2024-09-15T21:51:18.523 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T21:51:18.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T21:51:18.641 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906225' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAtifmMXFbH/pXe07yLF7sBFi/2vDghBG7rufFgAQzuxSTE8NFydYrX//dhtWfbDuF/v6uKVrJSBKuBsP5I+urg= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONiQaSbRxI5oGb8z6Vt/rpXloUrSTSrARgNQsaLrCeP5Oynml00GDohkfvnkqSk9QHzDQ9F1KHw0Pcwt2Qsg/0= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGno21zuZkRE8loZEA5URvNJKG21h/tD8OhYLvIieMhtIupcB+g4tQs3JeuHMKy/xGDu4RSYMNIuq57QtLXYTdE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T21:51:18.641 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T21:51:18.642 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T21:51:18.642 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T21:51:18.643 INFO:teuthology.task.internal:Checking packages... 2024-09-15T21:51:18.665 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T21:51:18.666 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T21:51:18.666 INFO:teuthology.packaging:ref: None 2024-09-15T21:51:18.666 INFO:teuthology.packaging:tag: None 2024-09-15T21:51:18.666 INFO:teuthology.packaging:branch: squid 2024-09-15T21:51:18.666 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:51:18.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T21:51:18.895 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326.g8921c8ef 2024-09-15T21:51:18.897 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T21:51:18.904 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T21:51:18.904 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T21:51:18.943 INFO:teuthology.task.internal:Saving configuration 2024-09-15T21:51:18.967 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T21:51:18.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T21:51:18.999 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:46:05.524663', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAtifmMXFbH/pXe07yLF7sBFi/2vDghBG7rufFgAQzuxSTE8NFydYrX//dhtWfbDuF/v6uKVrJSBKuBsP5I+urg='} 2024-09-15T21:51:19.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:46:05.522058', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONiQaSbRxI5oGb8z6Vt/rpXloUrSTSrARgNQsaLrCeP5Oynml00GDohkfvnkqSk9QHzDQ9F1KHw0Pcwt2Qsg/0='} 2024-09-15T21:51:19.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:46:05.523454', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGno21zuZkRE8loZEA5URvNJKG21h/tD8OhYLvIieMhtIupcB+g4tQs3JeuHMKy/xGDu4RSYMNIuq57QtLXYTdE='} 2024-09-15T21:51:19.048 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T21:51:19.055 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T21:51:19.055 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T21:51:19.055 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T21:51:19.055 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T21:51:19.171 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1aadca3520>, signals=[15]) 2024-09-15T21:51:19.171 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T21:51:19.177 INFO:teuthology.task.internal:Opening connections... 2024-09-15T21:51:19.177 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T21:51:19.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:51:19.264 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-15T21:51:19.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:51:19.341 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T21:51:19.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:51:19.416 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T21:51:19.423 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-15T21:51:19.442 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-15T21:51:19.443 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-15T21:51:19.500 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:51:19.501 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:51:19.502 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:51:19.502 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-15T21:51:19.522 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-15T21:51:19.541 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-15T21:51:19.541 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:51:19.600 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:51:19.601 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:51:19.601 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:51:19.601 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:51:19.601 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:51:19.601 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-15T21:51:19.621 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-15T21:51:19.640 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-15T21:51:19.640 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-15T21:51:19.698 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-15T21:51:19.698 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-15T21:51:19.698 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:51:19.699 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:51:19.700 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-15T21:51:19.721 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T21:51:19.732 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T21:51:19.751 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T21:51:19.751 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:51:19.754 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:51:19.756 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:51:19.773 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T21:51:19.780 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T21:51:19.780 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:51:19.812 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:51:19.814 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:51:19.927 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T21:51:20.002 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T21:51:20.018 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T21:51:20.018 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-15T21:51:20.018 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-15T21:51:20.018 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:51:20.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:51:20.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-15T21:51:20.212 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T21:51:20.212 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-15T21:51:20.213 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-15T21:51:20.231 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-503.el9.x86_64 2024-09-15T21:51:20.231 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T21:51:20.231 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-15T21:51:20.232 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum upgrade -y linux-firmware 2024-09-15T21:51:22.733 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-15T21:51:24.626 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-15T21:51:29.293 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-15T21:51:31.002 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-15T21:51:31.907 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-15T21:51:37.396 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T21:51:39.485 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-15T21:51:39.486 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-15T21:51:39.486 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-15T21:51:39.580 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T21:51:39.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T21:51:39.733 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-15T21:51:39.733 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-15T21:51:39.736 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi150.front.sepia.ceph.com to complete... 2024-09-15T21:51:46.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15 21:51:46 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-15T21:51:46.036 INFO:teuthology.orchestra.run.smithi150.stderr:FINISHED --2024-09-15 21:51:46-- 2024-09-15T21:51:46.036 INFO:teuthology.orchestra.run.smithi150.stderr:Total wall clock time: 6.3s 2024-09-15T21:51:46.036 INFO:teuthology.orchestra.run.smithi150.stderr:Downloaded: 1 files, 343M in 6.0s (57.3 MB/s) 2024-09-15T21:51:46.039 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T21:51:46.039 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-15T21:51:48.407 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying... ######################################## 2024-09-15T21:51:48.619 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing... ######################################## 2024-09-15T21:51:48.720 INFO:teuthology.orchestra.run.smithi150.stdout:Updating / installing... 2024-09-15T21:51:56.690 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-15T21:52:36.438 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-15T21:52:36.438 DEBUG:teuthology.orchestra.run.smithi150:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-15T21:52:36.533 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.533 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.533 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-15T21:52:36.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-15T21:52:36.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-15T21:52:36.536 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-15T21:52:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-15T21:52:36.538 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-15T21:52:36.539 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-15T21:52:36.540 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-15T21:52:36.541 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-15T21:52:36.542 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-15T21:52:36.543 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-15T21:52:36.544 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-15T21:52:36.545 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-15T21:52:36.546 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-15T21:52:36.547 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-15T21:52:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-15T21:52:36.549 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-15T21:52:36.550 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-15T21:52:36.551 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-15T21:52:36.552 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-15T21:52:36.553 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-15T21:52:36.554 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-15T21:52:36.555 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-15T21:52:36.556 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-15T21:52:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-15T21:52:36.558 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-15T21:52:36.559 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-15T21:52:36.560 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-15T21:52:36.561 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-15T21:52:36.562 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-15T21:52:36.563 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-15T21:52:36.564 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-15T21:52:36.565 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-15T21:52:36.566 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-15T21:52:36.567 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-15T21:52:36.568 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-15T21:52:36.569 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-15T21:52:36.570 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-15T21:52:36.571 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-15T21:52:36.572 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-15T21:52:36.573 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-15T21:52:36.574 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-15T21:52:36.575 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-15T21:52:36.576 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-15T21:52:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-15T21:52:36.578 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-15T21:52:36.579 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-15T21:52:36.580 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-15T21:52:36.581 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-15T21:52:36.582 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-15T21:52:36.583 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-15T21:52:36.584 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-15T21:52:36.585 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-15T21:52:36.586 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-15T21:52:36.587 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-15T21:52:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-15T21:52:36.589 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-15T21:52:36.590 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-15T21:52:36.591 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-15T21:52:36.592 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-15T21:52:36.593 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-15T21:52:36.594 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-15T21:52:36.595 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-15T21:52:36.596 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-15T21:52:36.597 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-15T21:52:36.598 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-15T21:52:36.599 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-15T21:52:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-15T21:52:36.601 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-15T21:52:36.602 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-15T21:52:36.603 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-15T21:52:36.604 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-15T21:52:36.605 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-15T21:52:36.606 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-15T21:52:36.607 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-15T21:52:36.608 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-15T21:52:36.609 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-15T21:52:36.610 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-15T21:52:36.611 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-15T21:52:36.612 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-15T21:52:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-15T21:52:36.614 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-15T21:52:36.615 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-15T21:52:36.616 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-15T21:52:36.617 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-15T21:52:36.618 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-15T21:52:36.619 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-15T21:52:36.620 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-15T21:52:36.621 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-15T21:52:36.622 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-15T21:52:36.623 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-15T21:52:36.624 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-15T21:52:36.625 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-15T21:52:36.626 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-15T21:52:36.627 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-15T21:52:36.628 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-15T21:52:36.629 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-15T21:52:36.630 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-15T21:52:36.631 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-15T21:52:36.632 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-15T21:52:36.633 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-15T21:52:36.634 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-15T21:52:36.635 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-15T21:52:36.636 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-15T21:52:36.637 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-15T21:52:36.638 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-15T21:52:36.639 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-15T21:52:36.640 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-15T21:52:36.641 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-15T21:52:36.642 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-15T21:52:36.643 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-15T21:52:36.644 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-15T21:52:36.645 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-15T21:52:36.646 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-15T21:52:36.647 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-15T21:52:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-15T21:52:36.649 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-15T21:52:36.650 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-15T21:52:36.651 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-15T21:52:36.652 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-15T21:52:36.653 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-15T21:52:36.654 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-15T21:52:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-15T21:52:36.656 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-15T21:52:36.657 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-15T21:52:36.658 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-15T21:52:36.659 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-15T21:52:36.660 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-15T21:52:36.661 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-15T21:52:36.662 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-15T21:52:36.663 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-15T21:52:36.664 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-15T21:52:36.665 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-15T21:52:36.666 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-15T21:52:36.667 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-15T21:52:36.668 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-15T21:52:36.669 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-15T21:52:36.670 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-15T21:52:36.671 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-15T21:52:36.672 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-15T21:52:36.673 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-15T21:52:36.674 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-15T21:52:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-15T21:52:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-15T21:52:36.677 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-15T21:52:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-15T21:52:36.681 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-15T21:52:36.682 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-15T21:52:36.683 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-15T21:52:36.684 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-15T21:52:36.685 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-15T21:52:36.689 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.690 DEBUG:teuthology.orchestra.run.smithi150:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout:postinstall scriptlet (using /bin/sh): 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout:for file in vmlinuz System.map config; do 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout: fi 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-15T21:52:36.714 INFO:teuthology.orchestra.run.smithi150.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.715 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-15T21:52:36.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 82.el9 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8274670 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T21:52:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-09-15T21:52:36.793 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T21:52:36.793 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T21:52:36.794 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T21:52:36.794 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:36.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T21:52:37.401 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-15T21:52:38.817 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T21:52:38.850 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-15T21:52:38.852 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-15T21:52:38.867 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.dfrcWkPAC0 2024-09-15T21:52:38.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dfrcWkPAC0 2024-09-15T21:52:38.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.dfrcWkPAC0 2024-09-15T21:52:39.088 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.dfrcWkPAC0 is 6KB 2024-09-15T21:52:39.136 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.dfrcWkPAC0 2024-09-15T21:52:39.151 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T21:52:39.214 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T21:52:39.215 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T21:52:39.215 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T21:52:39.215 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-15T21:52:39.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:52:39.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-15T21:53:09.364 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T21:53:09.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-15T21:53:09.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:53:43.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-15T21:53:52.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-15T21:53:53.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:54:11.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-15T21:54:23.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-15T21:54:23.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:54:24.646 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-15T21:54:25.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-15T21:54:25.170 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-15T21:54:25.171 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-15T21:54:25.205 INFO:teuthology.orchestra.run.smithi150.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:54:25.205 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T21:54:25.205 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T21:54:25.205 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T21:54:26.207 DEBUG:teuthology.parallel:result is None 2024-09-15T21:54:26.207 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T21:54:26.215 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T21:54:26.216 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:54:26.222 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:54:26.225 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:54:26.253 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T21:54:26.278 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T21:54:26.314 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T21:54:26.315 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:54:26.318 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:54:26.321 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:54:26.468 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T21:54:26.479 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T21:54:26.479 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:54:26.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:26.497 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:54:26.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:26.514 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:54:26.518 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:54:26.539 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:54:26.606 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:54:26.613 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:54:26.621 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:54:26.622 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:54:26.639 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:54:26.641 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:54:26.645 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T21:54:26.656 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T21:54:26.656 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:54:26.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:54:26.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:54:26.712 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T21:54:26.725 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T21:54:26.725 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:54:26.729 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:54:26.731 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:54:26.760 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:54:26.864 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:54:26.937 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:54:27.001 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:54:27.070 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T21:54:27.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:54:27.135 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:54:27.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:54:27.240 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:54:27.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:54:27.367 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T21:54:27.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:54:27.435 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:54:27.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:54:27.541 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:54:27.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:54:27.668 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T21:54:27.668 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:54:27.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-15T21:54:27.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-15T21:54:27.743 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-15T21:54:27.782 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T21:54:27.818 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T21:54:27.825 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T21:54:28.244 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T21:54:28.252 INFO:teuthology.task.internal:Starting timer... 2024-09-15T21:54:28.252 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T21:54:28.301 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T21:54:28.340 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T21:54:28.340 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-09-15T21:54:28.423 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-09-15T21:54:28.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-15T21:54:28.490 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-15T21:54:28.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-15T21:54:28.557 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-15T21:54:28.559 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T21:54:28.559 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-09-15T21:54:28.597 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-09-15T21:54:28.597 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-15T21:54:28.624 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-15T21:54:28.625 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-15T21:54:28.649 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-15T21:54:28.650 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi150.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-09-15T21:54:28.650 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T21:54:28.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:28.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T21:54:28.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:28.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T21:54:28.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:28.766 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T21:54:28.766 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-09-15T21:54:28.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-15T21:54:28.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-15T21:54:28.922 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T21:54:28.931 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T21:54:28.934 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T21:54:29.053 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T21:54:29.064 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T21:54:29.065 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi150.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T21:59:03.577 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-15T21:59:03.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-15T21:59:03.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:03.670 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-15T21:59:03.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-15T21:59:03.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-15T21:59:03.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:03.850 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-15T21:59:03.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-15T21:59:03.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T21:59:03.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:04.011 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-15T21:59:04.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T21:59:04.090 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T21:59:04.101 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T21:59:04.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T21:59:04.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:59:04.106 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T21:59:04.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:59:04.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T21:59:04.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:59:04.137 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T21:59:04.152 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T21:59:04.159 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T21:59:04.163 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T21:59:04.174 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T21:59:04.177 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-15T21:59:04.189 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-15T21:59:04.192 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T21:59:04.199 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-15T21:59:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T21:59:04.211 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-15T21:59:04.218 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T21:59:04.225 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T21:59:04.239 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T21:59:04.244 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-09-15T21:59:04.269 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-09-15T21:59:04.279 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-15T21:59:04.283 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T21:59:04.284 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-15T21:59:04.284 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.284 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.284 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.284 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.297 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-15T21:59:04.298 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T21:59:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T21:59:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-15T21:59:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.328 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T21:59:04.420 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-15T21:59:04.426 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T21:59:04.427 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-15T21:59:04.427 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.427 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.427 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.427 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T21:59:04.428 INFO:teuthology.run_tasks:Running task install... 2024-09-15T21:59:04.435 DEBUG:teuthology.task.install:project ceph 2024-09-15T21:59:04.436 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T21:59:04.436 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T21:59:04.436 INFO:teuthology.task.install:Using flavor: default 2024-09-15T21:59:04.441 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T21:59:04.441 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T21:59:04.442 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T21:59:04.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:59:04.444 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T21:59:04.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:59:04.445 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T21:59:04.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:59:04.590 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T21:59:04.591 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T21:59:04.594 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T21:59:04.594 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T21:59:04.600 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T21:59:04.600 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T21:59:04.700 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T21:59:04.701 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T21:59:04.701 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T21:59:04.708 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T21:59:04.709 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T21:59:04.709 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T21:59:04.715 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T21:59:04.715 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T21:59:04.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T21:59:04.735 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T21:59:04.736 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T21:59:04.743 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T21:59:04.743 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T21:59:04.758 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T21:59:04.758 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T21:59:04.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T21:59:04.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T21:59:04.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T21:59:04.878 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T21:59:04.886 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T21:59:04.934 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T21:59:04.943 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-15T21:59:04.945 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-15T21:59:04.952 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-15T21:59:04.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-15T21:59:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-09-15T21:59:04.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-09-15T21:59:05.170 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-15T21:59:05.181 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-15T21:59:05.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T21:59:05.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T21:59:05.261 INFO:teuthology.orchestra.run.smithi150.stdout:45 files removed 2024-09-15T21:59:05.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T21:59:05.754 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 311 kB/s | 83 kB 00:00 2024-09-15T21:59:05.784 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 269 kB/s | 83 kB 00:00 2024-09-15T21:59:06.002 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 279 kB/s | 83 kB 00:00 2024-09-15T21:59:06.038 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-15T21:59:06.076 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-15T21:59:06.294 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-15T21:59:06.305 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-15T21:59:06.343 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-15T21:59:06.569 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T21:59:07.039 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-15T21:59:07.060 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-15T21:59:07.478 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-09-15T21:59:08.915 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-15T21:59:08.945 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-15T21:59:09.312 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-15T21:59:13.224 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-15T21:59:13.279 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T21:59:14.741 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-15T21:59:14.763 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-15T21:59:15.038 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-15T21:59:15.845 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-15T21:59:16.084 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-15T21:59:16.597 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-15T21:59:17.818 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-15T21:59:21.343 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-15T21:59:21.556 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-15T21:59:23.630 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T21:59:23.630 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T21:59:23.644 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T21:59:23.645 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T21:59:23.646 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T21:59:23.647 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T21:59:23.649 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T21:59:23.652 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T21:59:23.653 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T21:59:23.716 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T21:59:23.737 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T21:59:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T21:59:23.739 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T21:59:23.740 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T21:59:23.741 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T21:59:23.742 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T21:59:23.743 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T21:59:23.744 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T21:59:23.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T21:59:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T21:59:23.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T21:59:23.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T21:59:23.749 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T21:59:23.750 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-15T21:59:23.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T21:59:23.752 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 226 M 2024-09-15T21:59:23.752 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-15T21:59:23.861 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T21:59:23.862 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T21:59:23.875 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T21:59:23.876 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T21:59:23.877 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T21:59:23.878 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T21:59:23.880 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T21:59:23.882 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T21:59:23.883 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T21:59:23.946 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-15T21:59:23.968 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-15T21:59:23.968 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-15T21:59:23.968 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-15T21:59:23.968 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T21:59:23.969 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T21:59:23.970 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T21:59:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T21:59:23.972 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T21:59:23.973 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T21:59:23.974 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T21:59:23.975 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T21:59:23.976 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T21:59:23.977 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T21:59:23.978 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T21:59:23.979 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T21:59:23.980 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 8 Packages 2024-09-15T21:59:23.981 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T21:59:23.982 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 226 M 2024-09-15T21:59:23.982 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-15T21:59:24.161 INFO:teuthology.orchestra.run.smithi154.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-15T21:59:24.165 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-15T21:59:24.344 INFO:teuthology.orchestra.run.smithi154.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-15T21:59:24.403 INFO:teuthology.orchestra.run.smithi154.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.4 MB/s | 145 kB 00:00 2024-09-15T21:59:24.533 INFO:teuthology.orchestra.run.smithi169.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 33 kB/s | 6.5 kB 00:00 2024-09-15T21:59:24.570 INFO:teuthology.orchestra.run.smithi154.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-15T21:59:24.620 INFO:teuthology.orchestra.run.smithi154.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-15T21:59:24.695 INFO:teuthology.orchestra.run.smithi154.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-15T21:59:24.858 INFO:teuthology.orchestra.run.smithi169.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.7 MB/s | 896 kB 00:00 2024-09-15T21:59:24.950 INFO:teuthology.orchestra.run.smithi169.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.5 MB/s | 145 kB 00:00 2024-09-15T21:59:25.054 INFO:teuthology.orchestra.run.smithi154.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-15T21:59:25.446 INFO:teuthology.orchestra.run.smithi154.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-15T21:59:25.483 INFO:teuthology.orchestra.run.smithi169.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 4.5 MB/s | 2.4 MB 00:00 2024-09-15T21:59:25.496 INFO:teuthology.orchestra.run.smithi154.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 509 kB/s | 25 kB 00:00 2024-09-15T21:59:25.801 INFO:teuthology.orchestra.run.smithi169.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-15T21:59:25.863 INFO:teuthology.orchestra.run.smithi154.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 14 MB/s | 17 MB 00:01 2024-09-15T21:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 11 MB/s | 11 MB 00:00 2024-09-15T21:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.5 MB/s | 228 kB 00:00 2024-09-15T21:59:26.039 INFO:teuthology.orchestra.run.smithi154.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 461 kB/s | 27 kB 00:00 2024-09-15T21:59:26.064 INFO:teuthology.orchestra.run.smithi154.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 629 kB/s | 32 kB 00:00 2024-09-15T21:59:26.092 INFO:teuthology.orchestra.run.smithi169.stdout:(6/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-15T21:59:26.123 INFO:teuthology.orchestra.run.smithi154.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-15T21:59:26.148 INFO:teuthology.orchestra.run.smithi154.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.9 MB/s | 163 kB 00:00 2024-09-15T21:59:26.182 INFO:teuthology.orchestra.run.smithi154.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T21:59:26.224 INFO:teuthology.orchestra.run.smithi154.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 6.6 MB/s | 506 kB 00:00 2024-09-15T21:59:26.299 INFO:teuthology.orchestra.run.smithi154.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 603 kB/s | 45 kB 00:00 2024-09-15T21:59:26.374 INFO:teuthology.orchestra.run.smithi154.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T21:59:26.384 INFO:teuthology.orchestra.run.smithi169.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 8.1 MB/s | 4.7 MB 00:00 2024-09-15T21:59:26.441 INFO:teuthology.orchestra.run.smithi154.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-15T21:59:26.533 INFO:teuthology.orchestra.run.smithi154.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 3.4 MB/s | 320 kB 00:00 2024-09-15T21:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout:(23/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-15T21:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.7 MB/s | 300 kB 00:00 2024-09-15T21:59:26.655 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T21:59:26.656 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T21:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T21:59:26.669 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T21:59:26.670 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T21:59:26.671 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T21:59:26.672 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T21:59:26.674 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T21:59:26.677 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T21:59:26.678 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T21:59:26.693 INFO:teuthology.orchestra.run.smithi154.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T21:59:26.743 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-15T21:59:26.751 INFO:teuthology.orchestra.run.smithi154.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================== 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================== 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T21:59:26.758 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T21:59:26.759 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T21:59:26.760 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T21:59:26.761 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T21:59:26.762 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T21:59:26.763 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T21:59:26.764 INFO:teuthology.orchestra.run.smithi150.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T21:59:26.765 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T21:59:26.766 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T21:59:26.767 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T21:59:26.768 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T21:59:26.769 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T21:59:26.770 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================== 2024-09-15T21:59:26.771 INFO:teuthology.orchestra.run.smithi150.stdout:Install 148 Packages 2024-09-15T21:59:26.772 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 8 Packages 2024-09-15T21:59:26.772 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T21:59:26.772 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 226 M 2024-09-15T21:59:26.772 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-15T21:59:26.810 INFO:teuthology.orchestra.run.smithi169.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 8.6 MB/s | 21 MB 00:02 2024-09-15T21:59:26.810 INFO:teuthology.orchestra.run.smithi154.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 546 kB/s | 32 kB 00:00 2024-09-15T21:59:26.860 INFO:teuthology.orchestra.run.smithi169.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 506 kB/s | 25 kB 00:00 2024-09-15T21:59:26.877 INFO:teuthology.orchestra.run.smithi154.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-15T21:59:26.902 INFO:teuthology.orchestra.run.smithi154.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.6 MB/s | 146 kB 00:00 2024-09-15T21:59:27.252 INFO:teuthology.orchestra.run.smithi154.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 9.5 MB/s | 3.6 MB 00:00 2024-09-15T21:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.7 MB/s | 249 kB 00:00 2024-09-15T21:59:27.419 INFO:teuthology.orchestra.run.smithi154.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 658 kB/s | 49 kB 00:00 2024-09-15T21:59:27.487 INFO:teuthology.orchestra.run.smithi154.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 245 kB/s | 16 kB 00:00 2024-09-15T21:59:27.562 INFO:teuthology.orchestra.run.smithi154.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 3.7 MB/s | 285 kB 00:00 2024-09-15T21:59:27.577 INFO:teuthology.orchestra.run.smithi169.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 17 MB 00:01 2024-09-15T21:59:27.646 INFO:teuthology.orchestra.run.smithi154.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-15T21:59:27.650 INFO:teuthology.orchestra.run.smithi150.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-09-15T21:59:27.660 INFO:teuthology.orchestra.run.smithi169.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 2.7 MB/s | 228 kB 00:00 2024-09-15T21:59:27.719 INFO:teuthology.orchestra.run.smithi169.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 463 kB/s | 27 kB 00:00 2024-09-15T21:59:27.746 INFO:teuthology.orchestra.run.smithi154.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 8.8 MB/s | 7.4 MB 00:00 2024-09-15T21:59:27.771 INFO:teuthology.orchestra.run.smithi154.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 145 kB/s | 18 kB 00:00 2024-09-15T21:59:27.777 INFO:teuthology.orchestra.run.smithi169.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 545 kB/s | 32 kB 00:00 2024-09-15T21:59:27.894 INFO:teuthology.orchestra.run.smithi169.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-15T21:59:27.969 INFO:teuthology.orchestra.run.smithi169.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.1 MB/s | 163 kB 00:00 2024-09-15T21:59:27.992 INFO:teuthology.orchestra.run.smithi150.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.6 MB/s | 896 kB 00:00 2024-09-15T21:59:28.036 INFO:teuthology.orchestra.run.smithi169.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.9 MB/s | 127 kB 00:00 2024-09-15T21:59:28.098 INFO:teuthology.orchestra.run.smithi150.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.3 MB/s | 145 kB 00:00 2024-09-15T21:59:28.147 INFO:teuthology.orchestra.run.smithi154.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 199 kB/s | 80 kB 00:00 2024-09-15T21:59:28.187 INFO:teuthology.orchestra.run.smithi169.stdout:(17/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 5.9 MB/s | 11 MB 00:01 2024-09-15T21:59:28.229 INFO:teuthology.orchestra.run.smithi169.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 2.6 MB/s | 506 kB 00:00 2024-09-15T21:59:28.284 INFO:teuthology.orchestra.run.smithi150.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 6.5 MB/s | 5.4 MB 00:00 2024-09-15T21:59:28.295 INFO:teuthology.orchestra.run.smithi169.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 679 kB/s | 45 kB 00:00 2024-09-15T21:59:28.371 INFO:teuthology.orchestra.run.smithi169.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T21:59:28.435 INFO:teuthology.orchestra.run.smithi150.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-15T21:59:28.440 INFO:teuthology.orchestra.run.smithi169.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-15T21:59:28.530 INFO:teuthology.orchestra.run.smithi169.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 3.4 MB/s | 320 kB 00:00 2024-09-15T21:59:28.552 INFO:teuthology.orchestra.run.smithi150.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2024-09-15T21:59:28.597 INFO:teuthology.orchestra.run.smithi169.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-15T21:59:28.672 INFO:teuthology.orchestra.run.smithi169.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.3 MB/s | 99 kB 00:00 2024-09-15T21:59:28.740 INFO:teuthology.orchestra.run.smithi169.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-15T21:59:28.781 INFO:teuthology.orchestra.run.smithi154.stdout:(40/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 15 MB/s | 49 MB 00:03 2024-09-15T21:59:28.794 INFO:teuthology.orchestra.run.smithi150.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-15T21:59:28.806 INFO:teuthology.orchestra.run.smithi154.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 290 kB/s | 191 kB 00:00 2024-09-15T21:59:28.939 INFO:teuthology.orchestra.run.smithi154.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 686 kB/s | 801 kB 00:01 2024-09-15T21:59:28.956 INFO:teuthology.orchestra.run.smithi169.stdout:(26/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-15T21:59:29.040 INFO:teuthology.orchestra.run.smithi169.stdout:(27/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 6.3 MB/s | 5.3 MB 00:00 2024-09-15T21:59:29.048 INFO:teuthology.orchestra.run.smithi154.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-15T21:59:29.065 INFO:teuthology.orchestra.run.smithi169.stdout:(28/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.5 MB/s | 170 kB 00:00 2024-09-15T21:59:29.124 INFO:teuthology.orchestra.run.smithi169.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 381 kB/s | 32 kB 00:00 2024-09-15T21:59:29.149 INFO:teuthology.orchestra.run.smithi169.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.7 MB/s | 146 kB 00:00 2024-09-15T21:59:29.173 INFO:teuthology.orchestra.run.smithi154.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-15T21:59:29.207 INFO:teuthology.orchestra.run.smithi154.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-15T21:59:29.291 INFO:teuthology.orchestra.run.smithi154.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-15T21:59:29.324 INFO:teuthology.orchestra.run.smithi154.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-15T21:59:29.349 INFO:teuthology.orchestra.run.smithi154.stdout:(48/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 445 kB/s | 253 kB 00:00 2024-09-15T21:59:29.517 INFO:teuthology.orchestra.run.smithi154.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-15T21:59:29.544 INFO:teuthology.orchestra.run.smithi150.stdout:(8/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 14 MB/s | 11 MB 00:00 2024-09-15T21:59:29.550 INFO:teuthology.orchestra.run.smithi154.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-15T21:59:29.575 INFO:teuthology.orchestra.run.smithi154.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-15T21:59:29.609 INFO:teuthology.orchestra.run.smithi154.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-15T21:59:29.636 INFO:teuthology.orchestra.run.smithi150.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 276 kB/s | 25 kB 00:00 2024-09-15T21:59:29.669 INFO:teuthology.orchestra.run.smithi154.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-15T21:59:29.716 INFO:teuthology.orchestra.run.smithi169.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-15T21:59:29.775 INFO:teuthology.orchestra.run.smithi169.stdout:(32/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 5.5 MB/s | 3.6 MB 00:00 2024-09-15T21:59:29.801 INFO:teuthology.orchestra.run.smithi169.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 2.9 MB/s | 249 kB 00:00 2024-09-15T21:59:29.817 INFO:teuthology.orchestra.run.smithi154.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-15T21:59:29.826 INFO:teuthology.orchestra.run.smithi169.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 961 kB/s | 49 kB 00:00 2024-09-15T21:59:29.843 INFO:teuthology.orchestra.run.smithi154.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 104 kB/s | 18 kB 00:00 2024-09-15T21:59:29.852 INFO:teuthology.orchestra.run.smithi169.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 327 kB/s | 16 kB 00:00 2024-09-15T21:59:29.868 INFO:teuthology.orchestra.run.smithi154.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-15T21:59:29.878 INFO:teuthology.orchestra.run.smithi150.stdout:(10/156): ceph-common-19.1.1-326.g8921c8ef.el9. 8.8 MB/s | 21 MB 00:02 2024-09-15T21:59:29.893 INFO:teuthology.orchestra.run.smithi169.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T21:59:29.919 INFO:teuthology.orchestra.run.smithi154.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-09-15T21:59:29.927 INFO:teuthology.orchestra.run.smithi169.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 10 MB/s | 765 kB 00:00 2024-09-15T21:59:29.936 INFO:teuthology.orchestra.run.smithi150.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.8 MB/s | 228 kB 00:00 2024-09-15T21:59:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-15T21:59:29.952 INFO:teuthology.orchestra.run.smithi169.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 311 kB/s | 18 kB 00:00 2024-09-15T21:59:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-15T21:59:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-15T21:59:30.012 INFO:teuthology.orchestra.run.smithi150.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 363 kB/s | 27 kB 00:00 2024-09-15T21:59:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-15T21:59:30.061 INFO:teuthology.orchestra.run.smithi154.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-15T21:59:30.078 INFO:teuthology.orchestra.run.smithi154.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-15T21:59:30.087 INFO:teuthology.orchestra.run.smithi150.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 422 kB/s | 32 kB 00:00 2024-09-15T21:59:30.120 INFO:teuthology.orchestra.run.smithi154.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-15T21:59:30.145 INFO:teuthology.orchestra.run.smithi154.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-15T21:59:30.162 INFO:teuthology.orchestra.run.smithi154.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-15T21:59:30.203 INFO:teuthology.orchestra.run.smithi169.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 290 kB/s | 80 kB 00:00 2024-09-15T21:59:30.204 INFO:teuthology.orchestra.run.smithi150.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-15T21:59:30.271 INFO:teuthology.orchestra.run.smithi150.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-15T21:59:30.296 INFO:teuthology.orchestra.run.smithi154.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-15T21:59:30.338 INFO:teuthology.orchestra.run.smithi154.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-15T21:59:30.354 INFO:teuthology.orchestra.run.smithi150.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.5 MB/s | 127 kB 00:00 2024-09-15T21:59:30.371 INFO:teuthology.orchestra.run.smithi154.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-15T21:59:30.397 INFO:teuthology.orchestra.run.smithi154.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T21:59:30.428 INFO:teuthology.orchestra.run.smithi169.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 850 kB/s | 191 kB 00:00 2024-09-15T21:59:30.464 INFO:teuthology.orchestra.run.smithi154.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-15T21:59:30.497 INFO:teuthology.orchestra.run.smithi154.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-15T21:59:30.523 INFO:teuthology.orchestra.run.smithi154.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-15T21:59:30.555 INFO:teuthology.orchestra.run.smithi150.stdout:(17/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 8.4 MB/s | 17 MB 00:02 2024-09-15T21:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-15T21:59:30.578 INFO:teuthology.orchestra.run.smithi169.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-15T21:59:30.588 INFO:teuthology.orchestra.run.smithi150.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 2.1 MB/s | 506 kB 00:00 2024-09-15T21:59:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-15T21:59:30.648 INFO:teuthology.orchestra.run.smithi154.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-15T21:59:30.664 INFO:teuthology.orchestra.run.smithi150.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 602 kB/s | 45 kB 00:00 2024-09-15T21:59:30.682 INFO:teuthology.orchestra.run.smithi154.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-15T21:59:30.707 INFO:teuthology.orchestra.run.smithi154.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-15T21:59:30.732 INFO:teuthology.orchestra.run.smithi154.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-15T21:59:30.739 INFO:teuthology.orchestra.run.smithi150.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T21:59:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 852 kB/s | 106 kB 00:00 2024-09-15T21:59:30.757 INFO:teuthology.orchestra.run.smithi154.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-15T21:59:30.806 INFO:teuthology.orchestra.run.smithi150.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-15T21:59:30.833 INFO:teuthology.orchestra.run.smithi154.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-15T21:59:30.858 INFO:teuthology.orchestra.run.smithi154.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-15T21:59:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-15T21:59:30.881 INFO:teuthology.orchestra.run.smithi150.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 4.2 MB/s | 320 kB 00:00 2024-09-15T21:59:30.883 INFO:teuthology.orchestra.run.smithi154.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-15T21:59:30.917 INFO:teuthology.orchestra.run.smithi154.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-15T21:59:30.934 INFO:teuthology.orchestra.run.smithi154.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T21:59:30.948 INFO:teuthology.orchestra.run.smithi150.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-15T21:59:30.954 INFO:teuthology.orchestra.run.smithi169.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-15T21:59:31.007 INFO:teuthology.orchestra.run.smithi150.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-15T21:59:31.009 INFO:teuthology.orchestra.run.smithi154.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-15T21:59:31.034 INFO:teuthology.orchestra.run.smithi154.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-15T21:59:31.060 INFO:teuthology.orchestra.run.smithi154.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 542 kB/s | 77 kB 00:00 2024-09-15T21:59:31.063 INFO:teuthology.orchestra.run.smithi169.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-15T21:59:31.082 INFO:teuthology.orchestra.run.smithi150.stdout:(25/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-15T21:59:31.085 INFO:teuthology.orchestra.run.smithi154.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-15T21:59:31.105 INFO:teuthology.orchestra.run.smithi169.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-09-15T21:59:31.108 INFO:teuthology.orchestra.run.smithi150.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 851 kB/s | 85 kB 00:00 2024-09-15T21:59:31.110 INFO:teuthology.orchestra.run.smithi154.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-15T21:59:31.135 INFO:teuthology.orchestra.run.smithi154.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-15T21:59:31.158 INFO:teuthology.orchestra.run.smithi150.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-15T21:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-15T21:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-09-15T21:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-15T21:59:31.241 INFO:teuthology.orchestra.run.smithi150.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 383 kB/s | 32 kB 00:00 2024-09-15T21:59:31.245 INFO:teuthology.orchestra.run.smithi154.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 752 kB/s | 44 kB 00:00 2024-09-15T21:59:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-15T21:59:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-15T21:59:31.308 INFO:teuthology.orchestra.run.smithi150.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.1 MB/s | 146 kB 00:00 2024-09-15T21:59:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-15T21:59:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-15T21:59:31.384 INFO:teuthology.orchestra.run.smithi150.stdout:(30/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-15T21:59:31.388 INFO:teuthology.orchestra.run.smithi154.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-15T21:59:31.421 INFO:teuthology.orchestra.run.smithi154.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-15T21:59:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-15T21:59:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-15T21:59:31.589 INFO:teuthology.orchestra.run.smithi169.stdout:(48/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 10 MB/s | 49 MB 00:04 2024-09-15T21:59:31.601 INFO:teuthology.orchestra.run.smithi150.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 12 MB/s | 3.6 MB 00:00 2024-09-15T21:59:31.697 INFO:teuthology.orchestra.run.smithi154.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-15T21:59:31.723 INFO:teuthology.orchestra.run.smithi154.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-15T21:59:31.773 INFO:teuthology.orchestra.run.smithi154.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-15T21:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-15T21:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-15T21:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-15T21:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-15T21:59:31.883 INFO:teuthology.orchestra.run.smithi154.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-15T21:59:31.916 INFO:teuthology.orchestra.run.smithi154.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T21:59:31.958 INFO:teuthology.orchestra.run.smithi154.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-15T21:59:32.009 INFO:teuthology.orchestra.run.smithi154.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-15T21:59:32.025 INFO:teuthology.orchestra.run.smithi154.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-15T21:59:32.051 INFO:teuthology.orchestra.run.smithi154.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T21:59:32.051 INFO:teuthology.orchestra.run.smithi150.stdout:(32/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 20 MB/s | 49 MB 00:02 2024-09-15T21:59:32.077 INFO:teuthology.orchestra.run.smithi150.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 525 kB/s | 249 kB 00:00 2024-09-15T21:59:32.084 INFO:teuthology.orchestra.run.smithi154.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-15T21:59:32.101 INFO:teuthology.orchestra.run.smithi150.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 995 kB/s | 49 kB 00:00 2024-09-15T21:59:32.109 INFO:teuthology.orchestra.run.smithi154.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-15T21:59:32.127 INFO:teuthology.orchestra.run.smithi150.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 329 kB/s | 16 kB 00:00 2024-09-15T21:59:32.135 INFO:teuthology.orchestra.run.smithi154.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T21:59:32.160 INFO:teuthology.orchestra.run.smithi150.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 285 kB 00:00 2024-09-15T21:59:32.168 INFO:teuthology.orchestra.run.smithi154.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T21:59:32.194 INFO:teuthology.orchestra.run.smithi154.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T21:59:32.203 INFO:teuthology.orchestra.run.smithi150.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 440 kB/s | 18 kB 00:00 2024-09-15T21:59:32.219 INFO:teuthology.orchestra.run.smithi154.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T21:59:32.236 INFO:teuthology.orchestra.run.smithi150.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-15T21:59:32.252 INFO:teuthology.orchestra.run.smithi154.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-15T21:59:32.305 INFO:teuthology.orchestra.run.smithi169.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 149 kB/s | 107 kB 00:00 2024-09-15T21:59:32.319 INFO:teuthology.orchestra.run.smithi154.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-15T21:59:32.328 INFO:teuthology.orchestra.run.smithi150.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 7.8 MB/s | 7.4 MB 00:00 2024-09-15T21:59:32.345 INFO:teuthology.orchestra.run.smithi154.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-15T21:59:32.353 INFO:teuthology.orchestra.run.smithi150.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 533 kB/s | 80 kB 00:00 2024-09-15T21:59:32.370 INFO:teuthology.orchestra.run.smithi154.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T21:59:32.395 INFO:teuthology.orchestra.run.smithi154.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-15T21:59:32.420 INFO:teuthology.orchestra.run.smithi154.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-15T21:59:32.437 INFO:teuthology.orchestra.run.smithi150.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-15T21:59:32.446 INFO:teuthology.orchestra.run.smithi154.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T21:59:32.462 INFO:teuthology.orchestra.run.smithi150.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-15T21:59:32.471 INFO:teuthology.orchestra.run.smithi154.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T21:59:32.472 INFO:teuthology.orchestra.run.smithi169.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 489 kB/s | 689 kB 00:01 2024-09-15T21:59:32.496 INFO:teuthology.orchestra.run.smithi154.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T21:59:32.506 INFO:teuthology.orchestra.run.smithi169.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 673 kB/s | 943 kB 00:01 2024-09-15T21:59:32.512 INFO:teuthology.orchestra.run.smithi150.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-15T21:59:32.521 INFO:teuthology.orchestra.run.smithi154.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T21:59:32.538 INFO:teuthology.orchestra.run.smithi150.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-15T21:59:32.555 INFO:teuthology.orchestra.run.smithi154.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-15T21:59:32.563 INFO:teuthology.orchestra.run.smithi150.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-15T21:59:32.589 INFO:teuthology.orchestra.run.smithi150.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-15T21:59:32.589 INFO:teuthology.orchestra.run.smithi154.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-15T21:59:32.614 INFO:teuthology.orchestra.run.smithi154.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-15T21:59:32.631 INFO:teuthology.orchestra.run.smithi150.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-15T21:59:32.639 INFO:teuthology.orchestra.run.smithi154.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T21:59:32.656 INFO:teuthology.orchestra.run.smithi150.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-15T21:59:32.665 INFO:teuthology.orchestra.run.smithi154.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-15T21:59:32.690 INFO:teuthology.orchestra.run.smithi154.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-15T21:59:32.724 INFO:teuthology.orchestra.run.smithi154.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-15T21:59:32.766 INFO:teuthology.orchestra.run.smithi154.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-15T21:59:32.791 INFO:teuthology.orchestra.run.smithi154.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-09-15T21:59:32.816 INFO:teuthology.orchestra.run.smithi154.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-15T21:59:32.823 INFO:teuthology.orchestra.run.smithi150.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-15T21:59:32.833 INFO:teuthology.orchestra.run.smithi154.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-15T21:59:32.856 INFO:teuthology.orchestra.run.smithi150.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-15T21:59:32.858 INFO:teuthology.orchestra.run.smithi154.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-15T21:59:32.864 INFO:teuthology.orchestra.run.smithi169.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-09-15T21:59:32.884 INFO:teuthology.orchestra.run.smithi154.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-15T21:59:32.908 INFO:teuthology.orchestra.run.smithi150.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-15T21:59:32.909 INFO:teuthology.orchestra.run.smithi154.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-15T21:59:32.932 INFO:teuthology.orchestra.run.smithi150.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-15T21:59:32.934 INFO:teuthology.orchestra.run.smithi154.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T21:59:32.960 INFO:teuthology.orchestra.run.smithi154.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T21:59:32.966 INFO:teuthology.orchestra.run.smithi150.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-15T21:59:33.010 INFO:teuthology.orchestra.run.smithi154.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T21:59:33.016 INFO:teuthology.orchestra.run.smithi150.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-15T21:59:33.058 INFO:teuthology.orchestra.run.smithi150.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 199 kB/s | 18 kB 00:00 2024-09-15T21:59:33.098 INFO:teuthology.orchestra.run.smithi169.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-09-15T21:59:33.099 INFO:teuthology.orchestra.run.smithi150.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-09-15T21:59:33.125 INFO:teuthology.orchestra.run.smithi150.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-15T21:59:33.167 INFO:teuthology.orchestra.run.smithi150.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-09-15T21:59:33.177 INFO:teuthology.orchestra.run.smithi154.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-15T21:59:33.201 INFO:teuthology.orchestra.run.smithi150.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-15T21:59:33.257 INFO:teuthology.orchestra.run.smithi169.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 400 kB/s | 313 kB 00:00 2024-09-15T21:59:33.259 INFO:teuthology.orchestra.run.smithi150.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.2 MB/s | 3.0 MB 00:00 2024-09-15T21:59:33.301 INFO:teuthology.orchestra.run.smithi150.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-15T21:59:33.343 INFO:teuthology.orchestra.run.smithi150.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 569 kB/s | 47 kB 00:00 2024-09-15T21:59:33.368 INFO:teuthology.orchestra.run.smithi150.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-15T21:59:33.369 INFO:teuthology.orchestra.run.smithi154.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-15T21:59:33.422 INFO:teuthology.orchestra.run.smithi150.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-09-15T21:59:33.469 INFO:teuthology.orchestra.run.smithi150.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-15T21:59:33.494 INFO:teuthology.orchestra.run.smithi150.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-15T21:59:33.599 INFO:teuthology.orchestra.run.smithi169.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 37 kB/s | 18 kB 00:00 2024-09-15T21:59:33.628 INFO:teuthology.orchestra.run.smithi150.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-15T21:59:33.685 INFO:teuthology.orchestra.run.smithi154.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 129 kB/s | 41 kB 00:00 2024-09-15T21:59:33.703 INFO:teuthology.orchestra.run.smithi150.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-15T21:59:33.749 INFO:teuthology.orchestra.run.smithi169.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-15T21:59:33.773 INFO:teuthology.orchestra.run.smithi150.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-15T21:59:33.785 INFO:teuthology.orchestra.run.smithi154.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 3.0 MB/s | 2.3 MB 00:00 2024-09-15T21:59:33.795 INFO:teuthology.orchestra.run.smithi150.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-15T21:59:33.838 INFO:teuthology.orchestra.run.smithi150.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-15T21:59:33.879 INFO:teuthology.orchestra.run.smithi150.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-15T21:59:33.904 INFO:teuthology.orchestra.run.smithi150.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-15T21:59:33.944 INFO:teuthology.orchestra.run.smithi154.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 8.6 MB/s | 1.4 MB 00:00 2024-09-15T21:59:33.978 INFO:teuthology.orchestra.run.smithi154.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.3 MB/s | 1.8 MB 00:00 2024-09-15T21:59:33.979 INFO:teuthology.orchestra.run.smithi150.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 818 kB/s | 61 kB 00:00 2024-09-15T21:59:34.024 INFO:teuthology.orchestra.run.smithi169.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-15T21:59:34.063 INFO:teuthology.orchestra.run.smithi150.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-15T21:59:34.089 INFO:teuthology.orchestra.run.smithi150.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-15T21:59:34.094 INFO:teuthology.orchestra.run.smithi154.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-15T21:59:34.114 INFO:teuthology.orchestra.run.smithi150.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-15T21:59:34.120 INFO:teuthology.orchestra.run.smithi154.stdout:(156/156): NetworkManager-tui-1.49.90-1.el9.x86 573 kB/s | 249 kB 00:00 2024-09-15T21:59:34.126 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-15T21:59:34.126 INFO:teuthology.orchestra.run.smithi154.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-15T21:59:34.156 INFO:teuthology.orchestra.run.smithi150.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 381 kB/s | 26 kB 00:00 2024-09-15T21:59:34.198 INFO:teuthology.orchestra.run.smithi150.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 230 kB/s | 19 kB 00:00 2024-09-15T21:59:34.223 INFO:teuthology.orchestra.run.smithi150.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-15T21:59:34.265 INFO:teuthology.orchestra.run.smithi150.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-09-15T21:59:34.325 INFO:teuthology.orchestra.run.smithi169.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-15T21:59:34.349 INFO:teuthology.orchestra.run.smithi150.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-15T21:59:34.374 INFO:teuthology.orchestra.run.smithi150.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-15T21:59:34.408 INFO:teuthology.orchestra.run.smithi150.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-15T21:59:34.433 INFO:teuthology.orchestra.run.smithi150.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-15T21:59:34.466 INFO:teuthology.orchestra.run.smithi169.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 185 kB/s | 160 kB 00:00 2024-09-15T21:59:34.475 INFO:teuthology.orchestra.run.smithi150.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-15T21:59:34.517 INFO:teuthology.orchestra.run.smithi150.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-15T21:59:34.542 INFO:teuthology.orchestra.run.smithi150.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-15T21:59:34.576 INFO:teuthology.orchestra.run.smithi150.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-15T21:59:34.626 INFO:teuthology.orchestra.run.smithi150.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-15T21:59:34.677 INFO:teuthology.orchestra.run.smithi150.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-09-15T21:59:34.752 INFO:teuthology.orchestra.run.smithi150.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.6 MB/s | 5.1 MB 00:00 2024-09-15T21:59:34.802 INFO:teuthology.orchestra.run.smithi150.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 42 kB 00:00 2024-09-15T21:59:34.852 INFO:teuthology.orchestra.run.smithi150.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-09-15T21:59:34.877 INFO:teuthology.orchestra.run.smithi150.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-15T21:59:34.928 INFO:teuthology.orchestra.run.smithi150.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-15T21:59:34.978 INFO:teuthology.orchestra.run.smithi150.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-15T21:59:35.003 INFO:teuthology.orchestra.run.smithi150.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-15T21:59:35.025 INFO:teuthology.orchestra.run.smithi169.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-15T21:59:35.053 INFO:teuthology.orchestra.run.smithi150.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 772 kB/s | 58 kB 00:00 2024-09-15T21:59:35.079 INFO:teuthology.orchestra.run.smithi150.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-15T21:59:35.129 INFO:teuthology.orchestra.run.smithi150.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-09-15T21:59:35.171 INFO:teuthology.orchestra.run.smithi150.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 487 kB/s | 45 kB 00:00 2024-09-15T21:59:35.296 INFO:teuthology.orchestra.run.smithi150.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-09-15T21:59:35.338 INFO:teuthology.orchestra.run.smithi150.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-09-15T21:59:35.376 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-15T21:59:35.383 INFO:teuthology.orchestra.run.smithi169.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 488 kB/s | 662 kB 00:01 2024-09-15T21:59:35.397 INFO:teuthology.orchestra.run.smithi150.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-15T21:59:35.447 INFO:teuthology.orchestra.run.smithi150.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 391 kB/s | 19 kB 00:00 2024-09-15T21:59:35.489 INFO:teuthology.orchestra.run.smithi150.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2024-09-15T21:59:35.529 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-15T21:59:35.529 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-15T21:59:35.556 INFO:teuthology.orchestra.run.smithi150.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-09-15T21:59:35.575 INFO:teuthology.orchestra.run.smithi169.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 465 kB/s | 581 kB 00:01 2024-09-15T21:59:35.601 INFO:teuthology.orchestra.run.smithi169.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-15T21:59:35.608 INFO:teuthology.orchestra.run.smithi150.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-15T21:59:35.632 INFO:teuthology.orchestra.run.smithi150.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-15T21:59:35.666 INFO:teuthology.orchestra.run.smithi150.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T21:59:35.841 INFO:teuthology.orchestra.run.smithi150.stdout:(112/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-15T21:59:35.900 INFO:teuthology.orchestra.run.smithi150.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-09-15T21:59:35.942 INFO:teuthology.orchestra.run.smithi150.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-15T21:59:35.984 INFO:teuthology.orchestra.run.smithi150.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 777 kB/s | 32 kB 00:00 2024-09-15T21:59:36.026 INFO:teuthology.orchestra.run.smithi150.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-15T21:59:36.059 INFO:teuthology.orchestra.run.smithi150.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-15T21:59:36.101 INFO:teuthology.orchestra.run.smithi150.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-09-15T21:59:36.135 INFO:teuthology.orchestra.run.smithi150.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-15T21:59:36.160 INFO:teuthology.orchestra.run.smithi150.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T21:59:36.167 INFO:teuthology.orchestra.run.smithi169.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-15T21:59:36.194 INFO:teuthology.orchestra.run.smithi150.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-15T21:59:36.227 INFO:teuthology.orchestra.run.smithi150.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-15T21:59:36.270 INFO:teuthology.orchestra.run.smithi150.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-15T21:59:36.301 INFO:teuthology.orchestra.run.smithi169.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 319 kB/s | 292 kB 00:00 2024-09-15T21:59:36.311 INFO:teuthology.orchestra.run.smithi150.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 427 kB/s | 18 kB 00:00 2024-09-15T21:59:36.353 INFO:teuthology.orchestra.run.smithi150.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 556 kB/s | 23 kB 00:00 2024-09-15T21:59:36.368 INFO:teuthology.orchestra.run.smithi169.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-09-15T21:59:36.412 INFO:teuthology.orchestra.run.smithi150.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 334 kB/s | 19 kB 00:00 2024-09-15T21:59:36.454 INFO:teuthology.orchestra.run.smithi150.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 473 kB/s | 20 kB 00:00 2024-09-15T21:59:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-15T21:59:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:(129/156): libarrow-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-15T21:59:36.655 INFO:teuthology.orchestra.run.smithi150.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 434 kB/s | 46 kB 00:00 2024-09-15T21:59:36.680 INFO:teuthology.orchestra.run.smithi150.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-15T21:59:36.722 INFO:teuthology.orchestra.run.smithi150.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-15T21:59:36.748 INFO:teuthology.orchestra.run.smithi150.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-09-15T21:59:36.773 INFO:teuthology.orchestra.run.smithi150.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-15T21:59:36.798 INFO:teuthology.orchestra.run.smithi150.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T21:59:36.823 INFO:teuthology.orchestra.run.smithi150.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-15T21:59:36.848 INFO:teuthology.orchestra.run.smithi150.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-15T21:59:36.874 INFO:teuthology.orchestra.run.smithi150.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T21:59:36.899 INFO:teuthology.orchestra.run.smithi150.stdout:(139/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-15T21:59:36.925 INFO:teuthology.orchestra.run.smithi150.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-15T21:59:36.950 INFO:teuthology.orchestra.run.smithi150.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-15T21:59:36.975 INFO:teuthology.orchestra.run.smithi150.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 990 kB/s | 74 kB 00:00 2024-09-15T21:59:37.000 INFO:teuthology.orchestra.run.smithi150.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T21:59:37.026 INFO:teuthology.orchestra.run.smithi150.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-15T21:59:37.051 INFO:teuthology.orchestra.run.smithi150.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T21:59:37.085 INFO:teuthology.orchestra.run.smithi150.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-15T21:59:37.118 INFO:teuthology.orchestra.run.smithi150.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-15T21:59:37.168 INFO:teuthology.orchestra.run.smithi150.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-15T21:59:37.342 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-15T21:59:37.343 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-15T21:59:37.377 INFO:teuthology.orchestra.run.smithi150.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-15T21:59:37.393 INFO:teuthology.orchestra.run.smithi169.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-15T21:59:37.419 INFO:teuthology.orchestra.run.smithi150.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.7 MB/s | 2.3 MB 00:00 2024-09-15T21:59:37.461 INFO:teuthology.orchestra.run.smithi150.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 983 kB/s | 41 kB 00:00 2024-09-15T21:59:37.503 INFO:teuthology.orchestra.run.smithi150.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-15T21:59:37.592 INFO:teuthology.orchestra.run.smithi150.stdout:(153/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 6.7 MB/s | 3.2 MB 00:00 2024-09-15T21:59:37.635 INFO:teuthology.orchestra.run.smithi169.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-15T21:59:37.637 INFO:teuthology.orchestra.run.smithi150.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 7.0 MB/s | 1.8 MB 00:00 2024-09-15T21:59:37.670 INFO:teuthology.orchestra.run.smithi150.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-15T21:59:37.685 INFO:teuthology.orchestra.run.smithi169.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2024-09-15T21:59:37.829 INFO:teuthology.orchestra.run.smithi150.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-15T21:59:37.834 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-15T21:59:37.834 INFO:teuthology.orchestra.run.smithi150.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-15T21:59:38.327 INFO:teuthology.orchestra.run.smithi169.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 975 kB/s | 910 kB 00:00 2024-09-15T21:59:38.352 INFO:teuthology.orchestra.run.smithi169.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-15T21:59:38.994 INFO:teuthology.orchestra.run.smithi169.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 136 kB/s | 87 kB 00:00 2024-09-15T21:59:39.899 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-15T21:59:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-15T21:59:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-15T21:59:40.261 INFO:teuthology.orchestra.run.smithi169.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 534 kB/s | 1.0 MB 00:01 2024-09-15T21:59:40.795 INFO:teuthology.orchestra.run.smithi169.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 1.9 MB/s | 5.8 MB 00:03 2024-09-15T21:59:40.878 INFO:teuthology.orchestra.run.smithi169.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-15T21:59:41.129 INFO:teuthology.orchestra.run.smithi169.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.8 MB/s | 6.0 MB 00:02 2024-09-15T21:59:41.679 INFO:teuthology.orchestra.run.smithi169.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 277 kB/s | 245 kB 00:00 2024-09-15T21:59:41.729 INFO:teuthology.orchestra.run.smithi169.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-09-15T21:59:41.788 INFO:teuthology.orchestra.run.smithi169.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 273 kB/s | 248 kB 00:00 2024-09-15T21:59:42.163 INFO:teuthology.orchestra.run.smithi169.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-15T21:59:42.366 INFO:teuthology.orchestra.run.smithi169.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-09-15T21:59:42.465 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-15T21:59:42.466 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-15T21:59:42.580 INFO:teuthology.orchestra.run.smithi169.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 202 kB/s | 172 kB 00:00 2024-09-15T21:59:43.205 INFO:teuthology.orchestra.run.smithi169.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 298 kB/s | 250 kB 00:00 2024-09-15T21:59:43.389 INFO:teuthology.orchestra.run.smithi169.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 277 kB/s | 222 kB 00:00 2024-09-15T21:59:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-15T21:59:43.723 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T21:59:43.839 INFO:teuthology.orchestra.run.smithi169.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-09-15T21:59:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T21:59:43.956 INFO:teuthology.orchestra.run.smithi169.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-09-15T21:59:44.059 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T21:59:44.100 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T21:59:44.125 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T21:59:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T21:59:44.497 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T21:59:44.609 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T21:59:44.730 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T21:59:44.731 INFO:teuthology.orchestra.run.smithi169.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-15T21:59:44.756 INFO:teuthology.orchestra.run.smithi169.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 294 kB/s | 269 kB 00:00 2024-09-15T21:59:44.760 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T21:59:44.834 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T21:59:44.865 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T21:59:45.013 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T21:59:45.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T21:59:45.097 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T21:59:45.201 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T21:59:45.223 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T21:59:45.285 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T21:59:45.307 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T21:59:45.333 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T21:59:45.373 INFO:teuthology.orchestra.run.smithi169.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2024-09-15T21:59:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T21:59:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T21:59:45.607 INFO:teuthology.orchestra.run.smithi169.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 319 kB/s | 279 kB 00:00 2024-09-15T21:59:45.731 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T21:59:45.824 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T21:59:45.924 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T21:59:45.999 INFO:teuthology.orchestra.run.smithi169.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 86 kB/s | 54 kB 00:00 2024-09-15T21:59:46.145 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T21:59:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T21:59:46.358 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T21:59:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T21:59:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T21:59:46.505 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T21:59:46.557 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T21:59:46.565 INFO:teuthology.orchestra.run.smithi169.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 74 kB/s | 42 kB 00:00 2024-09-15T21:59:46.600 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T21:59:46.644 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T21:59:46.676 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T21:59:46.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T21:59:46.765 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T21:59:46.818 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T21:59:46.856 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T21:59:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T21:59:46.933 INFO:teuthology.orchestra.run.smithi169.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-09-15T21:59:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T21:59:47.003 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T21:59:47.070 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T21:59:47.099 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T21:59:47.141 INFO:teuthology.orchestra.run.smithi169.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-15T21:59:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T21:59:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T21:59:47.298 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T21:59:47.433 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T21:59:47.484 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T21:59:47.708 INFO:teuthology.orchestra.run.smithi169.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 63 kB/s | 36 kB 00:00 2024-09-15T21:59:47.800 INFO:teuthology.orchestra.run.smithi169.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 255 kB/s | 221 kB 00:00 2024-09-15T21:59:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T21:59:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T21:59:48.125 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T21:59:48.167 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T21:59:48.205 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T21:59:48.247 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T21:59:48.342 INFO:teuthology.orchestra.run.smithi169.stdout:(97/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-09-15T21:59:48.367 INFO:teuthology.orchestra.run.smithi169.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-09-15T21:59:48.420 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T21:59:48.484 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T21:59:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T21:59:48.620 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T21:59:48.651 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T21:59:48.687 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T21:59:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T21:59:48.759 INFO:teuthology.orchestra.run.smithi169.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 317 kB/s | 304 kB 00:00 2024-09-15T21:59:48.770 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T21:59:48.813 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T21:59:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T21:59:48.971 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-15T21:59:48.975 INFO:teuthology.orchestra.run.smithi169.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-09-15T21:59:48.992 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T21:59:49.040 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T21:59:49.076 INFO:teuthology.orchestra.run.smithi169.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 135 kB/s | 96 kB 00:00 2024-09-15T21:59:49.082 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T21:59:49.126 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T21:59:49.182 INFO:teuthology.orchestra.run.smithi169.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 214 kB/s | 22 kB 00:00 2024-09-15T21:59:49.276 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T21:59:49.307 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T21:59:49.338 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T21:59:49.357 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T21:59:49.364 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T21:59:49.388 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T21:59:49.393 INFO:teuthology.orchestra.run.smithi169.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-15T21:59:49.427 INFO:teuthology.orchestra.run.smithi169.stdout:(104/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 95 kB/s | 64 kB 00:00 2024-09-15T21:59:49.462 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T21:59:49.469 INFO:teuthology.orchestra.run.smithi169.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-15T21:59:49.492 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T21:59:49.494 INFO:teuthology.orchestra.run.smithi169.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 842 kB/s | 19 kB 00:00 2024-09-15T21:59:49.527 INFO:teuthology.orchestra.run.smithi169.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-15T21:59:49.536 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T21:59:49.544 INFO:teuthology.orchestra.run.smithi169.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-15T21:59:49.561 INFO:teuthology.orchestra.run.smithi169.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-15T21:59:49.576 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T21:59:49.590 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T21:59:49.595 INFO:teuthology.orchestra.run.smithi169.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T21:59:49.620 INFO:teuthology.orchestra.run.smithi169.stdout:(111/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-09-15T21:59:49.629 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T21:59:49.633 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T21:59:49.645 INFO:teuthology.orchestra.run.smithi169.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-15T21:59:49.657 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T21:59:49.691 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T21:59:49.704 INFO:teuthology.orchestra.run.smithi169.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-15T21:59:49.721 INFO:teuthology.orchestra.run.smithi169.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-15T21:59:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T21:59:49.738 INFO:teuthology.orchestra.run.smithi169.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-15T21:59:49.755 INFO:teuthology.orchestra.run.smithi169.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 838 kB/s | 14 kB 00:00 2024-09-15T21:59:49.762 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T21:59:49.780 INFO:teuthology.orchestra.run.smithi169.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-15T21:59:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T21:59:49.814 INFO:teuthology.orchestra.run.smithi169.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.2 MB/s | 839 kB 00:00 2024-09-15T21:59:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T21:59:49.839 INFO:teuthology.orchestra.run.smithi169.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T21:59:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T21:59:49.898 INFO:teuthology.orchestra.run.smithi169.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-15T21:59:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T21:59:49.923 INFO:teuthology.orchestra.run.smithi169.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-15T21:59:49.935 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T21:59:49.948 INFO:teuthology.orchestra.run.smithi169.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-15T21:59:49.973 INFO:teuthology.orchestra.run.smithi169.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-15T21:59:49.999 INFO:teuthology.orchestra.run.smithi169.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-15T21:59:50.005 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T21:59:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T21:59:50.024 INFO:teuthology.orchestra.run.smithi169.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T21:59:50.050 INFO:teuthology.orchestra.run.smithi169.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-15T21:59:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T21:59:50.075 INFO:teuthology.orchestra.run.smithi169.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-15T21:59:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T21:59:50.100 INFO:teuthology.orchestra.run.smithi169.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-15T21:59:50.110 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T21:59:50.125 INFO:teuthology.orchestra.run.smithi169.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T21:59:50.151 INFO:teuthology.orchestra.run.smithi169.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T21:59:50.176 INFO:teuthology.orchestra.run.smithi169.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T21:59:50.203 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T21:59:50.218 INFO:teuthology.orchestra.run.smithi169.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-15T21:59:50.243 INFO:teuthology.orchestra.run.smithi169.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-15T21:59:50.255 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T21:59:50.267 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T21:59:50.268 INFO:teuthology.orchestra.run.smithi169.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-15T21:59:50.293 INFO:teuthology.orchestra.run.smithi169.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T21:59:50.294 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T21:59:50.319 INFO:teuthology.orchestra.run.smithi169.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-15T21:59:50.344 INFO:teuthology.orchestra.run.smithi169.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-15T21:59:50.370 INFO:teuthology.orchestra.run.smithi169.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-15T21:59:50.394 INFO:teuthology.orchestra.run.smithi169.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T21:59:50.407 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T21:59:50.420 INFO:teuthology.orchestra.run.smithi169.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-15T21:59:50.446 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T21:59:50.470 INFO:teuthology.orchestra.run.smithi169.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-15T21:59:50.495 INFO:teuthology.orchestra.run.smithi169.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 740 kB/s | 74 kB 00:00 2024-09-15T21:59:50.521 INFO:teuthology.orchestra.run.smithi169.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T21:59:50.546 INFO:teuthology.orchestra.run.smithi169.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T21:59:50.563 INFO:teuthology.orchestra.run.smithi169.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-15T21:59:50.589 INFO:teuthology.orchestra.run.smithi169.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-15T21:59:50.614 INFO:teuthology.orchestra.run.smithi169.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-15T21:59:50.660 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T21:59:50.664 INFO:teuthology.orchestra.run.smithi169.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T21:59:50.726 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T21:59:50.757 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T21:59:50.865 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T21:59:50.891 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T21:59:50.978 INFO:teuthology.orchestra.run.smithi169.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.7 MB/s | 3.2 MB 00:00 2024-09-15T21:59:50.986 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T21:59:50.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T21:59:51.034 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T21:59:51.038 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T21:59:51.072 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T21:59:51.076 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T21:59:51.115 INFO:teuthology.orchestra.run.smithi169.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 6.5 MB/s | 3.4 MB 00:00 2024-09-15T21:59:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T21:59:51.227 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T21:59:51.272 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T21:59:51.286 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T21:59:51.315 INFO:teuthology.orchestra.run.smithi169.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 204 kB/s | 41 kB 00:00 2024-09-15T21:59:51.360 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T21:59:51.408 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T21:59:51.465 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T21:59:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T21:59:51.615 INFO:teuthology.orchestra.run.smithi169.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 830 kB/s | 249 kB 00:00 2024-09-15T21:59:51.615 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T21:59:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T21:59:51.725 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T21:59:51.753 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T21:59:51.799 INFO:teuthology.orchestra.run.smithi169.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-15T21:59:51.833 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T21:59:51.874 INFO:teuthology.orchestra.run.smithi169.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.0 MB/s | 1.8 MB 00:00 2024-09-15T21:59:52.133 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T21:59:52.216 INFO:teuthology.orchestra.run.smithi169.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 1.4 MB 00:00 2024-09-15T21:59:52.273 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T21:59:52.367 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T21:59:52.386 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T21:59:52.424 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T21:59:52.468 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T21:59:52.487 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T21:59:52.549 INFO:teuthology.orchestra.run.smithi169.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 2.4 MB 00:00 2024-09-15T21:59:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T21:59:52.556 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-15T21:59:52.556 INFO:teuthology.orchestra.run.smithi169.stdout:Total 7.9 MB/s | 226 MB 00:28 2024-09-15T21:59:52.604 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T21:59:52.651 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T21:59:52.706 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T21:59:52.744 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T21:59:52.786 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T21:59:52.875 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T21:59:52.939 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T21:59:52.974 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T21:59:53.020 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T21:59:53.130 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T21:59:53.168 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T21:59:53.212 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T21:59:53.240 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T21:59:53.331 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T21:59:53.384 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T21:59:53.473 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T21:59:53.643 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T21:59:53.712 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T21:59:53.717 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T21:59:53.788 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-15T21:59:53.809 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T21:59:53.837 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T21:59:53.870 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T21:59:53.941 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-15T21:59:53.941 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-15T21:59:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T21:59:54.301 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T21:59:54.347 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T21:59:54.506 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T21:59:54.513 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T21:59:54.538 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T21:59:54.557 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T21:59:54.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T21:59:54.601 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T21:59:54.639 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T21:59:54.684 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T21:59:54.878 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T21:59:54.942 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T21:59:55.011 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T21:59:55.063 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T21:59:55.094 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T21:59:55.103 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T21:59:55.134 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T21:59:55.174 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T21:59:55.204 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T21:59:55.208 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T21:59:55.266 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T21:59:55.307 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T21:59:55.344 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T21:59:55.394 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T21:59:55.567 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T21:59:55.610 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T21:59:55.654 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T21:59:55.759 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-15T21:59:55.760 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-15T21:59:55.770 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T21:59:55.810 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T21:59:55.860 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T21:59:55.891 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T21:59:55.915 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T21:59:56.027 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T21:59:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T21:59:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T21:59:56.275 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T21:59:56.329 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T21:59:56.368 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T21:59:56.407 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T21:59:56.444 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T21:59:56.479 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T21:59:56.512 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T21:59:56.556 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T21:59:56.597 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T21:59:56.698 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T21:59:56.756 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T21:59:56.817 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T21:59:56.940 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T21:59:56.997 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T21:59:57.890 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T21:59:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T21:59:57.948 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T21:59:57.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T21:59:57.982 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T21:59:58.096 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T21:59:58.157 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T21:59:58.236 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T21:59:58.342 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T21:59:58.384 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T21:59:58.513 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T21:59:58.545 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T21:59:58.622 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T21:59:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T21:59:58.637 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T21:59:58.638 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T21:59:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T21:59:58.656 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T21:59:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T21:59:58.754 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T21:59:59.569 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T21:59:59.721 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:00:01.277 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:00:01.394 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:00:01.430 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:00:01.463 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:00:01.796 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:00:01.841 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:00:01.945 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:00:01.980 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:00:02.029 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:00:02.129 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-15T22:00:02.253 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:00:02.300 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:00:02.362 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:00:02.395 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:00:02.421 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:00:02.471 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:00:02.541 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:00:02.586 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:00:02.677 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:00:02.712 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:00:02.813 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:00:02.922 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:00:03.028 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:00:03.065 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:00:03.139 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:00:03.169 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:00:03.323 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:00:03.392 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:00:03.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:00:03.508 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:00:03.537 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:00:03.592 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:00:03.630 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:00:03.664 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:00:03.866 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:00:04.001 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:00:04.120 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:00:04.217 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:00:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:00:04.520 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:00:04.626 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:00:04.722 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:00:04.768 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:00:04.803 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:00:04.875 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:00:04.923 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:00:04.964 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:00:05.007 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:00:05.040 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:00:05.068 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:00:05.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:00:05.190 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:00:05.229 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:00:05.264 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:00:05.319 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:00:05.341 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:00:05.361 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:00:05.375 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:00:05.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:00:05.447 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:00:05.517 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:00:05.562 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:00:05.637 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:00:05.780 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:00:05.831 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:00:05.993 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:00:06.039 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:00:06.158 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:00:06.159 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:00:06.159 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:00:06.159 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:06.199 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:00:06.356 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:00:06.443 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:00:06.481 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:00:06.523 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:00:06.562 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:00:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:00:06.772 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:00:06.841 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:00:06.895 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:00:06.969 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:00:07.000 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:00:07.045 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:00:07.100 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:00:07.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:00:07.179 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:00:07.221 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:00:07.356 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:00:07.406 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:00:07.447 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:00:07.549 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:00:07.590 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:00:07.629 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:00:07.655 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:00:07.679 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:00:07.756 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:00:07.882 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:00:07.922 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:00:07.950 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:00:07.985 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:00:08.024 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:00:08.055 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:00:08.085 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:00:08.120 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:00:08.161 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:00:08.203 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:00:08.237 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:00:08.324 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:00:08.376 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:00:08.408 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:00:08.510 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:00:08.575 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:00:09.311 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:00:09.355 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:00:09.390 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:00:09.497 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:00:09.544 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:00:09.590 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:00:09.685 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:00:09.734 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:00:09.918 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:00:09.948 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:00:10.025 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:00:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-15T22:00:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:10.586 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:00:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:00:10.603 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:10.603 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:00:10.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:10.672 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:00:10.788 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:00:12.018 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:00:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:00:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:00:12.088 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:12.088 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:00:12.088 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:00:12.088 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:00:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:12.110 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:00:12.138 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:00:12.171 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:00:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:00:12.335 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:00:12.335 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:12.335 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:00:12.335 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:00:12.335 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:00:12.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:12.480 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:00:12.534 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:00:12.626 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:00:12.672 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:00:12.709 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:00:12.770 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:00:12.793 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:00:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:00:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:00:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:00:12.794 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:12.908 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:00:12.965 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:00:13.021 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:00:13.191 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:00:13.220 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:00:13.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:00:13.292 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:00:13.322 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:00:13.349 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:00:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:00:13.585 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:00:13.629 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:00:13.661 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:00:13.696 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:00:14.092 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:00:14.120 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:00:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:00:14.232 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:00:14.259 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:00:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:00:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:00:15.652 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:00:15.710 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:00:16.259 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:00:16.305 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:00:16.307 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:00:16.328 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:00:16.400 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:00:16.400 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:00:16.400 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:00:16.400 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:16.431 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:00:16.433 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:00:16.608 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:00:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:00:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:00:16.664 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:16.664 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:00:16.664 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:00:16.664 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:00:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:00:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:00:16.823 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:00:16.879 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:00:17.802 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:00:17.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:00:17.858 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:00:17.858 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:17.858 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:00:17.858 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:00:17.859 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:00:17.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:17.901 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:00:17.924 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:00:17.924 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:17.924 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:00:17.924 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:17.977 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:00:18.000 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:00:18.000 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:18.000 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:00:18.000 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:00:18.000 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:00:18.000 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:00:18.342 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:00:18.342 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:18.342 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:00:18.342 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:00:18.343 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:00:18.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:18.972 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:00:18.972 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-09-15T22:00:18.972 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-09-15T22:00:18.972 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-09-15T22:00:18.972 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-09-15T22:00:18.973 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-09-15T22:00:18.973 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-09-15T22:00:18.973 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-09-15T22:00:18.973 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:19.178 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:00:19.214 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:00:19.214 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:19.214 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:00:19.214 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:20.763 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:00:20.821 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:00:20.821 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:20.822 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:00:20.822 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:00:20.822 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:00:20.822 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:21.072 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:00:21.123 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:00:21.123 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:21.123 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:00:21.123 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:00:21.124 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:00:21.124 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:21.606 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:00:21.657 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:00:21.657 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:21.657 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:00:21.658 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:00:21.658 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:00:21.658 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:21.790 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:00:21.850 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:00:21.914 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:00:22.149 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:00:22.210 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:00:22.295 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:00:22.403 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:00:22.579 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:00:22.641 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:00:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:00:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:00:22.880 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:00:22.921 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:00:22.962 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:00:22.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:00:23.022 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:00:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:00:23.224 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:00:23.258 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:00:23.290 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:00:23.350 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:00:23.358 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:00:23.411 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:00:23.972 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:24.013 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:24.035 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:24.628 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:00:24.674 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:00:24.878 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:00:24.968 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:00:25.009 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:00:25.090 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:00:25.129 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:00:25.155 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:00:25.180 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:00:25.181 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:00:25.248 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:00:25.248 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:00:25.315 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:00:25.340 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:00:25.346 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:25.346 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:00:25.618 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:00:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:25.760 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:00:25.799 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:00:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:00:26.131 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:00:26.159 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:00:26.210 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:00:26.211 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:26.211 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:00:26.211 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:00:26.211 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:00:26.211 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:26.277 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:00:26.303 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:00:26.410 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:00:26.471 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:00:27.472 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:00:27.504 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:00:27.555 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:00:27.555 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:27.555 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:00:27.555 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:00:27.556 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:00:27.556 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:27.614 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:00:27.663 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:00:27.663 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:27.663 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:00:27.663 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:27.722 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:00:27.773 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:00:27.773 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:27.773 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:00:27.773 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:00:27.773 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:00:27.773 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:28.106 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:00:28.157 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:00:28.157 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:28.157 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:00:28.158 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:00:28.158 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:00:28.158 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:28.478 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-15T22:00:28.479 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:28.651 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:00:28.668 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:00:28.668 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:28.669 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:00:28.669 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:30.162 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:00:30.190 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:00:30.190 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:30.190 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:00:30.190 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:00:30.191 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:00:30.191 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:30.421 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:00:30.445 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:00:30.445 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:30.445 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:00:30.445 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:00:30.446 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:00:30.446 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:30.881 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:00:30.904 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:00:30.905 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:30.905 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:00:30.905 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:00:30.905 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:00:30.905 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:31.010 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:00:31.068 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:00:31.123 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:00:31.317 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:00:31.364 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:00:31.436 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:00:31.522 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:00:31.661 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:00:31.715 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:00:31.746 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:00:31.774 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:00:32.154 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:00:32.181 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:00:32.213 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:00:32.275 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:00:32.304 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:00:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:00:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:00:33.196 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:00:33.225 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:00:33.260 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:00:33.353 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:00:33.398 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:00:33.500 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:00:33.549 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:00:33.579 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:00:33.618 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:00:33.671 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:33.989 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.990 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.991 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:00:33.992 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:00:33.993 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:00:33.994 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:00:33.995 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.996 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.996 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:33.996 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:00:33.996 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:00:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:00:33.998 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:00:33.999 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:00:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:00:34.001 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:00:34.002 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:00:34.003 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:00:34.003 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:00:34.003 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-15T22:00:34.367 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:00:34.406 DEBUG:teuthology.parallel:result is None 2024-09-15T22:00:34.406 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:00:34.430 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:34.469 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:34.509 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:00:34.510 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:34.678 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:00:34.717 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:00:34.741 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:00:34.741 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:34.741 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:00:34.741 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:00:34.741 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:00:34.741 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:34.793 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:00:34.805 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:00:34.902 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:00:34.975 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:00:35.791 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:00:35.899 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:00:35.907 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:00:35.929 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:00:35.952 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:00:35.952 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:35.952 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:00:35.952 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:00:35.952 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:00:35.952 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:00:35.996 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:00:36.019 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:00:36.019 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:36.019 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:00:36.019 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:36.080 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:00:36.098 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:00:36.103 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:00:36.103 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:36.103 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:00:36.103 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:00:36.104 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:00:36.104 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:36.134 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:00:36.160 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:00:36.196 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:00:36.197 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:00:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:00:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:00:36.405 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:00:36.429 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:00:36.429 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:00:36.429 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:00:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:00:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:00:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:36.463 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:00:36.487 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:00:36.503 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:36.503 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:36.748 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:36.748 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:00:36.858 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:00:36.931 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:37.144 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:37.144 INFO:teuthology.orchestra.run.smithi150.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-15T22:00:37.144 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:40.992 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:00:41.034 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:00:41.075 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:00:41.107 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:00:41.134 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:00:41.318 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:00:41.364 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:00:41.394 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:00:41.424 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:00:41.470 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:00:42.035 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:42.076 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:42.097 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:00:42.948 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:00:42.992 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:00:42.992 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:00:42.992 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:00:42.992 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:00:42.993 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:00:42.993 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:00:42.993 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:00:42.993 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:00:42.995 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:00:42.996 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:00:42.997 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:00:43.009 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:00:43.009 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:00:43.009 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:00:43.009 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:00:43.009 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:00:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:00:43.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:00:43.012 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:00:43.013 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:00:43.014 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:00:43.015 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:00:43.016 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:00:43.017 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:00:43.018 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:00:43.019 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:00:43.020 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:00:43.021 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:00:43.021 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:00:43.039 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:00:43.089 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:00:43.177 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:00:43.234 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:00:43.259 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:00:43.285 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:00:43.286 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:00:43.370 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:00:43.454 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:00:43.479 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:00:43.484 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:43.484 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:00:43.664 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:00:43.748 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:00:43.811 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.208 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.209 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.210 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:00:45.211 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:00:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:00:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:00:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:00:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.212 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:00:45.213 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:00:45.214 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:00:45.215 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:00:45.216 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:00:45.217 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:00:45.218 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.219 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:00:45.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:00:45.221 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:00:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:00:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:00:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:00:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:00:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:00:45.222 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:00:45.223 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-15T22:00:45.834 DEBUG:teuthology.parallel:result is None 2024-09-15T22:00:49.507 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:49.508 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:00:49.508 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:00:49.508 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:00:49.508 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:00:49.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:00:49.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:00:49.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:00:49.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:00:49.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:00:49.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:00:49.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:00:49.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:00:49.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:00:49.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:00:49.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:00:49.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:00:49.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:00:49.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:00:49.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:00:49.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:00:49.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:00:49.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:00:49.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:00:49.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:00:49.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:00:49.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:00:49.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:00:49.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:00:49.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:00:49.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:00:49.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:00:49.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:00:49.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:00:49.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:00:49.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:00:49.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:00:49.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:00:49.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:00:49.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:00:49.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:00:49.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:00:49.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:00:49.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:00:49.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:00:49.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:00:49.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:00:49.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:00:49.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:00:49.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:00:49.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:00:49.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:00:49.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:00:49.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:00:49.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:00:49.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:00:49.521 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:00:49.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:00:49.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:00:49.524 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:00:49.525 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:00:49.526 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:00:49.527 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:00:49.528 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:00:52.036 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:00:52.036 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:52.036 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-15T22:00:52.036 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:00:52.037 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.038 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:00:52.039 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.040 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:00:52.041 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:00:52.042 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:00:52.043 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:00:52.044 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:00:52.045 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:00:52.046 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:00:52.047 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:00:52.048 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:00:52.049 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:00:52.049 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:00:52.049 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-15T22:00:52.511 DEBUG:teuthology.parallel:result is None 2024-09-15T22:00:52.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:00:52.655 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:00:52.705 INFO:teuthology.orchestra.run.smithi150.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:00:52.706 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:00:52.706 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:00:52.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:00:52.846 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:00:52.872 INFO:teuthology.orchestra.run.smithi154.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:00:52.872 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:00:52.873 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:00:52.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:00:53.009 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:00:53.035 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:00:53.035 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:00:53.035 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:00:53.037 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:00:53.037 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:00:53.037 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:00:53.101 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:00:53.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:00:53.135 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:00:53.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:00:53.167 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:00:53.167 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:00:53.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:00:53.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:00:53.321 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:00:53.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:00:53.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:00:53.421 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:00:53.422 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:00:53.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:00:53.520 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:00:53.520 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:00:53.521 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:00:53.577 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:00:53.674 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:00:53.674 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:00:53.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:00:53.765 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:00:53.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:00:53.795 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:00:53.864 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:00:53.864 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:00:53.864 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:00:53.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:00:54.035 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:00:54.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:00:54.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:00:54.125 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:00:54.126 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:00:54.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:00:54.225 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T22:00:54.332 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-15T22:00:54.332 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:00:54.333 INFO:tasks.cephadm:Cluster fsid is faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:00:54.333 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T22:00:54.333 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.150', 'mon.b': '172.21.15.154', 'mon.c': '172.21.15.169'} 2024-09-15T22:00:54.333 INFO:tasks.cephadm:First mon is mon.a on smithi150 2024-09-15T22:00:54.334 INFO:tasks.cephadm:First mgr is x 2024-09-15T22:00:54.334 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T22:00:54.334 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname $(hostname -s) 2024-09-15T22:00:54.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-09-15T22:00:54.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname $(hostname -s) 2024-09-15T22:00:54.448 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T22:00:54.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:00:54.585 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T22:00:54.720 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:00:54.722 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:00:54.722 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:00:54.722 DEBUG:teuthology.orchestra.run.smithi150:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.096 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:00 /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.097 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.470 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:00 /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.470 DEBUG:teuthology.orchestra.run.smithi169:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.859 INFO:teuthology.orchestra.run.smithi169.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:00 /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.860 DEBUG:teuthology.orchestra.run.smithi150:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.900 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.920 DEBUG:teuthology.orchestra.run.smithi169:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:00:55.956 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T22:00:55.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:00:55.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:00:55.963 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:00:57.553 INFO:teuthology.orchestra.run.smithi169.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:00:57.604 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:00:57.929 INFO:teuthology.orchestra.run.smithi150.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:01:26.560 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T22:01:26.561 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:01:26.561 INFO:teuthology.orchestra.run.smithi169.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:01:26.561 INFO:teuthology.orchestra.run.smithi169.stdout: "repo_digests": [ 2024-09-15T22:01:26.561 INFO:teuthology.orchestra.run.smithi169.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:01:26.561 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-09-15T22:01:26.561 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T22:01:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-15T22:01:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:01:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:01:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-09-15T22:01:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:01:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-15T22:01:26.614 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-15T22:01:30.051 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:01:30.051 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:01:30.052 INFO:teuthology.orchestra.run.smithi150.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:01:30.052 INFO:teuthology.orchestra.run.smithi150.stdout: "repo_digests": [ 2024-09-15T22:01:30.052 INFO:teuthology.orchestra.run.smithi150.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:01:30.052 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:01:30.052 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:01:30.086 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph 2024-09-15T22:01:30.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-09-15T22:01:30.180 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph 2024-09-15T22:01:30.214 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /etc/ceph 2024-09-15T22:01:30.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-09-15T22:01:30.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /etc/ceph 2024-09-15T22:01:30.330 INFO:tasks.cephadm:Writing seed config... 2024-09-15T22:01:30.331 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T22:01:30.332 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T22:01:30.333 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T22:01:30.334 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:01:30.335 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T22:01:30.336 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T22:01:30.336 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T22:01:30.336 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T22:01:30.336 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T22:01:30.336 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T22:01:30.336 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-15T22:01:30.337 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:01:30.337 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T22:01:30.372 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = faa38c0e-73ad-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T22:01:30.372 DEBUG:teuthology.orchestra.run.smithi150:mon.a> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T22:01:30.416 DEBUG:teuthology.orchestra.run.smithi150:mgr.x> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T22:01:30.462 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T22:01:30.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.150 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:01:30.726 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:01:30.726 INFO:teuthology.orchestra.run.smithi150.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'faa38c0e-73ad-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.150', '--skip-admin-label'] 2024-09-15T22:01:30.727 INFO:teuthology.orchestra.run.smithi150.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T22:01:30.727 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying podman|docker is present... 2024-09-15T22:01:30.786 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:01:30.787 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying lvm2 is present... 2024-09-15T22:01:30.787 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying time synchronization is in place... 2024-09-15T22:01:30.801 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:01:30.801 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:01:30.813 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:01:30.813 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout inactive 2024-09-15T22:01:30.827 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout enabled 2024-09-15T22:01:30.840 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout active 2024-09-15T22:01:30.840 INFO:teuthology.orchestra.run.smithi150.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:01:30.840 INFO:teuthology.orchestra.run.smithi150.stdout:Repeating the final host check... 2024-09-15T22:01:30.885 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:01:30.885 INFO:teuthology.orchestra.run.smithi150.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T22:01:30.885 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl is present 2024-09-15T22:01:30.885 INFO:teuthology.orchestra.run.smithi150.stdout:lvcreate is present 2024-09-15T22:01:30.898 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:01:30.898 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:01:30.910 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:01:30.910 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout inactive 2024-09-15T22:01:30.924 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout enabled 2024-09-15T22:01:30.936 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout active 2024-09-15T22:01:30.936 INFO:teuthology.orchestra.run.smithi150.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:01:30.936 INFO:teuthology.orchestra.run.smithi150.stdout:Host looks OK 2024-09-15T22:01:30.936 INFO:teuthology.orchestra.run.smithi150.stdout:Cluster fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:30.937 INFO:teuthology.orchestra.run.smithi150.stdout:Acquiring lock 140042428195696 on /run/cephadm/faa38c0e-73ad-11ef-bceb-c7b262605968.lock 2024-09-15T22:01:30.937 INFO:teuthology.orchestra.run.smithi150.stdout:Lock 140042428195696 acquired on /run/cephadm/faa38c0e-73ad-11ef-bceb-c7b262605968.lock 2024-09-15T22:01:30.937 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying IP 172.21.15.150 port 3300 ... 2024-09-15T22:01:30.938 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying IP 172.21.15.150 port 6789 ... 2024-09-15T22:01:30.938 INFO:teuthology.orchestra.run.smithi150.stdout:Base mon IP(s) is [172.21.15.150:3300, 172.21.15.150:6789], mon addrv is [v2:172.21.15.150:3300,v1:172.21.15.150:6789] 2024-09-15T22:01:30.944 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.150 metric 100 2024-09-15T22:01:30.945 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.150 metric 100 2024-09-15T22:01:30.950 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T22:01:30.951 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-15T22:01:30.951 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-15T22:01:30.956 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T22:01:30.956 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T22:01:30.956 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:01:30.957 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-15T22:01:30.957 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-15T22:01:30.957 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:01:30.957 INFO:teuthology.orchestra.run.smithi150.stdout:Mon IP `172.21.15.150` is in CIDR network `172.21.0.0/20` 2024-09-15T22:01:30.958 INFO:teuthology.orchestra.run.smithi150.stdout:Mon IP `172.21.15.150` is in CIDR network `172.21.0.0/20` 2024-09-15T22:01:30.958 INFO:teuthology.orchestra.run.smithi150.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T22:01:30.958 INFO:teuthology.orchestra.run.smithi150.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T22:01:30.959 INFO:teuthology.orchestra.run.smithi150.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:01:31.510 INFO:teuthology.orchestra.run.smithi150.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T22:01:32.604 INFO:teuthology.orchestra.run.smithi150.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:01:32.604 INFO:teuthology.orchestra.run.smithi150.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:01:32.605 INFO:teuthology.orchestra.run.smithi150.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T22:01:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:stat: stdout 167 167 2024-09-15T22:01:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:Creating initial keys... 2024-09-15T22:01:44.357 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph-authtool: stdout AQBHWedmWX1rLhAAasVrNV3E+8Xx3SvweB4CYA== 2024-09-15T22:01:45.557 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph-authtool: stdout AQBIWedmlP0VLBAAuF/PENGjU7Naa3H0WWo4qA== 2024-09-15T22:01:46.644 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph-authtool: stdout AQBJWedmX+9KOxAA74RNYPMEBQNCjxukRUCh/Q== 2024-09-15T22:01:46.645 INFO:teuthology.orchestra.run.smithi150.stdout:Creating initial monmap... 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:monmaptool for a [v2:172.21.15.150:3300,v1:172.21.15.150:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:setting min_mon_release = quincy 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/monmaptool: set fsid to faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:47.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:01:47.735 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:01:47.735 INFO:teuthology.orchestra.run.smithi150.stdout:Creating mon... 2024-09-15T22:01:49.226 INFO:teuthology.orchestra.run.smithi150.stdout:create mon.a on 2024-09-15T22:01:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T22:01:49.731 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T22:01:49.986 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968.target. 2024-09-15T22:01:49.986 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968.target. 2024-09-15T22:01:50.307 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:01:50.307 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Failed to reset failed state of unit ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T22:01:50.561 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968.target.wants/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@.service. 2024-09-15T22:01:51.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:51 smithi150 podman[30509]: 2024-09-15 22:01:51.114327998 +0000 UTC m=+0.321831390 container start dd5019f9ceb09aaa25f28e34d9860648f13406bfd8cfb179faf7930314b5c6ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-15T22:01:51.248 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:01:51.248 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout disabled 2024-09-15T22:01:51.261 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:01:51.261 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout inactive 2024-09-15T22:01:51.261 INFO:teuthology.orchestra.run.smithi150.stdout:firewalld.service is not enabled 2024-09-15T22:01:51.261 INFO:teuthology.orchestra.run.smithi150.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:01:51.262 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for mon to start... 2024-09-15T22:01:51.262 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for mon... 2024-09-15T22:01:51.563 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:51 smithi150 ceph-mon[30528]: mkfs faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:51.563 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:51 smithi150 ceph-mon[30528]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:01:51.563 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:51 smithi150 bash[30509]: dd5019f9ceb09aaa25f28e34d9860648f13406bfd8cfb179faf7930314b5c6ee 2024-09-15T22:01:51.563 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:51 smithi150 systemd[1]: Started Ceph mon.a for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:01:52.432 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:01:52.432 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: monmap epoch 1 2024-09-15T22:01:52.432 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: last_changed 2024-09-15T22:01:47.047639+0000 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: min_mon_release 19 (squid) 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: election_strategy: 1 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: fsmap 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: mgrmap e1: no daemons active 2024-09-15T22:01:52.433 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:52 smithi150 ceph-mon[30528]: from='client.? 172.21.15.150:0/1049320711' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T22:01:52.438 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout id: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout services: 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.702777s) 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T22:01:52.444 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout data: 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.799+0000 7fbd42000640 1 Processor -- start 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.799+0000 7fbd42000640 1 -- start start 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.799+0000 7fbd42000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c10af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:52.445 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.799+0000 7fbd42000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c10b530 con 0x7fbd3c10ab60 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.800+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c10af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.800+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c10af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59572/0 (socket says 172.21.15.150:59572) 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.800+0000 7fbd40c00640 1 -- 172.21.15.150:0/172234151 learned_addr learned my addr 172.21.15.150:0/172234151 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.801+0000 7fbd40c00640 1 -- 172.21.15.150:0/172234151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c10b6b0 con 0x7fbd3c10ab60 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.803+0000 7fbd40c00640 1 --2- 172.21.15.150:0/172234151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c10af60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009820 tx=0x7fbd3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88834ec4a745a9df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd3b400640 1 -- 172.21.15.150:0/172234151 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd30037070 con 0x7fbd3c10ab60 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd3b400640 1 -- 172.21.15.150:0/172234151 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd30032440 con 0x7fbd3c10ab60 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd3b400640 1 -- 172.21.15.150:0/172234151 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd30032740 con 0x7fbd3c10ab60 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd42000640 1 -- 172.21.15.150:0/172234151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 msgr2=0x7fbd3c10af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd42000640 1 --2- 172.21.15.150:0/172234151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c10af60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009820 tx=0x7fbd3002a270 comp rx=0 tx=0).stop 2024-09-15T22:01:52.446 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd42000640 1 -- 172.21.15.150:0/172234151 shutdown_connections 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd42000640 1 --2- 172.21.15.150:0/172234151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c10af60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.804+0000 7fbd42000640 1 -- 172.21.15.150:0/172234151 >> 172.21.15.150:0/172234151 conn(0x7fbd3c07cce0 msgr2=0x7fbd3c07d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.805+0000 7fbd42000640 1 -- 172.21.15.150:0/172234151 shutdown_connections 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.805+0000 7fbd42000640 1 -- 172.21.15.150:0/172234151 wait complete. 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.805+0000 7fbd42000640 1 Processor -- start 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd42000640 1 -- start start 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd42000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd42000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c109930 con 0x7fbd3c10ab60 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c19ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59586/0 (socket says 172.21.15.150:59586) 2024-09-15T22:01:52.447 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd40c00640 1 -- 172.21.15.150:0/1049320711 learned_addr learned my addr 172.21.15.150:0/1049320711 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.806+0000 7fbd40c00640 1 -- 172.21.15.150:0/1049320711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c19d3a0 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.807+0000 7fbd40c00640 1 --2- 172.21.15.150:0/1049320711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c19ce60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd300090b0 tx=0x7fbd300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.807+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd30041070 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.807+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3003c7a0 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.807+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c19d630 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.807+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd30037040 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.807+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c1a0320 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.808+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbd30044070 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.808+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbd3003d3f0 con 0x7fbd3c10ab60 2024-09-15T22:01:52.448 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.808+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c10afe0 con 0x7fbd3c10ab60 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.811+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbd30046450 con 0x7fbd3c10ab60 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.873+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fbd3c02d900 con 0x7fbd3c10ab60 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.873+0000 7fbd39600640 1 -- 172.21.15.150:0/1049320711 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fbd30046630 con 0x7fbd3c10ab60 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 msgr2=0x7fbd3c19ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 --2- 172.21.15.150:0/1049320711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c19ce60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd300090b0 tx=0x7fbd300046c0 comp rx=0 tx=0).stop 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 shutdown_connections 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 --2- 172.21.15.150:0/1049320711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c10ab60 0x7fbd3c19ce60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 >> 172.21.15.150:0/1049320711 conn(0x7fbd3c07cce0 msgr2=0x7fbd3c1911c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 shutdown_connections 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:51.874+0000 7fbd42000640 1 -- 172.21.15.150:0/1049320711 wait complete. 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:mon is available 2024-09-15T22:01:52.449 INFO:teuthology.orchestra.run.smithi150.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T22:01:53.310 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:53 smithi150 ceph-mon[30528]: from='client.? 172.21.15.150:0/2502650107' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:01:53.310 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:53 smithi150 ceph-mon[30528]: from='client.? 172.21.15.150:0/2502650107' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T22:01:53.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:01:53.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:01:53.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout fsid = faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:53.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.150:3300,v1:172.21.15.150:6789] 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:01:53.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.914+0000 7f2cf3e00640 1 Processor -- start 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.914+0000 7f2cf3e00640 1 -- start start 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.914+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf407c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.914+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf407c910 con 0x7f2cf407dee0 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.915+0000 7f2cf2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.915+0000 7f2cf2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf407c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59598/0 (socket says 172.21.15.150:59598) 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.915+0000 7f2cf2a00640 1 -- 172.21.15.150:0/2033048432 learned_addr learned my addr 172.21.15.150:0/2033048432 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.915+0000 7f2cf2a00640 1 -- 172.21.15.150:0/2033048432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf407ca90 con 0x7f2cf407dee0 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.916+0000 7f2cf2a00640 1 --2- 172.21.15.150:0/2033048432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf407c340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009820 tx=0x7f2ce402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ef2a638fd5e1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:53.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf2000640 1 -- 172.21.15.150:0/2033048432 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4037070 con 0x7f2cf407dee0 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf2000640 1 -- 172.21.15.150:0/2033048432 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce4032440 con 0x7f2cf407dee0 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf2000640 1 -- 172.21.15.150:0/2033048432 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4032740 con 0x7f2cf407dee0 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2033048432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 msgr2=0x7f2cf407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 --2- 172.21.15.150:0/2033048432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf407c340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009820 tx=0x7f2ce402a270 comp rx=0 tx=0).stop 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2033048432 shutdown_connections 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 --2- 172.21.15.150:0/2033048432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf407c340 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2033048432 >> 172.21.15.150:0/2033048432 conn(0x7f2cf4102ce0 msgr2=0x7f2cf4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2033048432 shutdown_connections 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.917+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2033048432 wait complete. 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.918+0000 7f2cf3e00640 1 Processor -- start 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.918+0000 7f2cf3e00640 1 -- start start 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.919+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.919+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf407cfc0 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.919+0000 7f2cf2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.919+0000 7f2cf2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59614/0 (socket says 172.21.15.150:59614) 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.919+0000 7f2cf2a00640 1 -- 172.21.15.150:0/2502650107 learned_addr learned my addr 172.21.15.150:0/2502650107 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.919+0000 7f2cf2a00640 1 -- 172.21.15.150:0/2502650107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf419d3b0 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2cf2a00640 1 --2- 172.21.15.150:0/2502650107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf419ce70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40090b0 tx=0x7f2ce40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4041070 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce403c7a0 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf419d640 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4037040 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf41a0330 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ce4044070 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.920+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2ce403d3f0 con 0x7f2cf407dee0 2024-09-15T22:01:53.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.921+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf407c3c0 con 0x7f2cf407dee0 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.924+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2ce4046450 con 0x7f2cf407dee0 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.983+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2cf402d910 con 0x7f2cf407dee0 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.987+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f2ce4046630 con 0x7f2cf407dee0 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.987+0000 7f2ceb400640 1 -- 172.21.15.150:0/2502650107 <== mon.0 v2:172.21.15.150:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ce40584b0 con 0x7f2cf407dee0 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.988+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 msgr2=0x7f2cf419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.988+0000 7f2cf3e00640 1 --2- 172.21.15.150:0/2502650107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf419ce70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40090b0 tx=0x7f2ce40046c0 comp rx=0 tx=0).stop 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.988+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 shutdown_connections 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.988+0000 7f2cf3e00640 1 --2- 172.21.15.150:0/2502650107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cf407dee0 0x7f2cf419ce70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.988+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 >> 172.21.15.150:0/2502650107 conn(0x7f2cf4102ce0 msgr2=0x7f2cf41030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.989+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 shutdown_connections 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:52.989+0000 7f2cf3e00640 1 -- 172.21.15.150:0/2502650107 wait complete. 2024-09-15T22:01:53.616 INFO:teuthology.orchestra.run.smithi150.stdout:Generating new minimal ceph.conf... 2024-09-15T22:01:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:54 smithi150 ceph-mon[30528]: from='client.? 172.21.15.150:0/708804877' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:01:54.729 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.071+0000 7f0be0a00640 1 Processor -- start 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.072+0000 7f0be0a00640 1 -- start start 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.072+0000 7f0be0a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.072+0000 7f0be0a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc108080 con 0x7f0bdc1076b0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.072+0000 7f0bd9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.072+0000 7f0bd9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59626/0 (socket says 172.21.15.150:59626) 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.072+0000 7f0bd9e00640 1 -- 172.21.15.150:0/189026280 learned_addr learned my addr 172.21.15.150:0/189026280 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.073+0000 7f0bd9e00640 1 -- 172.21.15.150:0/189026280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc1088b0 con 0x7f0bdc1076b0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.073+0000 7f0bd9e00640 1 --2- 172.21.15.150:0/189026280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc107ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009820 tx=0x7f0bcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3432bebd0f7b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.074+0000 7f0bd9400640 1 -- 172.21.15.150:0/189026280 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc037070 con 0x7f0bdc1076b0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.074+0000 7f0bd9400640 1 -- 172.21.15.150:0/189026280 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0bcc032900 con 0x7f0bdc1076b0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.074+0000 7f0bd9400640 1 -- 172.21.15.150:0/189026280 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc030850 con 0x7f0bdc1076b0 2024-09-15T22:01:54.730 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.074+0000 7f0be0a00640 1 -- 172.21.15.150:0/189026280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 msgr2=0x7f0bdc107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.074+0000 7f0be0a00640 1 --2- 172.21.15.150:0/189026280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc107ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009820 tx=0x7f0bcc02a270 comp rx=0 tx=0).stop 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.075+0000 7f0be0a00640 1 -- 172.21.15.150:0/189026280 shutdown_connections 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.075+0000 7f0be0a00640 1 --2- 172.21.15.150:0/189026280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc107ab0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.075+0000 7f0be0a00640 1 -- 172.21.15.150:0/189026280 >> 172.21.15.150:0/189026280 conn(0x7f0bdc102e80 msgr2=0x7f0bdc1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.075+0000 7f0be0a00640 1 -- 172.21.15.150:0/189026280 shutdown_connections 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.075+0000 7f0be0a00640 1 -- 172.21.15.150:0/189026280 wait complete. 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.075+0000 7f0be0a00640 1 Processor -- start 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0be0a00640 1 -- start start 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0be0a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0be0a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc10bc60 con 0x7f0bdc1076b0 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0bd9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0bd9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc19d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59640/0 (socket says 172.21.15.150:59640) 2024-09-15T22:01:54.731 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0bd9e00640 1 -- 172.21.15.150:0/708804877 learned_addr learned my addr 172.21.15.150:0/708804877 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.076+0000 7f0bd9e00640 1 -- 172.21.15.150:0/708804877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc19ddb0 con 0x7f0bdc1076b0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.077+0000 7f0bd9e00640 1 --2- 172.21.15.150:0/708804877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc19d870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009940 tx=0x7f0bcc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.077+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc042070 con 0x7f0bdc1076b0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.077+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0bcc0308c0 con 0x7f0bdc1076b0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.077+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc19e040 con 0x7f0bdc1076b0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.077+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc037040 con 0x7f0bdc1076b0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.077+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc1a0d30 con 0x7f0bdc1076b0 2024-09-15T22:01:54.732 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.078+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0bcc045070 con 0x7f0bdc1076b0 2024-09-15T22:01:54.733 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.078+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0bcc047b70 con 0x7f0bdc1076b0 2024-09-15T22:01:54.733 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.078+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bdc107b30 con 0x7f0bdc1076b0 2024-09-15T22:01:54.733 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.081+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0bcc0327b0 con 0x7f0bdc1076b0 2024-09-15T22:01:54.733 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.141+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0bdc1a0f00 con 0x7f0bdc1076b0 2024-09-15T22:01:54.733 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.141+0000 7f0bd3400640 1 -- 172.21.15.150:0/708804877 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f0bcc03c760 con 0x7f0bdc1076b0 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 msgr2=0x7f0bdc19d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 --2- 172.21.15.150:0/708804877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc19d870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009940 tx=0x7f0bcc032ce0 comp rx=0 tx=0).stop 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 shutdown_connections 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 --2- 172.21.15.150:0/708804877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bdc1076b0 0x7f0bdc19d870 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 >> 172.21.15.150:0/708804877 conn(0x7f0bdc102e80 msgr2=0x7f0bdc103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 shutdown_connections 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:54.142+0000 7f0be0a00640 1 -- 172.21.15.150:0/708804877 wait complete. 2024-09-15T22:01:54.734 INFO:teuthology.orchestra.run.smithi150.stdout:Restarting the monitor... 2024-09-15T22:01:55.093 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:54 smithi150 systemd[1]: Stopping Ceph mon.a for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:01:55.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:55 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a[30523]: 2024-09-15T22:01:55.090+0000 7f5ee9000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:01:55.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:55 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a[30523]: 2024-09-15T22:01:55.090+0000 7f5ee9000640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T22:01:55.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:55 smithi150 podman[30765]: 2024-09-15 22:01:55.317001677 +0000 UTC m=+0.353132983 container died dd5019f9ceb09aaa25f28e34d9860648f13406bfd8cfb179faf7930314b5c6ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-15T22:01:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:55 smithi150 podman[30765]: 2024-09-15 22:01:55.737510824 +0000 UTC m=+0.773642135 container cleanup dd5019f9ceb09aaa25f28e34d9860648f13406bfd8cfb179faf7930314b5c6ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:01:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:55 smithi150 bash[30765]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:01:56.245 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:55 smithi150 podman[30776]: 2024-09-15 22:01:55.980285253 +0000 UTC m=+0.650674989 container remove dd5019f9ceb09aaa25f28e34d9860648f13406bfd8cfb179faf7930314b5c6ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-15T22:01:56.584 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T22:01:56.584 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 systemd[1]: Stopped Ceph mon.a for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:01:56.584 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.212s CPU time. 2024-09-15T22:01:56.585 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 systemd[1]: Starting Ceph mon.a for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:01:56.859 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 podman[30867]: 2024-09-15 22:01:56.487539095 +0000 UTC m=+0.027422964 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:01:56.860 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 podman[30867]: 2024-09-15 22:01:56.62291001 +0000 UTC m=+0.162793878 container create f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T22:01:56.968 INFO:teuthology.orchestra.run.smithi150.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 podman[30867]: 2024-09-15 22:01:56.858837676 +0000 UTC m=+0.398721544 container init f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 podman[30867]: 2024-09-15 22:01:56.865427582 +0000 UTC m=+0.405311452 container start f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: pidfile_write: ignore empty --pid-file 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: load: jerasure load: lrc 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:01:57.115 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Git sha 0 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: DB SUMMARY 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: DB Session ID: 2Z0NTZZGI7IAF7YWV93A 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105660 ; 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:01:57.116 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.env: 0x562f755d0940 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.info_log: 0x562fabd916a0 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.statistics: (nil) 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.use_fsync: 0 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:01:57.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.db_log_dir: 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.wal_dir: 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:01:57.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.write_buffer_manager: 0x562fabda0dc0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.unordered_write: 0 2024-09-15T22:01:57.119 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:01:57.120 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:01:57.120 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:01:57.120 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:01:57.120 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.row_cache: None 2024-09-15T22:01:57.120 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.wal_filter: None 2024-09-15T22:01:57.120 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:01:57.121 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:01:57.121 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:01:57.121 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:01:57.121 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.wal_compression: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:01:57.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_open_files: -1 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:01:57.123 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Compression algorithms supported: 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kZSTD supported: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:01:57.124 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.merge_operator: 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_filter: None 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562fabd91300) 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:01:57.125 INFO:journalctl@ceph.mon.a.smithi150.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: index_type: 0 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: data_block_index_type: 0 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: index_shortening: 1 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: checksum: 4 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: no_block_cache: 0 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_cache: 0x562fabd851f0 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_cache_options: 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: capacity : 536870912 2024-09-15T22:01:57.126 INFO:journalctl@ceph.mon.a.smithi150.stdout: num_shard_bits : 4 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: strict_capacity_limit : 0 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_cache_compressed: (nil) 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: persistent_cache: (nil) 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_size: 4096 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_size_deviation: 10 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_restart_interval: 16 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: index_block_restart_interval: 1 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: metadata_block_size: 4096 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: partition_filters: 0 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: use_delta_encoding: 1 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: filter_policy: bloomfilter 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: whole_key_filtering: 1 2024-09-15T22:01:57.127 INFO:journalctl@ceph.mon.a.smithi150.stdout: verify_compression: 0 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: format_version: 5 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: enable_index_compression: 1 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: block_align: 0 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: max_auto_readahead_size: 262144 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: prepopulate_block_cache: 0 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression: NoCompression 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:01:57.128 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.num_levels: 7 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:01:57.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:01:57.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:01:57.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:01:57.132 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:01:57.133 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.ttl: 2592000 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:01:57.134 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f69270ae-785c-4880-b592-2d05f586838b 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437716907647, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437716909510, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98542, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14397, "raw_average_key_size": 49, "raw_value_size": 90788, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726437716, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f69270ae-785c-4880-b592-2d05f586838b", "db_session_id": "2Z0NTZZGI7IAF7YWV93A", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437716909689, "job": 1, "event": "recovery_finished"} 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562fabdb4e00 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: DB pointer 0x562fabeb0000 2024-09-15T22:01:57.135 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: ** DB Stats ** 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: ** Compaction Stats [default] ** 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:01:57.136 INFO:journalctl@ceph.mon.a.smithi150.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: L0 2/0 100.15 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: Sum 2/0 100.15 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: ** Compaction Stats [default] ** 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 84.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:01:57.137 INFO:journalctl@ceph.mon.a.smithi150.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: Cumulative compaction: 0.00 GB write, 16.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: Interval compaction: 0.00 GB write, 16.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: Block cache BinnedLRUCache@0x562fabd851f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: starting mon.a rank 0 at public addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] at bind addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???) e1 preinit fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).mds e1 new map 2024-09-15T22:01:57.138 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).mds e1 print_map 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: e1 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: btime 2024-09-15T22:01:51:172800+0000 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: legacy client fscid: -1 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout: No filesystems configured 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 bash[30867]: f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 systemd[1]: Started Ceph mon.a for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:01:57.139 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: monmap epoch 1 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: last_changed 2024-09-15T22:01:47.047639+0000 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: min_mon_release 19 (squid) 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: election_strategy: 1 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: fsmap 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:01:57.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:56 smithi150 ceph-mon[30886]: mgrmap e1: no daemons active 2024-09-15T22:01:58.526 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.531+0000 7f04d6e00640 1 Processor -- start 2024-09-15T22:01:58.526 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.531+0000 7f04d6e00640 1 -- start start 2024-09-15T22:01:58.526 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.532+0000 7f04d6e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d007c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:58.526 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.532+0000 7f04d6e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f04d007c8f0 con 0x7f04d007dec0 2024-09-15T22:01:58.526 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.532+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d007c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.532+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d007c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59654/0 (socket says 172.21.15.150:59654) 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.532+0000 7f04cfe00640 1 -- 172.21.15.150:0/4009769226 learned_addr learned my addr 172.21.15.150:0/4009769226 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.532+0000 7f04cfe00640 1 -- 172.21.15.150:0/4009769226 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d007ca70 con 0x7f04d007dec0 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.535+0000 7f04cfe00640 1 --2- 172.21.15.150:0/4009769226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d007c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009820 tx=0x7f04c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744e77b445f1b739 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.535+0000 7f04cea00640 1 -- 172.21.15.150:0/4009769226 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c0037070 con 0x7f04d007dec0 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.535+0000 7f04cea00640 1 -- 172.21.15.150:0/4009769226 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04c0032900 con 0x7f04d007dec0 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.535+0000 7f04cea00640 1 -- 172.21.15.150:0/4009769226 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c0030850 con 0x7f04d007dec0 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 -- 172.21.15.150:0/4009769226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 msgr2=0x7f04d007c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 --2- 172.21.15.150:0/4009769226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d007c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009820 tx=0x7f04c002a270 comp rx=0 tx=0).stop 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 -- 172.21.15.150:0/4009769226 shutdown_connections 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 --2- 172.21.15.150:0/4009769226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d007c320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 -- 172.21.15.150:0/4009769226 >> 172.21.15.150:0/4009769226 conn(0x7f04d0102e80 msgr2=0x7f04d01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:58.527 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 -- 172.21.15.150:0/4009769226 shutdown_connections 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.536+0000 7f04d6e00640 1 -- 172.21.15.150:0/4009769226 wait complete. 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.537+0000 7f04d6e00640 1 Processor -- start 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.537+0000 7f04d6e00640 1 -- start start 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.538+0000 7f04d6e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.538+0000 7f04d6e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f04d010dcc0 con 0x7f04d007dec0 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.538+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.538+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d019d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59660/0 (socket says 172.21.15.150:59660) 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.538+0000 7f04cfe00640 1 -- 172.21.15.150:0/1348191227 learned_addr learned my addr 172.21.15.150:0/1348191227 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.538+0000 7f04cfe00640 1 -- 172.21.15.150:0/1348191227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d019dd50 con 0x7f04d007dec0 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04cfe00640 1 --2- 172.21.15.150:0/1348191227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d019d810 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097f0 tx=0x7f04c0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c0037040 con 0x7f04d007dec0 2024-09-15T22:01:58.528 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04c0040070 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d019dfe0 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c003a390 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d01a0cd0 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04c003a5e0 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.539+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f04c0045950 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.540+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d007c3a0 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.543+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f04c0045460 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.603+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f04d019e460 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.605+0000 7f04ccc00640 1 -- 172.21.15.150:0/1348191227 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f04c003b430 con 0x7f04d007dec0 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 msgr2=0x7f04d019d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 --2- 172.21.15.150:0/1348191227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d019d810 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097f0 tx=0x7f04c0030d80 comp rx=0 tx=0).stop 2024-09-15T22:01:58.529 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 shutdown_connections 2024-09-15T22:01:58.530 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 --2- 172.21.15.150:0/1348191227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04d007dec0 0x7f04d019d810 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:01:58.530 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 >> 172.21.15.150:0/1348191227 conn(0x7f04d0102e80 msgr2=0x7f04d01039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:01:58.530 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 shutdown_connections 2024-09-15T22:01:58.530 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:01:57.606+0000 7f04d6e00640 1 -- 172.21.15.150:0/1348191227 wait complete. 2024-09-15T22:01:58.530 INFO:teuthology.orchestra.run.smithi150.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T22:01:58.558 INFO:teuthology.orchestra.run.smithi150.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:01:58.558 INFO:teuthology.orchestra.run.smithi150.stdout:Creating mgr... 2024-09-15T22:01:58.559 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T22:01:58.559 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T22:01:58.910 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:01:58.911 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Failed to reset failed state of unit ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T22:01:58.924 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:01:58 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1348191227' entity='client.admin' 2024-09-15T22:01:59.141 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968.target.wants/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@.service. 2024-09-15T22:01:59.176 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 systemd[1]: Starting Ceph mgr.x for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:01:59.764 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 podman[31095]: 2024-09-15 22:01:59.386634113 +0000 UTC m=+0.027580329 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:01:59.764 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 podman[31095]: 2024-09-15 22:01:59.484787456 +0000 UTC m=+0.125733650 container create 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T22:01:59.764 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 podman[31095]: 2024-09-15 22:01:59.695992045 +0000 UTC m=+0.336938263 container init 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T22:01:59.764 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 podman[31095]: 2024-09-15 22:01:59.70237458 +0000 UTC m=+0.343320784 container start 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:01:59.764 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 bash[31095]: 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 2024-09-15T22:01:59.803 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:01:59.803 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout disabled 2024-09-15T22:01:59.818 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:01:59.818 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout inactive 2024-09-15T22:01:59.818 INFO:teuthology.orchestra.run.smithi150.stdout:firewalld.service is not enabled 2024-09-15T22:01:59.818 INFO:teuthology.orchestra.run.smithi150.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:01:59.835 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:01:59.836 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout disabled 2024-09-15T22:01:59.850 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:01:59.850 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout inactive 2024-09-15T22:01:59.850 INFO:teuthology.orchestra.run.smithi150.stdout:firewalld.service is not enabled 2024-09-15T22:01:59.851 INFO:teuthology.orchestra.run.smithi150.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T22:01:59.851 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for mgr to start... 2024-09-15T22:01:59.851 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for mgr... 2024-09-15T22:02:00.014 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 systemd[1]: Started Ceph mgr.x for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:02:00.014 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:01:59.888+0000 7f4c03121040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:02:00.014 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:01:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:01:59.961+0000 7f4c03121040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:02:00.266 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:00.164+0000 7f4c03121040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:02:00.266 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:00.248+0000 7f4c03121040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:02:00.618 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:00 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2385039808' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:02:00.618 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:00.436+0000 7f4c03121040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:02:00.618 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:00.615+0000 7f4c03121040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:02:01.108 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:02:01.120 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:01.120 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:02:01.120 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-15T22:02:01.121 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:02:01.122 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:02:01.123 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:01:51:172800+0000", 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:02:01.124 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:01:51.173599+0000", 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:02:01.125 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.367+0000 7f5da6e00640 1 Processor -- start 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.368+0000 7f5da6e00640 1 -- start start 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.368+0000 7f5da6e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da01078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.368+0000 7f5da6e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0107ec0 con 0x7f5da01074f0 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.369+0000 7f5da5a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da01078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.369+0000 7f5da5a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da01078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46424/0 (socket says 172.21.15.150:46424) 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.369+0000 7f5da5a00640 1 -- 172.21.15.150:0/440540535 learned_addr learned my addr 172.21.15.150:0/440540535 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.369+0000 7f5da5a00640 1 -- 172.21.15.150:0/440540535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da01086f0 con 0x7f5da01074f0 2024-09-15T22:02:01.126 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.370+0000 7f5da5a00640 1 --2- 172.21.15.150:0/440540535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da01078f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009820 tx=0x7f5d9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2525f099285fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.371+0000 7f5d9fe00640 1 -- 172.21.15.150:0/440540535 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94037070 con 0x7f5da01074f0 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.371+0000 7f5d9fe00640 1 -- 172.21.15.150:0/440540535 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d94032900 con 0x7f5da01074f0 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.371+0000 7f5d9fe00640 1 -- 172.21.15.150:0/440540535 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94030850 con 0x7f5da01074f0 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.371+0000 7f5da6e00640 1 -- 172.21.15.150:0/440540535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 msgr2=0x7f5da01078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.371+0000 7f5da6e00640 1 --2- 172.21.15.150:0/440540535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da01078f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009820 tx=0x7f5d9402a270 comp rx=0 tx=0).stop 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.371+0000 7f5da6e00640 1 -- 172.21.15.150:0/440540535 shutdown_connections 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.372+0000 7f5da6e00640 1 --2- 172.21.15.150:0/440540535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da01078f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.372+0000 7f5da6e00640 1 -- 172.21.15.150:0/440540535 >> 172.21.15.150:0/440540535 conn(0x7f5da0102ce0 msgr2=0x7f5da0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.372+0000 7f5da6e00640 1 -- 172.21.15.150:0/440540535 shutdown_connections 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.372+0000 7f5da6e00640 1 -- 172.21.15.150:0/440540535 wait complete. 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.373+0000 7f5da6e00640 1 Processor -- start 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.373+0000 7f5da6e00640 1 -- start start 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.373+0000 7f5da6e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.373+0000 7f5da6e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5da010baa0 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.374+0000 7f5da5a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.374+0000 7f5da5a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da019b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46428/0 (socket says 172.21.15.150:46428) 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.374+0000 7f5da5a00640 1 -- 172.21.15.150:0/2385039808 learned_addr learned my addr 172.21.15.150:0/2385039808 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.374+0000 7f5da5a00640 1 -- 172.21.15.150:0/2385039808 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da019ba60 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.374+0000 7f5da5a00640 1 --2- 172.21.15.150:0/2385039808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da019b520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5d940097f0 tx=0x7f5d94030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94042070 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d94032ca0 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94037040 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da019bcf0 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da019e9e0 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d94045070 con 0x7f5da01074f0 2024-09-15T22:02:01.128 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.375+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5d94047ad0 con 0x7f5da01074f0 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.376+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da0107970 con 0x7f5da01074f0 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.379+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5d9403da60 con 0x7f5da01074f0 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.443+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5da019ef60 con 0x7f5da01074f0 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.444+0000 7f5d9e000640 1 -- 172.21.15.150:0/2385039808 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f5d9403d430 con 0x7f5da01074f0 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 msgr2=0x7f5da019b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 --2- 172.21.15.150:0/2385039808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da019b520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5d940097f0 tx=0x7f5d94030ec0 comp rx=0 tx=0).stop 2024-09-15T22:02:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 shutdown_connections 2024-09-15T22:02:01.130 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 --2- 172.21.15.150:0/2385039808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5da01074f0 0x7f5da019b520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:01.130 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 >> 172.21.15.150:0/2385039808 conn(0x7f5da0102ce0 msgr2=0x7f5da0103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:01.130 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 shutdown_connections 2024-09-15T22:02:01.130 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:00.445+0000 7f5da6e00640 1 -- 172.21.15.150:0/2385039808 wait complete. 2024-09-15T22:02:01.130 INFO:teuthology.orchestra.run.smithi150.stdout:mgr not available, waiting (1/15)... 2024-09-15T22:02:01.295 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:01.007+0000 7f4c03121040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:02:01.295 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:01.081+0000 7f4c03121040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:02:01.296 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:01.293+0000 7f4c03121040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:02:02.676 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:02.394+0000 7f4c03121040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:02:02.676 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:02.473+0000 7f4c03121040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:02:03.523 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:03.424+0000 7f4c03121040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:02:03.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:03 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3267642889' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:02:03.774 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:03.566+0000 7f4c03121040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:02:03.775 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:03.751+0000 7f4c03121040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:02:04.103 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:03.832+0000 7f4c03121040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:02:04.104 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.014+0000 7f4c03121040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:02:04.104 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.101+0000 7f4c03121040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:02:04.374 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.182+0000 7f4c03121040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:02:04.375 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.372+0000 7f4c03121040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:02:04.501 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:02:04.501 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:04.501 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:02:04.501 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:02:04.501 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:04.502 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:02:04.503 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:02:04.511 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:01:51:172800+0000", 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:02:04.512 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:01:51.173599+0000", 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:04.513 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.628+0000 7fe52f000640 1 Processor -- start 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.629+0000 7fe52f000640 1 -- start start 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.629+0000 7fe52f000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe528107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.629+0000 7fe52f000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe5281080a0 con 0x7fe5281076d0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.630+0000 7fe527e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe528107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.630+0000 7fe527e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe528107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46432/0 (socket says 172.21.15.150:46432) 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.630+0000 7fe527e00640 1 -- 172.21.15.150:0/2532121271 learned_addr learned my addr 172.21.15.150:0/2532121271 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.630+0000 7fe527e00640 1 -- 172.21.15.150:0/2532121271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5281088d0 con 0x7fe5281076d0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.631+0000 7fe527e00640 1 --2- 172.21.15.150:0/2532121271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe528107ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe518009820 tx=0x7fe51802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d95ba8d8bbfab95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.631+0000 7fe527400640 1 -- 172.21.15.150:0/2532121271 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe518037070 con 0x7fe5281076d0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.631+0000 7fe527400640 1 -- 172.21.15.150:0/2532121271 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe518032900 con 0x7fe5281076d0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.631+0000 7fe527400640 1 -- 172.21.15.150:0/2532121271 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe518030850 con 0x7fe5281076d0 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 -- 172.21.15.150:0/2532121271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 msgr2=0x7fe528107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:04.514 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 --2- 172.21.15.150:0/2532121271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe528107ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe518009820 tx=0x7fe51802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 -- 172.21.15.150:0/2532121271 shutdown_connections 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 --2- 172.21.15.150:0/2532121271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe528107ad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 -- 172.21.15.150:0/2532121271 >> 172.21.15.150:0/2532121271 conn(0x7fe528102e80 msgr2=0x7fe5281052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 -- 172.21.15.150:0/2532121271 shutdown_connections 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.632+0000 7fe52f000640 1 -- 172.21.15.150:0/2532121271 wait complete. 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.633+0000 7fe52f000640 1 Processor -- start 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.633+0000 7fe52f000640 1 -- start start 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.634+0000 7fe52f000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe52819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.634+0000 7fe52f000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe52810bc80 con 0x7fe5281076d0 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.634+0000 7fe527e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe52819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.634+0000 7fe527e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe52819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46448/0 (socket says 172.21.15.150:46448) 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.634+0000 7fe527e00640 1 -- 172.21.15.150:0/3267642889 learned_addr learned my addr 172.21.15.150:0/3267642889 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:04.515 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.634+0000 7fe527e00640 1 -- 172.21.15.150:0/3267642889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52819bbc0 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe527e00640 1 --2- 172.21.15.150:0/3267642889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe52819b680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe518009940 tx=0x7fe518032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe518042070 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5180308c0 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52819be50 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe518037040 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52819eb40 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe518045070 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.635+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe518047bb0 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.636+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe528107b50 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.639+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe5180327b0 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.702+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe52819ed10 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.703+0000 7fe525600640 1 -- 172.21.15.150:0/3267642889 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fe51803c760 con 0x7fe5281076d0 2024-09-15T22:02:04.516 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.704+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 msgr2=0x7fe52819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.704+0000 7fe52f000640 1 --2- 172.21.15.150:0/3267642889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe52819b680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe518009940 tx=0x7fe518032ce0 comp rx=0 tx=0).stop 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.704+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 shutdown_connections 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.704+0000 7fe52f000640 1 --2- 172.21.15.150:0/3267642889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5281076d0 0x7fe52819b680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.704+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 >> 172.21.15.150:0/3267642889 conn(0x7fe528102e80 msgr2=0x7fe528103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.704+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 shutdown_connections 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:03.705+0000 7fe52f000640 1 -- 172.21.15.150:0/3267642889 wait complete. 2024-09-15T22:02:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:mgr not available, waiting (2/15)... 2024-09-15T22:02:04.630 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.451+0000 7f4c03121040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:02:04.630 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.533+0000 7f4c03121040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:02:04.630 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.628+0000 7f4c03121040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:02:04.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.698+0000 7f4c03121040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:02:04.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:04.768+0000 7f4c03121040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:02:06.176 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:05.676+0000 7f4c03121040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: Activating manager daemon x 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: mgrmap e2: x(active, starting, since 0.00388929s) 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:02:06.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: Manager daemon x is now available 2024-09-15T22:02:06.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:02:06.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:02:06.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' 2024-09-15T22:02:06.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' 2024-09-15T22:02:06.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:05 smithi150 ceph-mon[30886]: from='mgr.14100 172.21.15.150:0/2393822324' entity='mgr.x' 2024-09-15T22:02:07.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:07 smithi150 ceph-mon[30886]: mgrmap e3: x(active, since 1.00994s) 2024-09-15T22:02:07.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:07 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/944497297' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:02:08.090 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:02:08.091 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:02:08.092 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:02:08.093 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:01:51:172800+0000", 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.094 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:01:51.173599+0000", 2024-09-15T22:02:08.095 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.064+0000 7f111fe00640 1 Processor -- start 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.065+0000 7f111fe00640 1 -- start start 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.065+0000 7f111fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112010af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.065+0000 7f111fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f112010b530 con 0x7f112010ab60 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.065+0000 7f111ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112010af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.065+0000 7f111ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112010af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46532/0 (socket says 172.21.15.150:46532) 2024-09-15T22:02:08.096 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.065+0000 7f111ea00640 1 -- 172.21.15.150:0/3464346973 learned_addr learned my addr 172.21.15.150:0/3464346973 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.066+0000 7f111ea00640 1 -- 172.21.15.150:0/3464346973 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112010b6b0 con 0x7f112010ab60 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.067+0000 7f111ea00640 1 --2- 172.21.15.150:0/3464346973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112010af60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1110009820 tx=0x7f111002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84780ed83a4f25dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.067+0000 7f111d600640 1 -- 172.21.15.150:0/3464346973 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110037070 con 0x7f112010ab60 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.067+0000 7f111d600640 1 -- 172.21.15.150:0/3464346973 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1110032900 con 0x7f112010ab60 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.067+0000 7f111d600640 1 -- 172.21.15.150:0/3464346973 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110030850 con 0x7f112010ab60 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 -- 172.21.15.150:0/3464346973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 msgr2=0x7f112010af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 --2- 172.21.15.150:0/3464346973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112010af60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1110009820 tx=0x7f111002a270 comp rx=0 tx=0).stop 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 -- 172.21.15.150:0/3464346973 shutdown_connections 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 --2- 172.21.15.150:0/3464346973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112010af60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 -- 172.21.15.150:0/3464346973 >> 172.21.15.150:0/3464346973 conn(0x7f112007cce0 msgr2=0x7f112007d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 -- 172.21.15.150:0/3464346973 shutdown_connections 2024-09-15T22:02:08.097 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.068+0000 7f111fe00640 1 -- 172.21.15.150:0/3464346973 wait complete. 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111fe00640 1 Processor -- start 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111fe00640 1 -- start start 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f112010dbc0 con 0x7f112010ab60 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46548/0 (socket says 172.21.15.150:46548) 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.069+0000 7f111ea00640 1 -- 172.21.15.150:0/944497297 learned_addr learned my addr 172.21.15.150:0/944497297 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f111ea00640 1 -- 172.21.15.150:0/944497297 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112019dc00 con 0x7f112010ab60 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f111ea00640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112019d6c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11100097f0 tx=0x7f1110030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110042070 con 0x7f112010ab60 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1110032ca0 con 0x7f112010ab60 2024-09-15T22:02:08.098 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110037040 con 0x7f112010ab60 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112019de90 con 0x7f112010ab60 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.070+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201a0b80 con 0x7f112010ab60 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.071+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f1110045070 con 0x7f112010ab60 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.071+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112010af60 con 0x7f112010ab60 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.072+0000 7f1117400640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f11040390a0 0x7f110403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.072+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f111006bfa0 con 0x7f112010ab60 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.072+0000 7f111e000640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f11040390a0 0x7f110403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.073+0000 7f111e000640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f11040390a0 0x7f110403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f110c0098c0 tx=0x7f110c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:08.099 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.078+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1110045360 con 0x7f112010ab60 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.317+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f11201a1200 con 0x7f112010ab60 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.318+0000 7f1117400640 1 -- 172.21.15.150:0/944497297 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f111002ed90 con 0x7f112010ab60 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.320+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f11040390a0 msgr2=0x7f110403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.320+0000 7f111fe00640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f11040390a0 0x7f110403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f110c0098c0 tx=0x7f110c006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.320+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 msgr2=0x7f112019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.320+0000 7f111fe00640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112019d6c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11100097f0 tx=0x7f1110030ec0 comp rx=0 tx=0).stop 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.321+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 shutdown_connections 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.321+0000 7f111fe00640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f11040390a0 0x7f110403b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.321+0000 7f111fe00640 1 --2- 172.21.15.150:0/944497297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f112010ab60 0x7f112019d6c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.321+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 >> 172.21.15.150:0/944497297 conn(0x7f112007cce0 msgr2=0x7f1120107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.321+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 shutdown_connections 2024-09-15T22:02:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:07.321+0000 7f111fe00640 1 -- 172.21.15.150:0/944497297 wait complete. 2024-09-15T22:02:08.101 INFO:teuthology.orchestra.run.smithi150.stdout:mgr is available 2024-09-15T22:02:09.081 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:08 smithi150 ceph-mon[30886]: mgrmap e4: x(active, since 2s) 2024-09-15T22:02:09.369 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:02:09.369 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:02:09.369 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout fsid = faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:02:09.369 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.150:3300,v1:172.21.15.150:6789] 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:02:09.370 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.564+0000 7f95a8c00640 1 Processor -- start 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.564+0000 7f95a8c00640 1 -- start start 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.565+0000 7f95a8c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a4107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.565+0000 7f95a8c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f95a4108080 con 0x7f95a41076b0 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.565+0000 7f95a1e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a4107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.565+0000 7f95a1e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a4107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46560/0 (socket says 172.21.15.150:46560) 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.565+0000 7f95a1e00640 1 -- 172.21.15.150:0/1436845804 learned_addr learned my addr 172.21.15.150:0/1436845804 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.565+0000 7f95a1e00640 1 -- 172.21.15.150:0/1436845804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a41088b0 con 0x7f95a41076b0 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.566+0000 7f95a1e00640 1 --2- 172.21.15.150:0/1436845804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a4107ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9594009820 tx=0x7f959402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec2241cdc9c07d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a1400640 1 -- 172.21.15.150:0/1436845804 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9594037070 con 0x7f95a41076b0 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a1400640 1 -- 172.21.15.150:0/1436845804 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9594032900 con 0x7f95a41076b0 2024-09-15T22:02:09.371 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a1400640 1 -- 172.21.15.150:0/1436845804 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9594030850 con 0x7f95a41076b0 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 -- 172.21.15.150:0/1436845804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 msgr2=0x7f95a4107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 --2- 172.21.15.150:0/1436845804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a4107ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9594009820 tx=0x7f959402a270 comp rx=0 tx=0).stop 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 -- 172.21.15.150:0/1436845804 shutdown_connections 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 --2- 172.21.15.150:0/1436845804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a4107ab0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 -- 172.21.15.150:0/1436845804 >> 172.21.15.150:0/1436845804 conn(0x7f95a4102e80 msgr2=0x7f95a41052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 -- 172.21.15.150:0/1436845804 shutdown_connections 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.567+0000 7f95a8c00640 1 -- 172.21.15.150:0/1436845804 wait complete. 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.568+0000 7f95a8c00640 1 Processor -- start 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a8c00640 1 -- start start 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a8c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a8c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410bc60 con 0x7f95a41076b0 2024-09-15T22:02:09.372 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a1e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a1e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a419b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46574/0 (socket says 172.21.15.150:46574) 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a1e00640 1 -- 172.21.15.150:0/2453220112 learned_addr learned my addr 172.21.15.150:0/2453220112 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.569+0000 7f95a1e00640 1 -- 172.21.15.150:0/2453220112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a419bba0 con 0x7f95a41076b0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.570+0000 7f95a1e00640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a419b660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f95940097f0 tx=0x7f9594030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.570+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9594037040 con 0x7f95a41076b0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.570+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9594040070 con 0x7f95a41076b0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.570+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a419be30 con 0x7f95a41076b0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.570+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959403a390 con 0x7f95a41076b0 2024-09-15T22:02:09.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.570+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a419eb20 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.571+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f959403b430 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.571+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a4107b30 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.572+0000 7f959b400640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9588039160 0x7f958803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.572+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f959406c3c0 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.572+0000 7f9599400640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9588039160 0x7f958803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.573+0000 7f9599400640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9588039160 0x7f958803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f958c0098c0 tx=0x7f958c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.577+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f959406c120 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.753+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f95a419c2b0 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.754+0000 7f959b400640 1 -- 172.21.15.150:0/2453220112 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f9594040ce0 con 0x7f95a41076b0 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9588039160 msgr2=0x7f958803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9588039160 0x7f958803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f958c0098c0 tx=0x7f958c006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 msgr2=0x7f95a419b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a419b660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f95940097f0 tx=0x7f9594030d80 comp rx=0 tx=0).stop 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 shutdown_connections 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9588039160 0x7f958803b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 --2- 172.21.15.150:0/2453220112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a41076b0 0x7f95a419b660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 >> 172.21.15.150:0/2453220112 conn(0x7f95a4102e80 msgr2=0x7f95a41039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 shutdown_connections 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:08.756+0000 7f95a8c00640 1 -- 172.21.15.150:0/2453220112 wait complete. 2024-09-15T22:02:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:Enabling cephadm module... 2024-09-15T22:02:09.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:09 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2453220112' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:02:10.991 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:10 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1385184146' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T22:02:10.991 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: ignoring --setuser ceph since I am not root 2024-09-15T22:02:10.991 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: ignoring --setgroup ceph since I am not root 2024-09-15T22:02:10.991 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:10.916+0000 7ff3f620f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:02:10.991 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:10.990+0000 7ff3f620f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:02:11.255 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:11.175+0000 7ff3f620f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:02:11.256 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:11.254+0000 7ff3f620f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:02:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.847+0000 7f669ec00640 1 Processor -- start 2024-09-15T22:02:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.847+0000 7f669ec00640 1 -- start start 2024-09-15T22:02:11.373 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.848+0000 7f669ec00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f6698107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.848+0000 7f669ec00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6698108080 con 0x7f66981076b0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.848+0000 7f6697e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f6698107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.848+0000 7f6697e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f6698107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34774/0 (socket says 172.21.15.150:34774) 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.848+0000 7f6697e00640 1 -- 172.21.15.150:0/638029839 learned_addr learned my addr 172.21.15.150:0/638029839 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.848+0000 7f6697e00640 1 -- 172.21.15.150:0/638029839 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981088b0 con 0x7f66981076b0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.849+0000 7f6697e00640 1 --2- 172.21.15.150:0/638029839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f6698107ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6688009820 tx=0x7f668802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa55d110a6cc9c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f6697400640 1 -- 172.21.15.150:0/638029839 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688037070 con 0x7f66981076b0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f6697400640 1 -- 172.21.15.150:0/638029839 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6688032900 con 0x7f66981076b0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f6697400640 1 -- 172.21.15.150:0/638029839 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688030850 con 0x7f66981076b0 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 -- 172.21.15.150:0/638029839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 msgr2=0x7f6698107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 --2- 172.21.15.150:0/638029839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f6698107ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6688009820 tx=0x7f668802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 -- 172.21.15.150:0/638029839 shutdown_connections 2024-09-15T22:02:11.374 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 --2- 172.21.15.150:0/638029839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f6698107ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 -- 172.21.15.150:0/638029839 >> 172.21.15.150:0/638029839 conn(0x7f6698102e80 msgr2=0x7f66981052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 -- 172.21.15.150:0/638029839 shutdown_connections 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.850+0000 7f669ec00640 1 -- 172.21.15.150:0/638029839 wait complete. 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.851+0000 7f669ec00640 1 Processor -- start 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.851+0000 7f669ec00640 1 -- start start 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f669ec00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f669819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f669ec00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f669810bc60 con 0x7f66981076b0 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f6697e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f669819d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f6697e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f669819d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34784/0 (socket says 172.21.15.150:34784) 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f6697e00640 1 -- 172.21.15.150:0/1385184146 learned_addr learned my addr 172.21.15.150:0/1385184146 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f6697e00640 1 -- 172.21.15.150:0/1385184146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669819ddd0 con 0x7f66981076b0 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.852+0000 7f6697e00640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f669819d890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6688009940 tx=0x7f6688032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.853+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688042070 con 0x7f66981076b0 2024-09-15T22:02:11.375 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.853+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66880308c0 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.853+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669819e060 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.853+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6688037040 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.853+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66981a0d50 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.854+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f6688045070 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.855+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6698107b30 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.855+0000 7f6695600640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f667c0391b0 0x7f667c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.855+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f668806c2a0 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.855+0000 7f668f400640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f667c0391b0 0x7f667c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.856+0000 7f668f400640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f667c0391b0 0x7f667c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f66800098c0 tx=0x7f6680006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:09.860+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f668804b170 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.077+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f66981a13d0 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.695+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f668806bcc0 con 0x7f66981076b0 2024-09-15T22:02:11.376 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.696+0000 7f6695600640 1 -- 172.21.15.150:0/1385184146 <== mon.0 v2:172.21.15.150:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f66880327b0 con 0x7f66981076b0 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f667c0391b0 msgr2=0x7f667c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f667c0391b0 0x7f667c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f66800098c0 tx=0x7f6680006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 msgr2=0x7f669819d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f669819d890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6688009940 tx=0x7f6688032ce0 comp rx=0 tx=0).stop 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 shutdown_connections 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f667c0391b0 0x7f667c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 --2- 172.21.15.150:0/1385184146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66981076b0 0x7f669819d890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 >> 172.21.15.150:0/1385184146 conn(0x7f6698102e80 msgr2=0x7f66981039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 shutdown_connections 2024-09-15T22:02:11.377 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:10.699+0000 7f669ec00640 1 -- 172.21.15.150:0/1385184146 wait complete. 2024-09-15T22:02:11.509 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:11.434+0000 7ff3f620f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:02:11.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1385184146' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T22:02:11.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-mon[30886]: mgrmap e5: x(active, since 5s) 2024-09-15T22:02:11.764 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:11.601+0000 7ff3f620f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:02:12.058 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:11.986+0000 7ff3f620f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:02:12.386 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:12.057+0000 7ff3f620f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:02:12.386 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:12.275+0000 7ff3f620f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.864+0000 7f906be00640 1 Processor -- start 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.864+0000 7f906be00640 1 -- start start 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.865+0000 7f906be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c1078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.865+0000 7f906be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f906c107ec0 con 0x7f906c1074f0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.865+0000 7f906aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c1078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.865+0000 7f906aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c1078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34822/0 (socket says 172.21.15.150:34822) 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.865+0000 7f906aa00640 1 -- 172.21.15.150:0/686902822 learned_addr learned my addr 172.21.15.150:0/686902822 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.866+0000 7f906aa00640 1 -- 172.21.15.150:0/686902822 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c1086f0 con 0x7f906c1074f0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.866+0000 7f906aa00640 1 --2- 172.21.15.150:0/686902822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c1078f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f905c009820 tx=0x7f905c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50d098a01a926cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.867+0000 7f9069600640 1 -- 172.21.15.150:0/686902822 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f905c037070 con 0x7f906c1074f0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.867+0000 7f9069600640 1 -- 172.21.15.150:0/686902822 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f905c032900 con 0x7f906c1074f0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.867+0000 7f9069600640 1 -- 172.21.15.150:0/686902822 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f905c030850 con 0x7f906c1074f0 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.867+0000 7f906be00640 1 -- 172.21.15.150:0/686902822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 msgr2=0x7f906c1078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.867+0000 7f906be00640 1 --2- 172.21.15.150:0/686902822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c1078f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f905c009820 tx=0x7f905c02a270 comp rx=0 tx=0).stop 2024-09-15T22:02:12.673 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.868+0000 7f906be00640 1 -- 172.21.15.150:0/686902822 shutdown_connections 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.868+0000 7f906be00640 1 --2- 172.21.15.150:0/686902822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c1078f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.868+0000 7f906be00640 1 -- 172.21.15.150:0/686902822 >> 172.21.15.150:0/686902822 conn(0x7f906c102ce0 msgr2=0x7f906c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.868+0000 7f906be00640 1 -- 172.21.15.150:0/686902822 shutdown_connections 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.868+0000 7f906be00640 1 -- 172.21.15.150:0/686902822 wait complete. 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906be00640 1 Processor -- start 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906be00640 1 -- start start 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f906c10baa0 con 0x7f906c1074f0 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34834/0 (socket says 172.21.15.150:34834) 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.869+0000 7f906aa00640 1 -- 172.21.15.150:0/2960053325 learned_addr learned my addr 172.21.15.150:0/2960053325 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:12.674 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f906aa00640 1 -- 172.21.15.150:0/2960053325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c19dd10 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f906aa00640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c19d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097f0 tx=0x7f905c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f905c042070 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f905c032ca0 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906c19dfa0 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f905c037040 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.870+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906c1a0c90 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.871+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f905c045070 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.872+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906c107970 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.872+0000 7f9063400640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 0x7f905003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.872+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f905c06c180 con 0x7f906c1074f0 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.872+0000 7f906a000640 1 -- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 msgr2=0x7f905003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.872+0000 7f906a000640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 0x7f905003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:02:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:11.881+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f905c04b170 con 0x7f906c1074f0 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.073+0000 7f906a000640 1 -- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 msgr2=0x7f905003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.073+0000 7f906a000640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 0x7f905003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.107+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f906c1a12a0 con 0x7f906c1074f0 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.107+0000 7f9063400640 1 -- 172.21.15.150:0/2960053325 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f905c06bba0 con 0x7f906c1074f0 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 msgr2=0x7f905003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 0x7f905003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 msgr2=0x7f906c19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c19d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097f0 tx=0x7f905c030ec0 comp rx=0 tx=0).stop 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 shutdown_connections 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7f9050039200 0x7f905003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 --2- 172.21.15.150:0/2960053325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f906c1074f0 0x7f906c19d7d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:12.676 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 >> 172.21.15.150:0/2960053325 conn(0x7f906c102ce0 msgr2=0x7f906c103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:12.677 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 shutdown_connections 2024-09-15T22:02:12.677 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:12.110+0000 7f906be00640 1 -- 172.21.15.150:0/2960053325 wait complete. 2024-09-15T22:02:12.677 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for the mgr to restart... 2024-09-15T22:02:12.677 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for mgr epoch 5... 2024-09-15T22:02:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:12 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2960053325' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:02:13.676 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:13 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:13.400+0000 7ff3f620f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:02:13.676 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:13 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:13.479+0000 7ff3f620f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:02:14.675 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:14.376+0000 7ff3f620f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:02:14.675 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:14.512+0000 7ff3f620f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:02:14.675 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:14.673+0000 7ff3f620f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:02:14.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:14.744+0000 7ff3f620f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:02:14.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:14.912+0000 7ff3f620f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:02:15.321 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:14.994+0000 7ff3f620f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:02:15.321 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.064+0000 7ff3f620f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:02:15.321 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.243+0000 7ff3f620f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:02:15.322 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.319+0000 7ff3f620f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:02:15.634 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.397+0000 7ff3f620f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:02:15.634 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.492+0000 7ff3f620f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:02:15.634 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.562+0000 7ff3f620f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:02:15.634 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:15.632+0000 7ff3f620f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:02:16.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:16.536+0000 7ff3f620f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:02:16.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: Active manager daemon x restarted 2024-09-15T22:02:16.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: Activating manager daemon x 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: mgrmap e6: x(active, starting, since 0.00389703s) 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: Manager daemon x is now available 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:16.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:16 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:17.884 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:17 smithi150 ceph-mon[30886]: Found migration_current of "None". Setting to last migration. 2024-09-15T22:02:17.884 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:17 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:02:17.884 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:17 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:02:17.884 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:17 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:17.884 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:17 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:17.884 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:17 smithi150 ceph-mon[30886]: mgrmap e7: x(active, since 1.00713s) 2024-09-15T22:02:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T22:02:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:02:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.146+0000 7fb11fe00640 1 Processor -- start 2024-09-15T22:02:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.147+0000 7fb11fe00640 1 -- start start 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.147+0000 7fb11fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb1201078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.147+0000 7fb11fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb120107ec0 con 0x7fb1201074f0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.147+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb1201078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.147+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb1201078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34848/0 (socket says 172.21.15.150:34848) 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.147+0000 7fb11ea00640 1 -- 172.21.15.150:0/927019447 learned_addr learned my addr 172.21.15.150:0/927019447 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.148+0000 7fb11ea00640 1 -- 172.21.15.150:0/927019447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1201086f0 con 0x7fb1201074f0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.149+0000 7fb11ea00640 1 --2- 172.21.15.150:0/927019447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb1201078f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb110009820 tx=0x7fb11002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916bebebc2ee56ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.149+0000 7fb11d600640 1 -- 172.21.15.150:0/927019447 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb110037070 con 0x7fb1201074f0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.149+0000 7fb11d600640 1 -- 172.21.15.150:0/927019447 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb110032900 con 0x7fb1201074f0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.149+0000 7fb11d600640 1 -- 172.21.15.150:0/927019447 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb110030850 con 0x7fb1201074f0 2024-09-15T22:02:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 -- 172.21.15.150:0/927019447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 msgr2=0x7fb1201078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 --2- 172.21.15.150:0/927019447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb1201078f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb110009820 tx=0x7fb11002a270 comp rx=0 tx=0).stop 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 -- 172.21.15.150:0/927019447 shutdown_connections 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 --2- 172.21.15.150:0/927019447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb1201078f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 -- 172.21.15.150:0/927019447 >> 172.21.15.150:0/927019447 conn(0x7fb120102ce0 msgr2=0x7fb120105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 -- 172.21.15.150:0/927019447 shutdown_connections 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.150+0000 7fb11fe00640 1 -- 172.21.15.150:0/927019447 wait complete. 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.151+0000 7fb11fe00640 1 Processor -- start 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.151+0000 7fb11fe00640 1 -- start start 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.151+0000 7fb11fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb12019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.151+0000 7fb11fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb12010baa0 con 0x7fb1201074f0 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.151+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb12019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb12019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34858/0 (socket says 172.21.15.150:34858) 2024-09-15T22:02:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb11ea00640 1 -- 172.21.15.150:0/1331091941 learned_addr learned my addr 172.21.15.150:0/1331091941 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb11ea00640 1 -- 172.21.15.150:0/1331091941 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12019dd10 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb11ea00640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb12019d7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1100097f0 tx=0x7fb110030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb110042070 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb110032ca0 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.152+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12019dfa0 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.153+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb110037040 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.153+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1201a0c90 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.154+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fb110045070 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.154+0000 7fb117400640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.154+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 --> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb10403bdd0 con 0x7fb104039200 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.154+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb11006c170 con 0x7fb1201074f0 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.154+0000 7fb11e000640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 msgr2=0x7fb10403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.154+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.355+0000 7fb11e000640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 msgr2=0x7fb10403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.355+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.756+0000 7fb11e000640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 msgr2=0x7fb10403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:13.756+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:14.557+0000 7fb11e000640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 msgr2=0x7fb10403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:14.557+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:16.159+0000 7fb11e000640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 msgr2=0x7fb10403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/685691735 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:16.159+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:16.540+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fb11003cbc0 con 0x7fb1201074f0 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:16.541+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 msgr2=0x7fb10403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:16.541+0000 7fb117400640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.149 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.543+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fb11003b330 con 0x7fb1201074f0 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.543+0000 7fb117400640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb10403cb30 0x7fb10403ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.543+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb11002eb70 con 0x7fb10403cb30 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.544+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb10403cb30 0x7fb10403ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.545+0000 7fb11e000640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb10403cb30 0x7fb10403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb10c003980 tx=0x7fb10c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.546+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb11002eb70 con 0x7fb10403cb30 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.553+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb120107970 con 0x7fb10403cb30 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.553+0000 7fb117400640 1 -- 172.21.15.150:0/1331091941 <== mgr.14118 v2:172.21.15.150:6800/3271868660 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fb120107970 con 0x7fb10403cb30 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb10403cb30 msgr2=0x7fb10403ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb10403cb30 0x7fb10403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb10c003980 tx=0x7fb10c0092b0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 msgr2=0x7fb12019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb12019d7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1100097f0 tx=0x7fb110030ec0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.150 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 shutdown_connections 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/685691735,v1:172.21.15.150:6801/685691735] conn(0x7fb104039200 0x7fb10403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb10403cb30 0x7fb10403ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 --2- 172.21.15.150:0/1331091941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1201074f0 0x7fb12019d7d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 >> 172.21.15.150:0/1331091941 conn(0x7fb120102ce0 msgr2=0x7fb120103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 shutdown_connections 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:17.554+0000 7fb11fe00640 1 -- 172.21.15.150:0/1331091941 wait complete. 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:mgr epoch 5 is available 2024-09-15T22:02:18.151 INFO:teuthology.orchestra.run.smithi150.stdout:Setting orchestrator backend to cephadm... 2024-09-15T22:02:18.400 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:18.149+0000 7ff355800640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:02:18] ENGINE Error in HTTPServer.serve 2024-09-15T22:02:18.400 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: Traceback (most recent call last): 2024-09-15T22:02:18.400 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:02:18.400 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self._connections.run(self.expiration_interval) 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self._run(expiration_interval) 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: s = self.context.wrap_socket( 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: return self.sslsocket_class._create( 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:02:18.401 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self.do_handshake() 2024-09-15T22:02:18.402 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:02:18.402 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self._sslobj.do_handshake() 2024-09-15T22:02:18.402 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:02:18.402 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-mon[30886]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:02:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-mon[30886]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:02:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:18 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:19.458 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.621+0000 7fa93f000640 1 Processor -- start 2024-09-15T22:02:19.458 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.621+0000 7fa93f000640 1 -- start start 2024-09-15T22:02:19.458 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.621+0000 7fa93f000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa938109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.621+0000 7fa93f000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa93810a260 con 0x7fa938109890 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.621+0000 7fa937e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa938109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.622+0000 7fa937e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa938109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34908/0 (socket says 172.21.15.150:34908) 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.622+0000 7fa937e00640 1 -- 172.21.15.150:0/3779017620 learned_addr learned my addr 172.21.15.150:0/3779017620 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.622+0000 7fa937e00640 1 -- 172.21.15.150:0/3779017620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93810aae0 con 0x7fa938109890 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.623+0000 7fa937e00640 1 --2- 172.21.15.150:0/3779017620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa938109c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa928009820 tx=0x7fa92802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7621f7f7892027 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.623+0000 7fa937400640 1 -- 172.21.15.150:0/3779017620 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928037070 con 0x7fa938109890 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.623+0000 7fa937400640 1 -- 172.21.15.150:0/3779017620 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa928032900 con 0x7fa938109890 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.623+0000 7fa937400640 1 -- 172.21.15.150:0/3779017620 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928030850 con 0x7fa938109890 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 -- 172.21.15.150:0/3779017620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 msgr2=0x7fa938109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 --2- 172.21.15.150:0/3779017620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa938109c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa928009820 tx=0x7fa92802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 -- 172.21.15.150:0/3779017620 shutdown_connections 2024-09-15T22:02:19.459 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 --2- 172.21.15.150:0/3779017620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa938109c90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 -- 172.21.15.150:0/3779017620 >> 172.21.15.150:0/3779017620 conn(0x7fa93807cea0 msgr2=0x7fa93807d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 -- 172.21.15.150:0/3779017620 shutdown_connections 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.624+0000 7fa93f000640 1 -- 172.21.15.150:0/3779017620 wait complete. 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.625+0000 7fa93f000640 1 Processor -- start 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.625+0000 7fa93f000640 1 -- start start 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.625+0000 7fa93f000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa93819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.625+0000 7fa93f000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa93810de90 con 0x7fa938109890 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.626+0000 7fa937e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa93819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.626+0000 7fa937e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa93819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34914/0 (socket says 172.21.15.150:34914) 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.626+0000 7fa937e00640 1 -- 172.21.15.150:0/2734914438 learned_addr learned my addr 172.21.15.150:0/2734914438 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.626+0000 7fa937e00640 1 -- 172.21.15.150:0/2734914438 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93819dd90 con 0x7fa938109890 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.626+0000 7fa937e00640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa93819d850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa9280097f0 tx=0x7fa928030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.627+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928037040 con 0x7fa938109890 2024-09-15T22:02:19.460 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.627+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa928040070 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.627+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa92803a390 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.627+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93819e020 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.627+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9381a0d10 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.628+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa92803b430 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.628+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa938109d10 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.628+0000 7fa935600640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa91c039200 0x7fa91c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.628+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa92806c800 con 0x7fa938109890 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.628+0000 7fa92fe00640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa91c039200 0x7fa91c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.629+0000 7fa92fe00640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa91c039200 0x7fa91c03b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa9200098c0 tx=0x7fa920006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:19.461 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.634+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa92806c150 con 0x7fa938109890 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.826+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fa938107bf0 con 0x7fa91c039200 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.832+0000 7fa935600640 1 -- 172.21.15.150:0/2734914438 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa938107bf0 con 0x7fa91c039200 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.834+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa91c039200 msgr2=0x7fa91c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.834+0000 7fa93f000640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa91c039200 0x7fa91c03b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa9200098c0 tx=0x7fa920006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.834+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 msgr2=0x7fa93819d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.834+0000 7fa93f000640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa93819d850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa9280097f0 tx=0x7fa928030d80 comp rx=0 tx=0).stop 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.835+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 shutdown_connections 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.835+0000 7fa93f000640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa91c039200 0x7fa91c03b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.835+0000 7fa93f000640 1 --2- 172.21.15.150:0/2734914438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa938109890 0x7fa93819d850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.835+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 >> 172.21.15.150:0/2734914438 conn(0x7fa93807cea0 msgr2=0x7fa9381074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.835+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 shutdown_connections 2024-09-15T22:02:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:18.835+0000 7fa93f000640 1 -- 172.21.15.150:0/2734914438 wait complete. 2024-09-15T22:02:19.717 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:18] ENGINE Bus STARTING 2024-09-15T22:02:19.717 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:18] ENGINE Serving on https://172.21.15.150:7150 2024-09-15T22:02:19.717 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:18] ENGINE Error in HTTPServer.serve 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: Traceback (most recent call last): 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: self._run(expiration_interval) 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: s = self.context.wrap_socket( 2024-09-15T22:02:19.718 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout: return self.sslsocket_class._create( 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout: self.do_handshake() 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout: self._sslobj.do_handshake() 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:18] ENGINE Serving on http://172.21.15.150:8765 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:18] ENGINE Bus STARTED 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: mgrmap e8: x(active, since 2s) 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:19.719 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:19 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:20.804 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:20 smithi150 ceph-mon[30886]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:20.815 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T22:02:20.815 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.946+0000 7f3e6c000640 1 Processor -- start 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.947+0000 7f3e6c000640 1 -- start start 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.947+0000 7f3e6c000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e64107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.947+0000 7f3e6c000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e64108110 con 0x7f3e64107740 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.947+0000 7f3e69600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e64107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.947+0000 7f3e69600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e64107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36400/0 (socket says 172.21.15.150:36400) 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.947+0000 7f3e69600640 1 -- 172.21.15.150:0/960921652 learned_addr learned my addr 172.21.15.150:0/960921652 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.948+0000 7f3e69600640 1 -- 172.21.15.150:0/960921652 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e64108940 con 0x7f3e64107740 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.948+0000 7f3e69600640 1 --2- 172.21.15.150:0/960921652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e64107b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009820 tx=0x7f3e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e93b08f4a0bcf2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.949+0000 7f3e63e00640 1 -- 172.21.15.150:0/960921652 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58037070 con 0x7f3e64107740 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.949+0000 7f3e63e00640 1 -- 172.21.15.150:0/960921652 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e58032900 con 0x7f3e64107740 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.949+0000 7f3e63e00640 1 -- 172.21.15.150:0/960921652 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58030850 con 0x7f3e64107740 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.949+0000 7f3e6c000640 1 -- 172.21.15.150:0/960921652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 msgr2=0x7f3e64107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:20.816 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.949+0000 7f3e6c000640 1 --2- 172.21.15.150:0/960921652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e64107b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009820 tx=0x7f3e5802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.950+0000 7f3e6c000640 1 -- 172.21.15.150:0/960921652 shutdown_connections 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.950+0000 7f3e6c000640 1 --2- 172.21.15.150:0/960921652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e64107b40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.950+0000 7f3e6c000640 1 -- 172.21.15.150:0/960921652 >> 172.21.15.150:0/960921652 conn(0x7f3e64102f10 msgr2=0x7f3e64105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.950+0000 7f3e6c000640 1 -- 172.21.15.150:0/960921652 shutdown_connections 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.950+0000 7f3e6c000640 1 -- 172.21.15.150:0/960921652 wait complete. 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e6c000640 1 Processor -- start 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e6c000640 1 -- start start 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e6c000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e6407db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e6c000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410bcf0 con 0x7f3e64107740 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e69600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e6407db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e69600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e6407db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36416/0 (socket says 172.21.15.150:36416) 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.951+0000 7f3e69600640 1 -- 172.21.15.150:0/3107057800 learned_addr learned my addr 172.21.15.150:0/3107057800 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:20.817 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e69600640 1 -- 172.21.15.150:0/3107057800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6407e0d0 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e69600640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e6407db90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e580097f0 tx=0x7f3e58030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58042070 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e5803d430 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e6c000640 1 -- 172.21.15.150:0/3107057800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6407c2c0 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58037040 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.952+0000 7f3e6c000640 1 -- 172.21.15.150:0/3107057800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6407c800 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.954+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3e58045070 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.954+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e40005290 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.954+0000 7f3e62000640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e4c039200 0x7f3e4c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.954+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e5806c0a0 con 0x7f3e64107740 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.954+0000 7f3e68c00640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e4c039200 0x7f3e4c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.955+0000 7f3e68c00640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e4c039200 0x7f3e4c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098c0 tx=0x7f3e50006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:20.818 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:19.959+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e58045360 con 0x7f3e64107740 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.138+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f3e40000bc0 con 0x7f3e4c039200 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.139+0000 7f3e62000640 1 -- 172.21.15.150:0/3107057800 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f3e40000bc0 con 0x7f3e4c039200 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.141+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e4c039200 msgr2=0x7f3e4c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.141+0000 7f3e57400640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e4c039200 0x7f3e4c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098c0 tx=0x7f3e50006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 msgr2=0x7f3e6407db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e6407db90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e580097f0 tx=0x7f3e58030d80 comp rx=0 tx=0).stop 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 shutdown_connections 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e4c039200 0x7f3e4c03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 --2- 172.21.15.150:0/3107057800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e64107740 0x7f3e6407db90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 >> 172.21.15.150:0/3107057800 conn(0x7f3e64102f10 msgr2=0x7f3e64103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 shutdown_connections 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:20.142+0000 7f3e57400640 1 -- 172.21.15.150:0/3107057800 wait complete. 2024-09-15T22:02:20.819 INFO:teuthology.orchestra.run.smithi150.stdout:Generating ssh key... 2024-09-15T22:02:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-mon[30886]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:21.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: Generating public/private rsa key pair. 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: Your identification has been saved in /tmp/tmp6946q6wh/key 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: Your public key has been saved in /tmp/tmp6946q6wh/key.pub 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: The key fingerprint is: 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: SHA256:RiERRX6TAI/EQdMd+IS1ABXn7Tx726I0aJxdKIL8e6Q ceph-faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: The key's randomart image is: 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: +---[RSA 3072]----+ 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | o@@O*+. | 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | ..*+*o+ | 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | . +o* . | 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | . o ..+ . | 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | o S . = . | 2024-09-15T22:02:21.927 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | o o.= + | 2024-09-15T22:02:21.928 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | .o= = . | 2024-09-15T22:02:21.928 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | Eo.. o.o | 2024-09-15T22:02:21.928 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: | .. .....| 2024-09-15T22:02:21.928 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: +----[SHA256]-----+ 2024-09-15T22:02:22.204 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e5e00640 1 Processor -- start 2024-09-15T22:02:22.204 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e5e00640 1 -- start start 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e5e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e010af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e5e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76e010b530 con 0x7f76e010ab60 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e010af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e010af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36422/0 (socket says 172.21.15.150:36422) 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.288+0000 7f76e4a00640 1 -- 172.21.15.150:0/470117203 learned_addr learned my addr 172.21.15.150:0/470117203 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.289+0000 7f76e4a00640 1 -- 172.21.15.150:0/470117203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e010b6b0 con 0x7f76e010ab60 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.290+0000 7f76e4a00640 1 --2- 172.21.15.150:0/470117203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e010af60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009820 tx=0x7f76d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17eb4d4c5292d7cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.290+0000 7f76df400640 1 -- 172.21.15.150:0/470117203 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d4037070 con 0x7f76e010ab60 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.290+0000 7f76df400640 1 -- 172.21.15.150:0/470117203 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76d4032900 con 0x7f76e010ab60 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.290+0000 7f76df400640 1 -- 172.21.15.150:0/470117203 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d4030850 con 0x7f76e010ab60 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 -- 172.21.15.150:0/470117203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 msgr2=0x7f76e010af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:22.205 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 --2- 172.21.15.150:0/470117203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e010af60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009820 tx=0x7f76d402a270 comp rx=0 tx=0).stop 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 -- 172.21.15.150:0/470117203 shutdown_connections 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 --2- 172.21.15.150:0/470117203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e010af60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 -- 172.21.15.150:0/470117203 >> 172.21.15.150:0/470117203 conn(0x7f76e007cce0 msgr2=0x7f76e007d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 -- 172.21.15.150:0/470117203 shutdown_connections 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.291+0000 7f76e5e00640 1 -- 172.21.15.150:0/470117203 wait complete. 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e5e00640 1 Processor -- start 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e5e00640 1 -- start start 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e5e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e5e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76e010dbc0 con 0x7f76e010ab60 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e019d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36436/0 (socket says 172.21.15.150:36436) 2024-09-15T22:02:22.206 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.292+0000 7f76e4a00640 1 -- 172.21.15.150:0/2332574459 learned_addr learned my addr 172.21.15.150:0/2332574459 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76e4a00640 1 -- 172.21.15.150:0/2332574459 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e019dc40 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76e4a00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e019d700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d4042070 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76d4032ca0 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d4037040 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e019ded0 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.293+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e01a0bc0 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.295+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f76d4045070 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.295+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e010af60 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.295+0000 7f76dd600640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f76c80391b0 0x7f76c803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.295+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f76d406c340 con 0x7f76e010ab60 2024-09-15T22:02:22.207 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.295+0000 7f76dfe00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f76c80391b0 0x7f76c803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.296+0000 7f76dfe00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f76c80391b0 0x7f76c803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0098c0 tx=0x7f76cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.300+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76d404b170 con 0x7f76e010ab60 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.475+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f76e0107c30 con 0x7f76c80391b0 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.613+0000 7f76dd600640 1 -- 172.21.15.150:0/2332574459 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f76e0107c30 con 0x7f76c80391b0 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f76c80391b0 msgr2=0x7f76c803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f76c80391b0 0x7f76c803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0098c0 tx=0x7f76cc006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 msgr2=0x7f76e019d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e019d700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d4030ec0 comp rx=0 tx=0).stop 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 shutdown_connections 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f76c80391b0 0x7f76c803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 --2- 172.21.15.150:0/2332574459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76e010ab60 0x7f76e019d700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:22.208 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 >> 172.21.15.150:0/2332574459 conn(0x7f76e007cce0 msgr2=0x7f76e0107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:22.209 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 shutdown_connections 2024-09-15T22:02:22.209 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:21.615+0000 7f76e5e00640 1 -- 172.21.15.150:0/2332574459 wait complete. 2024-09-15T22:02:22.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:22 smithi150 ceph-mon[30886]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:22.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:22 smithi150 ceph-mon[30886]: Generating ssh key... 2024-09-15T22:02:22.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:22 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:22.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:22 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:23.537 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:02:23.537 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.743+0000 7f069c000640 1 Processor -- start 2024-09-15T22:02:23.537 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.743+0000 7f069c000640 1 -- start start 2024-09-15T22:02:23.537 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.743+0000 7f069c000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:23.537 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.743+0000 7f069c000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f069407c8f0 con 0x7f069407dec0 2024-09-15T22:02:23.537 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.744+0000 7f0699600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.744+0000 7f0699600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36452/0 (socket says 172.21.15.150:36452) 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.744+0000 7f0699600640 1 -- 172.21.15.150:0/1723816370 learned_addr learned my addr 172.21.15.150:0/1723816370 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.744+0000 7f0699600640 1 -- 172.21.15.150:0/1723816370 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069407ca70 con 0x7f069407dec0 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.745+0000 7f0699600640 1 --2- 172.21.15.150:0/1723816370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069407c320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0688009820 tx=0x7f068802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b626534043ca3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.745+0000 7f0693e00640 1 -- 172.21.15.150:0/1723816370 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688037070 con 0x7f069407dec0 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.745+0000 7f0693e00640 1 -- 172.21.15.150:0/1723816370 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0688032900 con 0x7f069407dec0 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.745+0000 7f0693e00640 1 -- 172.21.15.150:0/1723816370 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688030850 con 0x7f069407dec0 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 -- 172.21.15.150:0/1723816370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 msgr2=0x7f069407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 --2- 172.21.15.150:0/1723816370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069407c320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0688009820 tx=0x7f068802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 -- 172.21.15.150:0/1723816370 shutdown_connections 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 --2- 172.21.15.150:0/1723816370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069407c320 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 -- 172.21.15.150:0/1723816370 >> 172.21.15.150:0/1723816370 conn(0x7f0694102e80 msgr2=0x7f06941052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 -- 172.21.15.150:0/1723816370 shutdown_connections 2024-09-15T22:02:23.538 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.746+0000 7f069c000640 1 -- 172.21.15.150:0/1723816370 wait complete. 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.747+0000 7f069c000640 1 Processor -- start 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.747+0000 7f069c000640 1 -- start start 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f069c000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f069c000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f069410dcc0 con 0x7f069407dec0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f0699600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f0699600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36468/0 (socket says 172.21.15.150:36468) 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f0699600640 1 -- 172.21.15.150:0/1982345088 learned_addr learned my addr 172.21.15.150:0/1982345088 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f0699600640 1 -- 172.21.15.150:0/1982345088 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069419dd50 con 0x7f069407dec0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.748+0000 7f0699600640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069419d810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0688032ce0 tx=0x7f0688032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.749+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688042070 con 0x7f069407dec0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.749+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06880308c0 con 0x7f069407dec0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.749+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069419dfe0 con 0x7f069407dec0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.749+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688037040 con 0x7f069407dec0 2024-09-15T22:02:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.749+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06941a0cd0 con 0x7f069407dec0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.750+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0688045070 con 0x7f069407dec0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.750+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069407c3a0 con 0x7f069407dec0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.750+0000 7f0692000640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f067c0391b0 0x7f067c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.750+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f068806c540 con 0x7f069407dec0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.750+0000 7f0698c00640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f067c0391b0 0x7f067c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.751+0000 7f0698c00640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f067c0391b0 0x7f067c03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f06800098c0 tx=0x7f0680006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.756+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f068806be90 con 0x7f069407dec0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.931+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f0694104100 con 0x7f067c0391b0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.932+0000 7f0692000640 1 -- 172.21.15.150:0/1982345088 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f0694104100 con 0x7f067c0391b0 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f067c0391b0 msgr2=0x7f067c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f067c0391b0 0x7f067c03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f06800098c0 tx=0x7f0680006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:23.540 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 msgr2=0x7f069419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069419d810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0688032ce0 tx=0x7f0688032d10 comp rx=0 tx=0).stop 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 shutdown_connections 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f067c0391b0 0x7f067c03b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 --2- 172.21.15.150:0/1982345088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f069407dec0 0x7f069419d810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.934+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 >> 172.21.15.150:0/1982345088 conn(0x7f0694102e80 msgr2=0x7f06941039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.935+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 shutdown_connections 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:22.935+0000 7f069c000640 1 -- 172.21.15.150:0/1982345088 wait complete. 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:02:23.541 INFO:teuthology.orchestra.run.smithi150.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T22:02:23.542 INFO:teuthology.orchestra.run.smithi150.stdout:Adding host smithi150... 2024-09-15T22:02:24.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:23 smithi150 ceph-mon[30886]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:25.125 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:24 smithi150 ceph-mon[30886]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi150", "addr": "172.21.15.150", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:26.020 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:25 smithi150 ceph-mon[30886]: Deploying cephadm binary to smithi150 2024-09-15T22:02:28.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout Added host 'smithi150' with addr '172.21.15.150' 2024-09-15T22:02:28.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.994+0000 7f88cf200640 1 Processor -- start 2024-09-15T22:02:28.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.995+0000 7f88cf200640 1 -- start start 2024-09-15T22:02:28.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.995+0000 7f88cf200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d010af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:28.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.995+0000 7f88cf200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010b530 con 0x7f88d010ab60 2024-09-15T22:02:28.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.995+0000 7f88cde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d010af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.995+0000 7f88cde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d010af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36480/0 (socket says 172.21.15.150:36480) 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.995+0000 7f88cde00640 1 -- 172.21.15.150:0/2126872727 learned_addr learned my addr 172.21.15.150:0/2126872727 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.996+0000 7f88cde00640 1 -- 172.21.15.150:0/2126872727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d010b6b0 con 0x7f88d010ab60 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.997+0000 7f88cde00640 1 --2- 172.21.15.150:0/2126872727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d010af60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009820 tx=0x7f88c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b883c023c16ac0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.997+0000 7f88cd400640 1 -- 172.21.15.150:0/2126872727 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c0037070 con 0x7f88d010ab60 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.997+0000 7f88cd400640 1 -- 172.21.15.150:0/2126872727 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88c0032900 con 0x7f88d010ab60 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.997+0000 7f88cd400640 1 -- 172.21.15.150:0/2126872727 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c0030850 con 0x7f88d010ab60 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.997+0000 7f88cf200640 1 -- 172.21.15.150:0/2126872727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 msgr2=0x7f88d010af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.997+0000 7f88cf200640 1 --2- 172.21.15.150:0/2126872727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d010af60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009820 tx=0x7f88c002a270 comp rx=0 tx=0).stop 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.998+0000 7f88cf200640 1 -- 172.21.15.150:0/2126872727 shutdown_connections 2024-09-15T22:02:28.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.998+0000 7f88cf200640 1 --2- 172.21.15.150:0/2126872727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d010af60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.998+0000 7f88cf200640 1 -- 172.21.15.150:0/2126872727 >> 172.21.15.150:0/2126872727 conn(0x7f88d007cce0 msgr2=0x7f88d007d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.998+0000 7f88cf200640 1 -- 172.21.15.150:0/2126872727 shutdown_connections 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.998+0000 7f88cf200640 1 -- 172.21.15.150:0/2126872727 wait complete. 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cf200640 1 Processor -- start 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cf200640 1 -- start start 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cf200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cf200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010dbc0 con 0x7f88d010ab60 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36494/0 (socket says 172.21.15.150:36494) 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cde00640 1 -- 172.21.15.150:0/1854194708 learned_addr learned my addr 172.21.15.150:0/1854194708 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:23.999+0000 7f88cde00640 1 -- 172.21.15.150:0/1854194708 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d019dc00 con 0x7f88d010ab60 2024-09-15T22:02:28.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.000+0000 7f88cde00640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d019d6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f88c00097f0 tx=0x7f88c0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.000+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c0042070 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.000+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88c0032ca0 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.000+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d019de90 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.000+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c0037040 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.000+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d01a0b80 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.001+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f88c0045070 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.001+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d010af60 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.002+0000 7f88c7400640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f88b4039200 0x7f88b403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.002+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f88c006c330 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.002+0000 7f88c5400640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f88b4039200 0x7f88b403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.003+0000 7f88c5400640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f88b4039200 0x7f88b403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f88b80098c0 tx=0x7f88b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.007+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88c006bc80 con 0x7f88d010ab60 2024-09-15T22:02:28.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:24.184+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi150", "addr": "172.21.15.150", "target": ["mon-mgr", ""]}) -- 0x7f88d0107c20 con 0x7f88b4039200 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.005+0000 7f88c7400640 1 -- 172.21.15.150:0/1854194708 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f88d0107c20 con 0x7f88b4039200 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.008+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f88b4039200 msgr2=0x7f88b403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.008+0000 7f88cf200640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f88b4039200 0x7f88b403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f88b80098c0 tx=0x7f88b8006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.008+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 msgr2=0x7f88d019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.008+0000 7f88cf200640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d019d6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f88c00097f0 tx=0x7f88c0030ec0 comp rx=0 tx=0).stop 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.009+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 shutdown_connections 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.009+0000 7f88cf200640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f88b4039200 0x7f88b403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.009+0000 7f88cf200640 1 --2- 172.21.15.150:0/1854194708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88d010ab60 0x7f88d019d6c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.009+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 >> 172.21.15.150:0/1854194708 conn(0x7f88d007cce0 msgr2=0x7f88d0107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.009+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 shutdown_connections 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:28.009+0000 7f88cf200640 1 -- 172.21.15.150:0/1854194708 wait complete. 2024-09-15T22:02:28.701 INFO:teuthology.orchestra.run.smithi150.stdout:Deploying unmanaged mon service... 2024-09-15T22:02:29.243 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:29 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:29.243 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:29 smithi150 ceph-mon[30886]: Added host smithi150 2024-09-15T22:02:29.243 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:29 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:30.810 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:30 smithi150 ceph-mon[30886]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:30.810 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:30 smithi150 ceph-mon[30886]: Saving service mon spec with placement count:5 2024-09-15T22:02:30.810 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:30 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.240+0000 7f440b200640 1 Processor -- start 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.241+0000 7f440b200640 1 -- start start 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.241+0000 7f440b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.241+0000 7f440b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f440c07c8d0 con 0x7f440c07dea0 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.241+0000 7f4409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.242+0000 7f4409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c07c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36504/0 (socket says 172.21.15.150:36504) 2024-09-15T22:02:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.242+0000 7f4409e00640 1 -- 172.21.15.150:0/3760504218 learned_addr learned my addr 172.21.15.150:0/3760504218 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.242+0000 7f4409e00640 1 -- 172.21.15.150:0/3760504218 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c07ca50 con 0x7f440c07dea0 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.243+0000 7f4409e00640 1 --2- 172.21.15.150:0/3760504218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c07c300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009e80 tx=0x7f43fc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6083cbf9d77b4ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.243+0000 7f4409400640 1 -- 172.21.15.150:0/3760504218 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc036070 con 0x7f440c07dea0 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.243+0000 7f4409400640 1 -- 172.21.15.150:0/3760504218 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43fc0318c0 con 0x7f440c07dea0 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.243+0000 7f4409400640 1 -- 172.21.15.150:0/3760504218 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc007ab0 con 0x7f440c07dea0 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 -- 172.21.15.150:0/3760504218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 msgr2=0x7f440c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 --2- 172.21.15.150:0/3760504218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c07c300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009e80 tx=0x7f43fc02a7a0 comp rx=0 tx=0).stop 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 -- 172.21.15.150:0/3760504218 shutdown_connections 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 --2- 172.21.15.150:0/3760504218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c07c300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 -- 172.21.15.150:0/3760504218 >> 172.21.15.150:0/3760504218 conn(0x7f440c102ce0 msgr2=0x7f440c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:31.154 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 -- 172.21.15.150:0/3760504218 shutdown_connections 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.244+0000 7f440b200640 1 -- 172.21.15.150:0/3760504218 wait complete. 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.245+0000 7f440b200640 1 Processor -- start 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.245+0000 7f440b200640 1 -- start start 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.245+0000 7f440b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.245+0000 7f440b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f440c10dac0 con 0x7f440c07dea0 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.246+0000 7f4409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.246+0000 7f4409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36506/0 (socket says 172.21.15.150:36506) 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.246+0000 7f4409e00640 1 -- 172.21.15.150:0/2556380867 learned_addr learned my addr 172.21.15.150:0/2556380867 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.246+0000 7f4409e00640 1 -- 172.21.15.150:0/2556380867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c19dc30 con 0x7f440c07dea0 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.246+0000 7f4409e00640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c19d6f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43fc031ca0 tx=0x7f43fc031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.247+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc036050 con 0x7f440c07dea0 2024-09-15T22:02:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.247+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43fc042070 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.247+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43fc03d940 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.247+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c19dec0 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.247+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c1a0bb0 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.248+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f43fc03b610 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.248+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c07c380 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.248+0000 7f4403400640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f43f0039200 0x7f43f003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.248+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f43fc007e00 con 0x7f440c07dea0 2024-09-15T22:02:31.156 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.249+0000 7f4401400640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f43f0039200 0x7f43f003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.249+0000 7f4401400640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f43f0039200 0x7f43f003b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43f40098c0 tx=0x7f43f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.254+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43fc042220 con 0x7f440c07dea0 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.465+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f440c103fd0 con 0x7f43f0039200 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.474+0000 7f4403400640 1 -- 172.21.15.150:0/2556380867 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f440c103fd0 con 0x7f43f0039200 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f43f0039200 msgr2=0x7f43f003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f43f0039200 0x7f43f003b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43f40098c0 tx=0x7f43f4006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 msgr2=0x7f440c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c19d6f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43fc031ca0 tx=0x7f43fc031cd0 comp rx=0 tx=0).stop 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 shutdown_connections 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f43f0039200 0x7f43f003b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 --2- 172.21.15.150:0/2556380867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c07dea0 0x7f440c19d6f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 >> 172.21.15.150:0/2556380867 conn(0x7f440c102ce0 msgr2=0x7f440c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:31.157 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 shutdown_connections 2024-09-15T22:02:31.158 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:29.476+0000 7f440b200640 1 -- 172.21.15.150:0/2556380867 wait complete. 2024-09-15T22:02:31.158 INFO:teuthology.orchestra.run.smithi150.stdout:Deploying unmanaged mgr service... 2024-09-15T22:02:31.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:31 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:31.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:31 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:31.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:31 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:32.584 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T22:02:32.584 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.666+0000 7f2059e00640 1 Processor -- start 2024-09-15T22:02:32.584 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.666+0000 7f2059e00640 1 -- start start 2024-09-15T22:02:32.584 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.666+0000 7f2059e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205410af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.666+0000 7f2059e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f205410b530 con 0x7f205410ab60 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.667+0000 7f2058a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205410af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.667+0000 7f2058a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205410af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39230/0 (socket says 172.21.15.150:39230) 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.667+0000 7f2058a00640 1 -- 172.21.15.150:0/1640476026 learned_addr learned my addr 172.21.15.150:0/1640476026 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.667+0000 7f2058a00640 1 -- 172.21.15.150:0/1640476026 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205410b6b0 con 0x7f205410ab60 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.668+0000 7f2058a00640 1 --2- 172.21.15.150:0/1640476026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205410af60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2048009820 tx=0x7f204802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1871bf3745f78c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.669+0000 7f2053400640 1 -- 172.21.15.150:0/1640476026 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048037070 con 0x7f205410ab60 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.669+0000 7f2053400640 1 -- 172.21.15.150:0/1640476026 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048032920 con 0x7f205410ab60 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.669+0000 7f2053400640 1 -- 172.21.15.150:0/1640476026 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048030810 con 0x7f205410ab60 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 -- 172.21.15.150:0/1640476026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 msgr2=0x7f205410af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 --2- 172.21.15.150:0/1640476026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205410af60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2048009820 tx=0x7f204802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:32.585 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 -- 172.21.15.150:0/1640476026 shutdown_connections 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 --2- 172.21.15.150:0/1640476026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205410af60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 -- 172.21.15.150:0/1640476026 >> 172.21.15.150:0/1640476026 conn(0x7f205407cce0 msgr2=0x7f205407d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 -- 172.21.15.150:0/1640476026 shutdown_connections 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.670+0000 7f2059e00640 1 -- 172.21.15.150:0/1640476026 wait complete. 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2059e00640 1 Processor -- start 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2059e00640 1 -- start start 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2059e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2059e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f205410dbc0 con 0x7f205410ab60 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2058a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2058a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39236/0 (socket says 172.21.15.150:39236) 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.671+0000 7f2058a00640 1 -- 172.21.15.150:0/1958809482 learned_addr learned my addr 172.21.15.150:0/1958809482 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.672+0000 7f2058a00640 1 -- 172.21.15.150:0/1958809482 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205419dc70 con 0x7f205410ab60 2024-09-15T22:02:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.672+0000 7f2058a00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205419d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f20480097f0 tx=0x7f20480327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.672+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048037040 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.672+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048030c40 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.672+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205419df00 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.672+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204803a5d0 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.673+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20541a0bf0 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.674+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205410dd40 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.674+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f204803a7c0 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.674+0000 7f2051600640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f203c039200 0x7f203c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.674+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f204806c810 con 0x7f205410ab60 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.675+0000 7f2053e00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f203c039200 0x7f203c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.675+0000 7f2053e00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f203c039200 0x7f203c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20400098c0 tx=0x7f2040006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:32.587 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.679+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2048030df0 con 0x7f205410ab60 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.874+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2054107c50 con 0x7f203c039200 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.880+0000 7f2051600640 1 -- 172.21.15.150:0/1958809482 <== mgr.14118 v2:172.21.15.150:6800/3271868660 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2054107c50 con 0x7f203c039200 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f203c039200 msgr2=0x7f203c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f203c039200 0x7f203c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20400098c0 tx=0x7f2040006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 msgr2=0x7f205419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205419d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f20480097f0 tx=0x7f20480327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 shutdown_connections 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f203c039200 0x7f203c03b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 --2- 172.21.15.150:0/1958809482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f205410ab60 0x7f205419d730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 >> 172.21.15.150:0/1958809482 conn(0x7f205407cce0 msgr2=0x7f2054107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:32.588 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 shutdown_connections 2024-09-15T22:02:32.589 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:31.883+0000 7f2059e00640 1 -- 172.21.15.150:0/1958809482 wait complete. 2024-09-15T22:02:33.092 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:32 smithi150 ceph-mon[30886]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:33.093 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:32 smithi150 ceph-mon[30886]: Saving service mgr spec with placement count:2 2024-09-15T22:02:34.284 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.119+0000 7fd4e6200640 1 Processor -- start 2024-09-15T22:02:34.284 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.119+0000 7fd4e6200640 1 -- start start 2024-09-15T22:02:34.284 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.119+0000 7fd4e6200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e010af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:34.284 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.119+0000 7fd4e6200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010b530 con 0x7fd4e010ab60 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.120+0000 7fd4e4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e010af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.120+0000 7fd4e4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e010af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39250/0 (socket says 172.21.15.150:39250) 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.120+0000 7fd4e4e00640 1 -- 172.21.15.150:0/932338630 learned_addr learned my addr 172.21.15.150:0/932338630 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.120+0000 7fd4e4e00640 1 -- 172.21.15.150:0/932338630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e010b6b0 con 0x7fd4e010ab60 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.121+0000 7fd4e4e00640 1 --2- 172.21.15.150:0/932338630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e010af60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009820 tx=0x7fd4d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc5b679bb8a513b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.121+0000 7fd4df400640 1 -- 172.21.15.150:0/932338630 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4037070 con 0x7fd4e010ab60 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.121+0000 7fd4df400640 1 -- 172.21.15.150:0/932338630 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d4032920 con 0x7fd4e010ab60 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.121+0000 7fd4df400640 1 -- 172.21.15.150:0/932338630 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4030810 con 0x7fd4e010ab60 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 -- 172.21.15.150:0/932338630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 msgr2=0x7fd4e010af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 --2- 172.21.15.150:0/932338630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e010af60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009820 tx=0x7fd4d402a270 comp rx=0 tx=0).stop 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 -- 172.21.15.150:0/932338630 shutdown_connections 2024-09-15T22:02:34.285 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 --2- 172.21.15.150:0/932338630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e010af60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 -- 172.21.15.150:0/932338630 >> 172.21.15.150:0/932338630 conn(0x7fd4e007cce0 msgr2=0x7fd4e007d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 -- 172.21.15.150:0/932338630 shutdown_connections 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.122+0000 7fd4e6200640 1 -- 172.21.15.150:0/932338630 wait complete. 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.123+0000 7fd4e6200640 1 Processor -- start 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.123+0000 7fd4e6200640 1 -- start start 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.124+0000 7fd4e6200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.124+0000 7fd4e6200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010dbc0 con 0x7fd4e010ab60 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.124+0000 7fd4e4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.124+0000 7fd4e4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39256/0 (socket says 172.21.15.150:39256) 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.124+0000 7fd4e4e00640 1 -- 172.21.15.150:0/248201806 learned_addr learned my addr 172.21.15.150:0/248201806 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.124+0000 7fd4e4e00640 1 -- 172.21.15.150:0/248201806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e019dc10 con 0x7fd4e010ab60 2024-09-15T22:02:34.286 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.125+0000 7fd4e4e00640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e019d6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40097f0 tx=0x7fd4d40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.125+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4037040 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.125+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d4030c40 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.125+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e019dea0 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.125+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d403a5d0 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.125+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01a0b90 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.126+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd4d403a810 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.126+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e010dd40 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.126+0000 7fd4dd600640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fd4c80391b0 0x7fd4c803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.127+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd4d406c780 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.127+0000 7fd4dfe00640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fd4c80391b0 0x7fd4c803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.127+0000 7fd4dfe00640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fd4c80391b0 0x7fd4c803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0098c0 tx=0x7fd4cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.132+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4d40371e0 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.312+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd4e010afe0 con 0x7fd4e010ab60 2024-09-15T22:02:34.287 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.316+0000 7fd4dd600640 1 -- 172.21.15.150:0/248201806 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fd4d4030df0 con 0x7fd4e010ab60 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fd4c80391b0 msgr2=0x7fd4c803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fd4c80391b0 0x7fd4c803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0098c0 tx=0x7fd4cc006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 msgr2=0x7fd4e019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e019d6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40097f0 tx=0x7fd4d40327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 shutdown_connections 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fd4c80391b0 0x7fd4c803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 --2- 172.21.15.150:0/248201806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4e010ab60 0x7fd4e019d6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 >> 172.21.15.150:0/248201806 conn(0x7fd4e007cce0 msgr2=0x7fd4e0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 shutdown_connections 2024-09-15T22:02:34.288 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:33.319+0000 7fd4e6200640 1 -- 172.21.15.150:0/248201806 wait complete. 2024-09-15T22:02:34.592 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:34 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/248201806' entity='client.admin' 2024-09-15T22:02:34.592 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:34 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.855+0000 7f3e1be00640 1 Processor -- start 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.856+0000 7f3e1be00640 1 -- start start 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.856+0000 7f3e1be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c1078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.856+0000 7f3e1be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c107ec0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.856+0000 7f3e1aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c1078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.856+0000 7f3e1aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c1078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39268/0 (socket says 172.21.15.150:39268) 2024-09-15T22:02:35.696 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.856+0000 7f3e1aa00640 1 -- 172.21.15.150:0/4026048705 learned_addr learned my addr 172.21.15.150:0/4026048705 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.857+0000 7f3e1aa00640 1 -- 172.21.15.150:0/4026048705 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c1086f0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.858+0000 7f3e1aa00640 1 --2- 172.21.15.150:0/4026048705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c1078f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009820 tx=0x7f3e0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3906305fa68bd98b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.858+0000 7f3e1a000640 1 -- 172.21.15.150:0/4026048705 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c037070 con 0x7f3e1c1074f0 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1a000640 1 -- 172.21.15.150:0/4026048705 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e0c032920 con 0x7f3e1c1074f0 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1a000640 1 -- 172.21.15.150:0/4026048705 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c030810 con 0x7f3e1c1074f0 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1be00640 1 -- 172.21.15.150:0/4026048705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 msgr2=0x7f3e1c1078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1be00640 1 --2- 172.21.15.150:0/4026048705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c1078f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009820 tx=0x7f3e0c02a270 comp rx=0 tx=0).stop 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1be00640 1 -- 172.21.15.150:0/4026048705 shutdown_connections 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1be00640 1 --2- 172.21.15.150:0/4026048705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c1078f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1be00640 1 -- 172.21.15.150:0/4026048705 >> 172.21.15.150:0/4026048705 conn(0x7f3e1c102ce0 msgr2=0x7f3e1c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.859+0000 7f3e1be00640 1 -- 172.21.15.150:0/4026048705 shutdown_connections 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.860+0000 7f3e1be00640 1 -- 172.21.15.150:0/4026048705 wait complete. 2024-09-15T22:02:35.697 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.861+0000 7f3e1be00640 1 Processor -- start 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.861+0000 7f3e1be00640 1 -- start start 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.861+0000 7f3e1be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.861+0000 7f3e1be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c10baa0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.862+0000 7f3e1aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.862+0000 7f3e1aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39272/0 (socket says 172.21.15.150:39272) 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.862+0000 7f3e1aa00640 1 -- 172.21.15.150:0/3538205478 learned_addr learned my addr 172.21.15.150:0/3538205478 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.862+0000 7f3e1aa00640 1 -- 172.21.15.150:0/3538205478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c19ba60 con 0x7f3e1c1074f0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.862+0000 7f3e1aa00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c19b520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097f0 tx=0x7f3e0c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.863+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c037040 con 0x7f3e1c1074f0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.863+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e0c030c40 con 0x7f3e1c1074f0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.863+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c03a5b0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.863+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c19bcf0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.863+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c19e9e0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.864+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3e0c03a750 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.864+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c107970 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.865+0000 7f3e13400640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e00039200 0x7f3e0003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.865+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e0c06c770 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.865+0000 7f3e13e00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e00039200 0x7f3e0003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.866+0000 7f3e13e00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e00039200 0x7f3e0003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e040098c0 tx=0x7f3e04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:34.870+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e0c042dc0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.053+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f3e1c19ebb0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.056+0000 7f3e13400640 1 -- 172.21.15.150:0/3538205478 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f3e0c06c0c0 con 0x7f3e1c1074f0 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.058+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e00039200 msgr2=0x7f3e0003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:35.699 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.058+0000 7f3e1be00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e00039200 0x7f3e0003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e040098c0 tx=0x7f3e04006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.058+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 msgr2=0x7f3e1c19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.058+0000 7f3e1be00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c19b520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097f0 tx=0x7f3e0c0327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.059+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 shutdown_connections 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.059+0000 7f3e1be00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7f3e00039200 0x7f3e0003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.059+0000 7f3e1be00640 1 --2- 172.21.15.150:0/3538205478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1c1074f0 0x7f3e1c19b520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.059+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 >> 172.21.15.150:0/3538205478 conn(0x7f3e1c102ce0 msgr2=0x7f3e1c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.059+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 shutdown_connections 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:35.059+0000 7f3e1be00640 1 -- 172.21.15.150:0/3538205478 wait complete. 2024-09-15T22:02:35.700 INFO:teuthology.orchestra.run.smithi150.stdout:Enabling the dashboard module... 2024-09-15T22:02:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:36 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3538205478' entity='client.admin' 2024-09-15T22:02:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:36 smithi150 ceph-mon[30886]: from='mgr.14118 172.21.15.150:0/3724424316' entity='mgr.x' 2024-09-15T22:02:37.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2594768358' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T22:02:37.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-mon[30886]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:02:37.309 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: ignoring --setuser ceph since I am not root 2024-09-15T22:02:37.309 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: ignoring --setgroup ceph since I am not root 2024-09-15T22:02:37.310 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:37.307+0000 7ff5e8636040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:02:37.561 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:37.378+0000 7ff5e8636040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:02:37.824 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:37.567+0000 7ff5e8636040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:02:37.825 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:37.648+0000 7ff5e8636040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:02:37.825 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:37.822+0000 7ff5e8636040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:02:38.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:38 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2594768358' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T22:02:38.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:38 smithi150 ceph-mon[30886]: mgrmap e9: x(active, since 20s) 2024-09-15T22:02:38.176 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:37.992+0000 7ff5e8636040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa391a00640 1 Processor -- start 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa391a00640 1 -- start start 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa391a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c106800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa391a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c106dd0 con 0x7fa38c106400 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa38be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c106800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa38be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c106800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39282/0 (socket says 172.21.15.150:39282) 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.179+0000 7fa38be00640 1 -- 172.21.15.150:0/1073840905 learned_addr learned my addr 172.21.15.150:0/1073840905 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.180+0000 7fa38be00640 1 -- 172.21.15.150:0/1073840905 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c107600 con 0x7fa38c106400 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.181+0000 7fa38be00640 1 --2- 172.21.15.150:0/1073840905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c106800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d180 tx=0x7fa37c02c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f35b01b5eabc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:38.263 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.181+0000 7fa38b400640 1 -- 172.21.15.150:0/1073840905 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c00b410 con 0x7fa38c106400 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.181+0000 7fa38b400640 1 -- 172.21.15.150:0/1073840905 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa37c009ae0 con 0x7fa38c106400 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.181+0000 7fa38b400640 1 -- 172.21.15.150:0/1073840905 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c033b90 con 0x7fa38c106400 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 -- 172.21.15.150:0/1073840905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 msgr2=0x7fa38c106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 --2- 172.21.15.150:0/1073840905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c106800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d180 tx=0x7fa37c02c9a0 comp rx=0 tx=0).stop 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 -- 172.21.15.150:0/1073840905 shutdown_connections 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 --2- 172.21.15.150:0/1073840905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c106800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 -- 172.21.15.150:0/1073840905 >> 172.21.15.150:0/1073840905 conn(0x7fa38c101bf0 msgr2=0x7fa38c104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 -- 172.21.15.150:0/1073840905 shutdown_connections 2024-09-15T22:02:38.264 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.182+0000 7fa391a00640 1 -- 172.21.15.150:0/1073840905 wait complete. 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa391a00640 1 Processor -- start 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa391a00640 1 -- start start 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa391a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa391a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c07aff0 con 0x7fa38c106400 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa38be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa38be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c19d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39290/0 (socket says 172.21.15.150:39290) 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.183+0000 7fa38be00640 1 -- 172.21.15.150:0/2594768358 learned_addr learned my addr 172.21.15.150:0/2594768358 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.184+0000 7fa38be00640 1 -- 172.21.15.150:0/2594768358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c19dcf0 con 0x7fa38c106400 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.184+0000 7fa38be00640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c19d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0338a0 tx=0x7fa37c033bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.184+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c043070 con 0x7fa38c106400 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.184+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa37c03c910 con 0x7fa38c106400 2024-09-15T22:02:38.265 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.184+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c03b720 con 0x7fa38c106400 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.184+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c19df80 con 0x7fa38c106400 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.185+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c1a0c70 con 0x7fa38c106400 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.186+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa37c046070 con 0x7fa38c106400 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.186+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c106880 con 0x7fa38c106400 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.186+0000 7fa389600640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa370039200 0x7fa37003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.186+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa37c030050 con 0x7fa38c106400 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.187+0000 7fa383400640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa370039200 0x7fa37003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:38.266 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.187+0000 7fa383400640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa370039200 0x7fa37003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa3740098c0 tx=0x7fa374006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.191+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa37c04e260 con 0x7fa38c106400 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:36.442+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fa38c196c20 con 0x7fa38c106400 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.061+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fa37c03cdf0 con 0x7fa38c106400 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.062+0000 7fa389600640 1 -- 172.21.15.150:0/2594768358 <== mon.0 v2:172.21.15.150:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fa37c03cac0 con 0x7fa38c106400 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa370039200 msgr2=0x7fa37003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa370039200 0x7fa37003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa3740098c0 tx=0x7fa374006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 msgr2=0x7fa38c19d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c19d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0338a0 tx=0x7fa37c033bb0 comp rx=0 tx=0).stop 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 shutdown_connections 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fa370039200 0x7fa37003b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 --2- 172.21.15.150:0/2594768358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa38c106400 0x7fa38c19d7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 >> 172.21.15.150:0/2594768358 conn(0x7fa38c101bf0 msgr2=0x7fa38c193d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 shutdown_connections 2024-09-15T22:02:38.267 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:37.065+0000 7fa391a00640 1 -- 172.21.15.150:0/2594768358 wait complete. 2024-09-15T22:02:38.526 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:38 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:38.366+0000 7ff5e8636040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:02:38.526 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:38 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:38.441+0000 7ff5e8636040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:02:38.780 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:38 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:38.659+0000 7ff5e8636040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:02:39.357 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:39 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3209475819' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.764+0000 7ffaad400640 1 Processor -- start 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.764+0000 7ffaad400640 1 -- start start 2024-09-15T22:02:39.636 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.765+0000 7ffaad400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa8107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.765+0000 7ffaad400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81080a0 con 0x7ffaa81076d0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.765+0000 7ffaa6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa8107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.765+0000 7ffaa6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa8107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39312/0 (socket says 172.21.15.150:39312) 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.765+0000 7ffaa6800640 1 -- 172.21.15.150:0/1202517853 learned_addr learned my addr 172.21.15.150:0/1202517853 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.765+0000 7ffaa6800640 1 -- 172.21.15.150:0/1202517853 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa81088d0 con 0x7ffaa81076d0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.766+0000 7ffaa6800640 1 --2- 172.21.15.150:0/1202517853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa8107ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009820 tx=0x7ffa9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5614bb727deb257e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.767+0000 7ffaa5400640 1 -- 172.21.15.150:0/1202517853 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa98037070 con 0x7ffaa81076d0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.767+0000 7ffaa5400640 1 -- 172.21.15.150:0/1202517853 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa98032920 con 0x7ffaa81076d0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.767+0000 7ffaa5400640 1 -- 172.21.15.150:0/1202517853 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa98030810 con 0x7ffaa81076d0 2024-09-15T22:02:39.637 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.767+0000 7ffaad400640 1 -- 172.21.15.150:0/1202517853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 msgr2=0x7ffaa8107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.767+0000 7ffaad400640 1 --2- 172.21.15.150:0/1202517853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa8107ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009820 tx=0x7ffa9802a270 comp rx=0 tx=0).stop 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.768+0000 7ffaad400640 1 -- 172.21.15.150:0/1202517853 shutdown_connections 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.768+0000 7ffaad400640 1 --2- 172.21.15.150:0/1202517853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa8107ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.768+0000 7ffaad400640 1 -- 172.21.15.150:0/1202517853 >> 172.21.15.150:0/1202517853 conn(0x7ffaa8102e80 msgr2=0x7ffaa81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.768+0000 7ffaad400640 1 -- 172.21.15.150:0/1202517853 shutdown_connections 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.768+0000 7ffaad400640 1 -- 172.21.15.150:0/1202517853 wait complete. 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.769+0000 7ffaad400640 1 Processor -- start 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.769+0000 7ffaad400640 1 -- start start 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.769+0000 7ffaad400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.769+0000 7ffaad400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa810bc80 con 0x7ffaa81076d0 2024-09-15T22:02:39.638 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.769+0000 7ffaa6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.769+0000 7ffaa6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39324/0 (socket says 172.21.15.150:39324) 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.770+0000 7ffaa6800640 1 -- 172.21.15.150:0/3209475819 learned_addr learned my addr 172.21.15.150:0/3209475819 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.770+0000 7ffaa6800640 1 -- 172.21.15.150:0/3209475819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa819de00 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.770+0000 7ffaa6800640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa819d8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097f0 tx=0x7ffa980327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.770+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa98037040 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.770+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa98030cc0 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.770+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa819e090 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.771+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa9803a640 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.771+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81a0d80 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.772+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ffa9803a940 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.772+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa8107b50 con 0x7ffaa81076d0 2024-09-15T22:02:39.639 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.772+0000 7ffa9f400640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 0x7ffa8c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.772+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffa9806c9e0 con 0x7ffaa81076d0 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.772+0000 7ffaa5e00640 1 -- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 msgr2=0x7ffa8c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/3271868660 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.772+0000 7ffaa5e00640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 0x7ffa8c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.777+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa98042300 con 0x7ffaa81076d0 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.973+0000 7ffaa5e00640 1 -- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 msgr2=0x7ffa8c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/3271868660 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:38.973+0000 7ffaa5e00640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 0x7ffa8c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.000+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ffaa81a1370 con 0x7ffaa81076d0 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.000+0000 7ffa9f400640 1 -- 172.21.15.150:0/3209475819 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ffa98049200 con 0x7ffaa81076d0 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.002+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 msgr2=0x7ffa8c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.002+0000 7ffaad400640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 0x7ffa8c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:39.640 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.002+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 msgr2=0x7ffaa819d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.002+0000 7ffaad400640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa819d8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097f0 tx=0x7ffa980327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.003+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 shutdown_connections 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.003+0000 7ffaad400640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7ffa8c039200 0x7ffa8c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.003+0000 7ffaad400640 1 --2- 172.21.15.150:0/3209475819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa81076d0 0x7ffaa819d8c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.003+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 >> 172.21.15.150:0/3209475819 conn(0x7ffaa8102e80 msgr2=0x7ffaa8103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.003+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 shutdown_connections 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:39.003+0000 7ffaad400640 1 -- 172.21.15.150:0/3209475819 wait complete. 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for the mgr to restart... 2024-09-15T22:02:39.641 INFO:teuthology.orchestra.run.smithi150.stdout:Waiting for mgr epoch 9... 2024-09-15T22:02:39.896 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:39 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:39.817+0000 7ff5e8636040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:02:40.176 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:39 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:39.907+0000 7ff5e8636040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:02:41.143 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:40 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:40.839+0000 7ff5e8636040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:02:41.143 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:40 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:40.975+0000 7ff5e8636040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:02:41.144 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.141+0000 7ff5e8636040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:02:41.426 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.216+0000 7ff5e8636040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:02:41.426 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.386+0000 7ff5e8636040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:02:41.720 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.467+0000 7ff5e8636040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:02:41.720 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.538+0000 7ff5e8636040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:02:41.720 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.717+0000 7ff5e8636040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:02:41.998 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.818+0000 7ff5e8636040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:02:41.998 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.900+0000 7ff5e8636040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:02:41.998 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:41.996+0000 7ff5e8636040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:02:42.426 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:42 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:42.067+0000 7ff5e8636040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:02:42.426 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:42 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:42.137+0000 7ff5e8636040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:02:43.426 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:43.044+0000 7ff5e8636040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:02:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: Active manager daemon x restarted 2024-09-15T22:02:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: Activating manager daemon x 2024-09-15T22:02:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T22:02:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: mgrmap e10: x(active, starting, since 0.00422379s) 2024-09-15T22:02:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:02:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:02:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:02:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:02:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:02:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: Manager daemon x is now available 2024-09-15T22:02:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:44.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:02:44.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:02:44.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-mon[30886]: mgrmap e11: x(active, since 1.00741s) 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:44.141+0000 7ff53ec00640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:02:44] ENGINE Error in HTTPServer.serve 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: Traceback (most recent call last): 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self._connections.run(self.expiration_interval) 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self._run(expiration_interval) 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:02:44.427 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: s = self.context.wrap_socket( 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: return self.sslsocket_class._create( 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self.do_handshake() 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: self._sslobj.do_handshake() 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:02:44.428 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:02:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:02:44.835 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:02:44.835 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T22:02:44.835 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:02:44.835 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:02:44.835 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.127+0000 7fb3d5400640 1 Processor -- start 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.128+0000 7fb3d5400640 1 -- start start 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.128+0000 7fb3d5400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d01078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.128+0000 7fb3d5400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d0107ec0 con 0x7fb3d01074f0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.128+0000 7fb3cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d01078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.128+0000 7fb3cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d01078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50258/0 (socket says 172.21.15.150:50258) 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.128+0000 7fb3cfe00640 1 -- 172.21.15.150:0/3723698102 learned_addr learned my addr 172.21.15.150:0/3723698102 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.129+0000 7fb3cfe00640 1 -- 172.21.15.150:0/3723698102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d01086f0 con 0x7fb3d01074f0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.130+0000 7fb3cfe00640 1 --2- 172.21.15.150:0/3723698102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d01078f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009820 tx=0x7fb3c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910776453db020e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.130+0000 7fb3cea00640 1 -- 172.21.15.150:0/3723698102 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c0037070 con 0x7fb3d01074f0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.130+0000 7fb3cea00640 1 -- 172.21.15.150:0/3723698102 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c0032920 con 0x7fb3d01074f0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.130+0000 7fb3cea00640 1 -- 172.21.15.150:0/3723698102 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c0030810 con 0x7fb3d01074f0 2024-09-15T22:02:44.836 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 -- 172.21.15.150:0/3723698102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 msgr2=0x7fb3d01078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 --2- 172.21.15.150:0/3723698102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d01078f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009820 tx=0x7fb3c002a270 comp rx=0 tx=0).stop 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 -- 172.21.15.150:0/3723698102 shutdown_connections 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 --2- 172.21.15.150:0/3723698102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d01078f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 -- 172.21.15.150:0/3723698102 >> 172.21.15.150:0/3723698102 conn(0x7fb3d0102ce0 msgr2=0x7fb3d0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 -- 172.21.15.150:0/3723698102 shutdown_connections 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.131+0000 7fb3d5400640 1 -- 172.21.15.150:0/3723698102 wait complete. 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.132+0000 7fb3d5400640 1 Processor -- start 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.132+0000 7fb3d5400640 1 -- start start 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.132+0000 7fb3d5400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.133+0000 7fb3d5400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d010baa0 con 0x7fb3d01074f0 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.133+0000 7fb3cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.133+0000 7fb3cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50270/0 (socket says 172.21.15.150:50270) 2024-09-15T22:02:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.133+0000 7fb3cfe00640 1 -- 172.21.15.150:0/1733202188 learned_addr learned my addr 172.21.15.150:0/1733202188 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.133+0000 7fb3cfe00640 1 -- 172.21.15.150:0/1733202188 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d007e0d0 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.133+0000 7fb3cfe00640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d007db90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00097f0 tx=0x7fb3c00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.134+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c0037040 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.134+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c0030c40 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.134+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3c003a5b0 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.134+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d007c2c0 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.134+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d007c800 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.135+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fb3c003a7f0 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.135+0000 7fb3ccc00640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.135+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 --> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb3b403bdd0 con 0x7fb3b4039200 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.135+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb3c006c7c0 con 0x7fb3d01074f0 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.135+0000 7fb3cf400640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 msgr2=0x7fb3b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/3271868660 2024-09-15T22:02:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.136+0000 7fb3cf400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.337+0000 7fb3cf400640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 msgr2=0x7fb3b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/3271868660 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.337+0000 7fb3cf400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.738+0000 7fb3cf400640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 msgr2=0x7fb3b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/3271868660 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:40.738+0000 7fb3cf400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:41.539+0000 7fb3cf400640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 msgr2=0x7fb3b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6800/3271868660 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:41.539+0000 7fb3cf400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:43.048+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fb3c006b1b0 con 0x7fb3d01074f0 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:43.048+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 msgr2=0x7fb3b403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:43.048+0000 7fb3ccc00640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.050+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fb3c003b3f0 con 0x7fb3d01074f0 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.051+0000 7fb3ccc00640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb3b403ccc0 0x7fb3b403f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.051+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb3c0039ec0 con 0x7fb3b403ccc0 2024-09-15T22:02:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.051+0000 7fb3cf400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb3b403ccc0 0x7fb3b403f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.053+0000 7fb3cf400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb3b403ccc0 0x7fb3b403f0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc003980 tx=0x7fb3bc006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.054+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb3c0039ec0 con 0x7fb3b403ccc0 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.061+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb3d0107970 con 0x7fb3b403ccc0 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.061+0000 7fb3ccc00640 1 -- 172.21.15.150:0/1733202188 <== mgr.14150 v2:172.21.15.150:6800/1242932536 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fb3d0107970 con 0x7fb3b403ccc0 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb3b403ccc0 msgr2=0x7fb3b403f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb3b403ccc0 0x7fb3b403f0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc003980 tx=0x7fb3bc006e10 comp rx=0 tx=0).stop 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 msgr2=0x7fb3d007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d007db90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00097f0 tx=0x7fb3c00327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 shutdown_connections 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb3b403ccc0 0x7fb3b403f0b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:6800/3271868660,v1:172.21.15.150:6801/3271868660] conn(0x7fb3b4039200 0x7fb3b403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 --2- 172.21.15.150:0/1733202188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d01074f0 0x7fb3d007db90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:44.840 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 >> 172.21.15.150:0/1733202188 conn(0x7fb3d0102ce0 msgr2=0x7fb3d0103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:44.841 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 shutdown_connections 2024-09-15T22:02:44.841 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:44.062+0000 7fb3d5400640 1 -- 172.21.15.150:0/1733202188 wait complete. 2024-09-15T22:02:44.841 INFO:teuthology.orchestra.run.smithi150.stdout:mgr epoch 9 is available 2024-09-15T22:02:44.841 INFO:teuthology.orchestra.run.smithi150.stdout:Generating a dashboard self-signed certificate... 2024-09-15T22:02:45.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:43] ENGINE Bus STARTING 2024-09-15T22:02:45.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:44] ENGINE Serving on http://172.21.15.150:8765 2024-09-15T22:02:45.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:02:45.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:44] ENGINE Serving on https://172.21.15.150:7150 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:44] ENGINE Bus STARTED 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:45 smithi150 ceph-mon[30886]: [15/Sep/2024:22:02:44] ENGINE Error in HTTPServer.serve 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: Traceback (most recent call last): 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: self._run(expiration_interval) 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:02:45.412 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: s = self.context.wrap_socket( 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: return self.sslsocket_class._create( 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: self.do_handshake() 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: self._sslobj.do_handshake() 2024-09-15T22:02:45.413 INFO:journalctl@ceph.mon.a.smithi150.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:02:46.317 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:46 smithi150 ceph-mon[30886]: mgrmap e12: x(active, since 2s) 2024-09-15T22:02:46.317 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:46.317 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:46.317 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.661+0000 7fac17000640 1 Processor -- start 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.661+0000 7fac17000640 1 -- start start 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.661+0000 7fac17000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac10081af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.661+0000 7fac17000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac100820c0 con 0x7fac100816f0 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.662+0000 7fac0fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac10081af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.662+0000 7fac0fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac10081af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50348/0 (socket says 172.21.15.150:50348) 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.662+0000 7fac0fe00640 1 -- 172.21.15.150:0/3894775098 learned_addr learned my addr 172.21.15.150:0/3894775098 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:46.611 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.662+0000 7fac0fe00640 1 -- 172.21.15.150:0/3894775098 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1010ee90 con 0x7fac100816f0 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.663+0000 7fac0fe00640 1 --2- 172.21.15.150:0/3894775098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac10081af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac00009820 tx=0x7fac0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edd3dc2428ed372 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.663+0000 7fac0ea00640 1 -- 172.21.15.150:0/3894775098 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac00037070 con 0x7fac100816f0 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.663+0000 7fac0ea00640 1 -- 172.21.15.150:0/3894775098 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac00032920 con 0x7fac100816f0 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.663+0000 7fac0ea00640 1 -- 172.21.15.150:0/3894775098 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac00030810 con 0x7fac100816f0 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 -- 172.21.15.150:0/3894775098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 msgr2=0x7fac10081af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 --2- 172.21.15.150:0/3894775098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac10081af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac00009820 tx=0x7fac0002a270 comp rx=0 tx=0).stop 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 -- 172.21.15.150:0/3894775098 shutdown_connections 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 --2- 172.21.15.150:0/3894775098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac10081af0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 -- 172.21.15.150:0/3894775098 >> 172.21.15.150:0/3894775098 conn(0x7fac1007cea0 msgr2=0x7fac1007f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 -- 172.21.15.150:0/3894775098 shutdown_connections 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.664+0000 7fac17000640 1 -- 172.21.15.150:0/3894775098 wait complete. 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.665+0000 7fac17000640 1 Processor -- start 2024-09-15T22:02:46.612 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.665+0000 7fac17000640 1 -- start start 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac17000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac101a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac17000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac10112240 con 0x7fac100816f0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac0fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac101a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac0fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac101a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50360/0 (socket says 172.21.15.150:50360) 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac0fe00640 1 -- 172.21.15.150:0/1100037467 learned_addr learned my addr 172.21.15.150:0/1100037467 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac0fe00640 1 -- 172.21.15.150:0/1100037467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac101a2200 con 0x7fac100816f0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.666+0000 7fac0fe00640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac101a1cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac000097f0 tx=0x7fac00030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.667+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac00037040 con 0x7fac100816f0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.667+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac00040070 con 0x7fac100816f0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.667+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac101a2490 con 0x7fac100816f0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.667+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0003a6d0 con 0x7fac100816f0 2024-09-15T22:02:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.667+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101a5180 con 0x7fac100816f0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.668+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fac000327b0 con 0x7fac100816f0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.668+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac10081af0 con 0x7fac100816f0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.668+0000 7fac0cc00640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fabf4039200 0x7fabf403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.668+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fac0006ca40 con 0x7fac100816f0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.669+0000 7fac0f400640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fabf4039200 0x7fabf403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.669+0000 7fac0f400640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fabf4039200 0x7fabf403b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0098c0 tx=0x7fabfc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.674+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac0004a200 con 0x7fac100816f0 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.861+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fac1007e120 con 0x7fabf4039200 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.925+0000 7fac0cc00640 1 -- 172.21.15.150:0/1100037467 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fac1007e120 con 0x7fabf4039200 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fabf4039200 msgr2=0x7fabf403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fabf4039200 0x7fabf403b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0098c0 tx=0x7fabfc006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 msgr2=0x7fac101a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac101a1cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac000097f0 tx=0x7fac00030d40 comp rx=0 tx=0).stop 2024-09-15T22:02:46.614 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 shutdown_connections 2024-09-15T22:02:46.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fabf4039200 0x7fabf403b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:46.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 --2- 172.21.15.150:0/1100037467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac100816f0 0x7fac101a1cc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:46.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 >> 172.21.15.150:0/1100037467 conn(0x7fac1007cea0 msgr2=0x7fac1007da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:46.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 shutdown_connections 2024-09-15T22:02:46.615 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:45.927+0000 7fac17000640 1 -- 172.21.15.150:0/1100037467 wait complete. 2024-09-15T22:02:46.615 INFO:teuthology.orchestra.run.smithi150.stdout:Creating initial admin user... 2024-09-15T22:02:47.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:47 smithi150 ceph-mon[30886]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:47.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:48.880 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:48 smithi150 ceph-mon[30886]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:48.880 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:48 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$JR3VtlvATViG2LtSS3PtD.18sNm6yeCyFbSTp3CauitzSWhnJB9gy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726437767, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.139+0000 7f1b75a00640 1 Processor -- start 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.139+0000 7f1b75a00640 1 -- start start 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.139+0000 7f1b75a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b70109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.139+0000 7f1b75a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7010a260 con 0x7f1b70109890 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.140+0000 7f1b6ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b70109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.140+0000 7f1b6ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b70109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50376/0 (socket says 172.21.15.150:50376) 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.140+0000 7f1b6ea00640 1 -- 172.21.15.150:0/550073696 learned_addr learned my addr 172.21.15.150:0/550073696 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.140+0000 7f1b6ea00640 1 -- 172.21.15.150:0/550073696 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7010aae0 con 0x7f1b70109890 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.141+0000 7f1b6ea00640 1 --2- 172.21.15.150:0/550073696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b70109c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009820 tx=0x7f1b6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a84e0d4a978669d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.141+0000 7f1b6e000640 1 -- 172.21.15.150:0/550073696 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b60037070 con 0x7f1b70109890 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.141+0000 7f1b6e000640 1 -- 172.21.15.150:0/550073696 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b60032920 con 0x7f1b70109890 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.141+0000 7f1b6e000640 1 -- 172.21.15.150:0/550073696 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b60030810 con 0x7f1b70109890 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 -- 172.21.15.150:0/550073696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 msgr2=0x7f1b70109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 --2- 172.21.15.150:0/550073696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b70109c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009820 tx=0x7f1b6002a270 comp rx=0 tx=0).stop 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 -- 172.21.15.150:0/550073696 shutdown_connections 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 --2- 172.21.15.150:0/550073696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b70109c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 -- 172.21.15.150:0/550073696 >> 172.21.15.150:0/550073696 conn(0x7f1b7007cea0 msgr2=0x7f1b7007d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 -- 172.21.15.150:0/550073696 shutdown_connections 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.142+0000 7f1b75a00640 1 -- 172.21.15.150:0/550073696 wait complete. 2024-09-15T22:02:48.892 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.143+0000 7f1b75a00640 1 Processor -- start 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.143+0000 7f1b75a00640 1 -- start start 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.143+0000 7f1b75a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b7019d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.143+0000 7f1b75a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7010de90 con 0x7f1b70109890 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b6ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b7019d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b6ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b7019d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50382/0 (socket says 172.21.15.150:50382) 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b6ea00640 1 -- 172.21.15.150:0/3738853952 learned_addr learned my addr 172.21.15.150:0/3738853952 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b6ea00640 1 -- 172.21.15.150:0/3738853952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7019dd90 con 0x7f1b70109890 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b6ea00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b7019d850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b60030380 tx=0x7f1b60032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b60037040 con 0x7f1b70109890 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b60040070 con 0x7f1b70109890 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7019e020 con 0x7f1b70109890 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.144+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b6003a7b0 con 0x7f1b70109890 2024-09-15T22:02:48.893 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.145+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b701a0d10 con 0x7f1b70109890 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.146+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f1b6003b420 con 0x7f1b70109890 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.146+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b70109d10 con 0x7f1b70109890 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.146+0000 7f1b67400640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1b54039200 0x7f1b5403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.146+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b6006cae0 con 0x7f1b70109890 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.146+0000 7f1b67e00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1b54039200 0x7f1b5403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.147+0000 7f1b67e00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1b54039200 0x7f1b5403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b580098c0 tx=0x7f1b58006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.151+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b60043360 con 0x7f1b70109890 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.365+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f1b7019e500 con 0x7f1b54039200 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.592+0000 7f1b67400640 1 -- 172.21.15.150:0/3738853952 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f1b7019e500 con 0x7f1b54039200 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1b54039200 msgr2=0x7f1b5403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1b54039200 0x7f1b5403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b580098c0 tx=0x7f1b58006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 msgr2=0x7f1b7019d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:48.894 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b7019d850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b60030380 tx=0x7f1b60032670 comp rx=0 tx=0).stop 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 shutdown_connections 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1b54039200 0x7f1b5403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 --2- 172.21.15.150:0/3738853952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b70109890 0x7f1b7019d850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 >> 172.21.15.150:0/3738853952 conn(0x7f1b7007cea0 msgr2=0x7f1b70107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 shutdown_connections 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:47.595+0000 7f1b75a00640 1 -- 172.21.15.150:0/3738853952 wait complete. 2024-09-15T22:02:48.895 INFO:teuthology.orchestra.run.smithi150.stdout:Fetching dashboard port number... 2024-09-15T22:02:49.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:49 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2527080940' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T22:02:50.195 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.379+0000 7f909fc00640 1 Processor -- start 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909fc00640 1 -- start start 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909fc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f9098107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909fc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9098108080 con 0x7f90981076b0 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f9098107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f9098107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50384/0 (socket says 172.21.15.150:50384) 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909d200640 1 -- 172.21.15.150:0/2501240477 learned_addr learned my addr 172.21.15.150:0/2501240477 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.380+0000 7f909d200640 1 -- 172.21.15.150:0/2501240477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90981088b0 con 0x7f90981076b0 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.381+0000 7f909d200640 1 --2- 172.21.15.150:0/2501240477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f9098107ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f908c009820 tx=0x7f908c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba81202bfcf8b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:50.196 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f9097400640 1 -- 172.21.15.150:0/2501240477 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c037070 con 0x7f90981076b0 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f9097400640 1 -- 172.21.15.150:0/2501240477 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f908c032920 con 0x7f90981076b0 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f9097400640 1 -- 172.21.15.150:0/2501240477 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c030810 con 0x7f90981076b0 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f909fc00640 1 -- 172.21.15.150:0/2501240477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 msgr2=0x7f9098107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f909fc00640 1 --2- 172.21.15.150:0/2501240477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f9098107ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f908c009820 tx=0x7f908c02a270 comp rx=0 tx=0).stop 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f909fc00640 1 -- 172.21.15.150:0/2501240477 shutdown_connections 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f909fc00640 1 --2- 172.21.15.150:0/2501240477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f9098107ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f909fc00640 1 -- 172.21.15.150:0/2501240477 >> 172.21.15.150:0/2501240477 conn(0x7f9098102e80 msgr2=0x7f90981052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.382+0000 7f909fc00640 1 -- 172.21.15.150:0/2501240477 shutdown_connections 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.383+0000 7f909fc00640 1 -- 172.21.15.150:0/2501240477 wait complete. 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.383+0000 7f909fc00640 1 Processor -- start 2024-09-15T22:02:50.197 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909fc00640 1 -- start start 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909fc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f909807db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909fc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f909810bc60 con 0x7f90981076b0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f909807db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f909807db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50396/0 (socket says 172.21.15.150:50396) 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909d200640 1 -- 172.21.15.150:0/2527080940 learned_addr learned my addr 172.21.15.150:0/2527080940 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.384+0000 7f909d200640 1 -- 172.21.15.150:0/2527080940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909807e0d0 con 0x7f90981076b0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.385+0000 7f909d200640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f909807db90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f908c0097f0 tx=0x7f908c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.385+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c037040 con 0x7f90981076b0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.385+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f908c030cc0 con 0x7f90981076b0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.385+0000 7f909fc00640 1 -- 172.21.15.150:0/2527080940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909807c2c0 con 0x7f90981076b0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.385+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f908c03a640 con 0x7f90981076b0 2024-09-15T22:02:50.198 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.385+0000 7f909fc00640 1 -- 172.21.15.150:0/2527080940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909807c800 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.386+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f908c03b3f0 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.386+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9074005290 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.387+0000 7f9095600640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9080039260 0x7f908003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.387+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f908c06c9e0 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.387+0000 7f9097e00640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9080039260 0x7f908003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.388+0000 7f9097e00640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9080039260 0x7f908003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f90840098c0 tx=0x7f9084006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.392+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f908c0313a0 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.566+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f9074005580 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.567+0000 7f9095600640 1 -- 172.21.15.150:0/2527080940 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f908c038250 con 0x7f90981076b0 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9080039260 msgr2=0x7f908003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9080039260 0x7f908003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f90840098c0 tx=0x7f9084006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 msgr2=0x7f909807db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f909807db90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f908c0097f0 tx=0x7f908c0327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 shutdown_connections 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9080039260 0x7f908003b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 --2- 172.21.15.150:0/2527080940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90981076b0 0x7f909807db90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 >> 172.21.15.150:0/2527080940 conn(0x7f9098102e80 msgr2=0x7f9098103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 shutdown_connections 2024-09-15T22:02:50.200 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:49.569+0000 7f908aa00640 1 -- 172.21.15.150:0/2527080940 wait complete. 2024-09-15T22:02:50.211 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:02:50.211 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout disabled 2024-09-15T22:02:50.224 INFO:teuthology.orchestra.run.smithi150.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:02:50.224 INFO:teuthology.orchestra.run.smithi150.stdout:systemctl: stdout inactive 2024-09-15T22:02:50.224 INFO:teuthology.orchestra.run.smithi150.stdout:firewalld.service is not enabled 2024-09-15T22:02:50.224 INFO:teuthology.orchestra.run.smithi150.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T22:02:50.227 INFO:teuthology.orchestra.run.smithi150.stdout:Ceph Dashboard is now available at: 2024-09-15T22:02:50.227 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:50.227 INFO:teuthology.orchestra.run.smithi150.stdout: URL: https://smithi150.front.sepia.ceph.com:8443/ 2024-09-15T22:02:50.227 INFO:teuthology.orchestra.run.smithi150.stdout: User: admin 2024-09-15T22:02:50.227 INFO:teuthology.orchestra.run.smithi150.stdout: Password: 19xjsferys 2024-09-15T22:02:50.227 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:50.228 INFO:teuthology.orchestra.run.smithi150.stdout:Saving cluster configuration to /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config directory 2024-09-15T22:02:50.779 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:50 smithi150 ceph-mon[30886]: mgrmap e13: x(active, since 6s) 2024-09-15T22:02:51.712 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.777+0000 7f651e400640 1 Processor -- start 2024-09-15T22:02:51.712 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.777+0000 7f651e400640 1 -- start start 2024-09-15T22:02:51.712 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.778+0000 7f651e400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651810af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:51.712 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.778+0000 7f651e400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f651810b530 con 0x7f651810ab60 2024-09-15T22:02:51.712 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.778+0000 7f651d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651810af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.778+0000 7f651d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651810af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54676/0 (socket says 172.21.15.150:54676) 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.778+0000 7f651d000640 1 -- 172.21.15.150:0/3061639729 learned_addr learned my addr 172.21.15.150:0/3061639729 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.779+0000 7f651d000640 1 -- 172.21.15.150:0/3061639729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651810b6b0 con 0x7f651810ab60 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.779+0000 7f651d000640 1 --2- 172.21.15.150:0/3061639729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651810af60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f650c009820 tx=0x7f650c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3536ae025f9621 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f6517400640 1 -- 172.21.15.150:0/3061639729 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c037070 con 0x7f651810ab60 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f6517400640 1 -- 172.21.15.150:0/3061639729 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f650c032920 con 0x7f651810ab60 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f6517400640 1 -- 172.21.15.150:0/3061639729 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c030810 con 0x7f651810ab60 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f651e400640 1 -- 172.21.15.150:0/3061639729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 msgr2=0x7f651810af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f651e400640 1 --2- 172.21.15.150:0/3061639729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651810af60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f650c009820 tx=0x7f650c02a270 comp rx=0 tx=0).stop 2024-09-15T22:02:51.713 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f651e400640 1 -- 172.21.15.150:0/3061639729 shutdown_connections 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.780+0000 7f651e400640 1 --2- 172.21.15.150:0/3061639729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651810af60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.781+0000 7f651e400640 1 -- 172.21.15.150:0/3061639729 >> 172.21.15.150:0/3061639729 conn(0x7f651807cce0 msgr2=0x7f651807d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.781+0000 7f651e400640 1 -- 172.21.15.150:0/3061639729 shutdown_connections 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.781+0000 7f651e400640 1 -- 172.21.15.150:0/3061639729 wait complete. 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.781+0000 7f651e400640 1 Processor -- start 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651e400640 1 -- start start 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651e400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651e400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f651810dbc0 con 0x7f651810ab60 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651819d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54680/0 (socket says 172.21.15.150:54680) 2024-09-15T22:02:51.714 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651d000640 1 -- 172.21.15.150:0/3524668723 learned_addr learned my addr 172.21.15.150:0/3524668723 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.782+0000 7f651d000640 1 -- 172.21.15.150:0/3524668723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651819dc20 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.783+0000 7f651d000640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651819d6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f650c0097f0 tx=0x7f650c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.783+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c037040 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.783+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f650c030c40 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.783+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f650c03a5d0 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.783+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651819deb0 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.783+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65181a0ba0 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.784+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f650c03b3f0 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.784+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651810dd40 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.785+0000 7f6515600640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6500039300 0x7f650003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.785+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f650c06c9d0 con 0x7f651810ab60 2024-09-15T22:02:51.715 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.785+0000 7f6517e00640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6500039300 0x7f650003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.786+0000 7f6517e00640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6500039300 0x7f650003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f65040098c0 tx=0x7f6504006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:50.790+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f650c041510 con 0x7f651810ab60 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.048+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f65181a0d70 con 0x7f651810ab60 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.051+0000 7f6515600640 1 -- 172.21.15.150:0/3524668723 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f650c0412b0 con 0x7f651810ab60 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6500039300 msgr2=0x7f650003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6500039300 0x7f650003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f65040098c0 tx=0x7f6504006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 msgr2=0x7f651819d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:51.716 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651819d6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f650c0097f0 tx=0x7f650c0327b0 comp rx=0 tx=0).stop 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 shutdown_connections 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6500039300 0x7f650003b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 --2- 172.21.15.150:0/3524668723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f651810ab60 0x7f651819d6e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 >> 172.21.15.150:0/3524668723 conn(0x7f651807cce0 msgr2=0x7f6518107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 shutdown_connections 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/bin/ceph: stderr 2024-09-15T22:02:51.053+0000 7f651e400640 1 -- 172.21.15.150:0/3524668723 wait complete. 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T22:02:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: ceph telemetry on 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout:For more information see: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:02:51.718 INFO:teuthology.orchestra.run.smithi150.stdout:Bootstrap complete. 2024-09-15T22:02:51.767 INFO:tasks.cephadm:Fetching config... 2024-09-15T22:02:51.768 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:02:51.768 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T22:02:51.804 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T22:02:51.804 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:02:51.804 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T22:02:51.882 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T22:02:51.883 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:02:51.883 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T22:02:51.980 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T22:02:51.980 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:02:51.980 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T22:02:52.057 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T22:02:52.057 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:02:52.177 INFO:teuthology.orchestra.run.smithi150.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:02:52.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:02:52.244 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:02:52.256 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:02:52.257 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:52 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3524668723' entity='client.admin' 2024-09-15T22:02:52.298 INFO:teuthology.orchestra.run.smithi169.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2dFFQLDwcohbyZYbbC7yZai1Ojv0+VG8nUb4In54tHvmRNTH9Iyl8Of9itqxIWq/YjKOHrj3JXAdSvp34pEwOxgX2RIDtcxDDgwt50oKeu0x0BxrliSRIIiUrDUWwYX05vrnWrkWxgL6roLekOCBzElnPkiEGE/5g3iQKZnE1isPE2WOULqzWnU3dNNMvSfCpFYlrtUCOmiKcaFSOZ/yY87XxPPLZC4FLOSsqtqgx5Ic/LYsJkl5mFFIL2gV/xp+W5xLwgs3lnP+s8HRKreIe5+4V30lo9erC9yZeCglPWF1I8lOFSgq6tP/UN04NaVdRMw5j/oiUYpRhFg3PTfzHY96m/9dPlwPX55OYdiUM0f8J0JUwC5lOKPPdH+BeFu1fGVBOkQ0YLJNtOj2nRcEe25ikRt/IYlpaWgcGhTOxNKbG4QwdSX7Z1o/4h6jXpb2AfGFBhqSeKRS/UW5AFXmxEXPSrPKfAif7w6txpaqQi0+OnN213YKi+hhlXWL4hk= ceph-faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:02:52.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T22:02:52.674 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.179+0000 7f0129600640 1 -- 172.21.15.150:0/2933759786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 msgr2=0x7f0124103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.179+0000 7f0129600640 1 --2- 172.21.15.150:0/2933759786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124103c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0114009880 tx=0x7f011402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.180+0000 7f0129600640 1 -- 172.21.15.150:0/2933759786 shutdown_connections 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.180+0000 7f0129600640 1 --2- 172.21.15.150:0/2933759786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124103c20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.180+0000 7f0129600640 1 -- 172.21.15.150:0/2933759786 >> 172.21.15.150:0/2933759786 conn(0x7f01240feff0 msgr2=0x7f0124101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.180+0000 7f0129600640 1 -- 172.21.15.150:0/2933759786 shutdown_connections 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.180+0000 7f0129600640 1 -- 172.21.15.150:0/2933759786 wait complete. 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.181+0000 7f0129600640 1 Processor -- start 2024-09-15T22:02:53.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.181+0000 7f0129600640 1 -- start start 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.181+0000 7f0129600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.181+0000 7f0129600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0124109930 con 0x7f0124103820 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.181+0000 7f0122a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.181+0000 7f0122a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54698/0 (socket says 172.21.15.150:54698) 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f0122a00640 1 -- 172.21.15.150:0/616473443 learned_addr learned my addr 172.21.15.150:0/616473443 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f0122a00640 1 -- 172.21.15.150:0/616473443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241994c0 con 0x7f0124103820 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f0122a00640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0114004f60 tx=0x7f01140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f011403f070 con 0x7f0124103820 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0114004d40 con 0x7f0124103820 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0114035030 con 0x7f0124103820 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.182+0000 7f0129600640 1 -- 172.21.15.150:0/616473443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0124199750 con 0x7f0124103820 2024-09-15T22:02:53.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.183+0000 7f0129600640 1 -- 172.21.15.150:0/616473443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012419c440 con 0x7f0124103820 2024-09-15T22:02:53.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.184+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f0114042070 con 0x7f0124103820 2024-09-15T22:02:53.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.184+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012410a0b0 con 0x7f0124103820 2024-09-15T22:02:53.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.184+0000 7f011b400640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01080392a0 0x7f010803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:53.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.184+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f011406d3c0 con 0x7f0124103820 2024-09-15T22:02:53.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.184+0000 7f0122000640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01080392a0 0x7f010803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:53.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.185+0000 7f0122000640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01080392a0 0x7f010803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01100098c0 tx=0x7f0110006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:53.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.190+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f011403a3c0 con 0x7f0124103820 2024-09-15T22:02:53.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.384+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f0124191f60 con 0x7f0124103820 2024-09-15T22:02:53.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.387+0000 7f011b400640 1 -- 172.21.15.150:0/616473443 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f0114040260 con 0x7f0124103820 2024-09-15T22:02:53.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01080392a0 msgr2=0x7f010803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:53.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01080392a0 0x7f010803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01100098c0 tx=0x7f0110006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:53.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 msgr2=0x7f0124198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0114004f60 tx=0x7f01140048f0 comp rx=0 tx=0).stop 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 shutdown_connections 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01080392a0 0x7f010803b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 --2- 172.21.15.150:0/616473443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0124103820 0x7f0124198f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.389+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 >> 172.21.15.150:0/616473443 conn(0x7f01240feff0 msgr2=0x7f01240ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.390+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 shutdown_connections 2024-09-15T22:02:53.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:53.390+0000 7f0118c00640 1 -- 172.21.15.150:0/616473443 wait complete. 2024-09-15T22:02:54.182 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T22:02:54.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T22:02:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:54 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/616473443' entity='client.admin' 2024-09-15T22:02:54.678 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:02:55.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 -- 172.21.15.150:0/4006266459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 msgr2=0x7f298c103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 --2- 172.21.15.150:0/4006266459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c103a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2980009880 tx=0x7f298002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:02:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 -- 172.21.15.150:0/4006266459 shutdown_connections 2024-09-15T22:02:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 --2- 172.21.15.150:0/4006266459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c103a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 -- 172.21.15.150:0/4006266459 >> 172.21.15.150:0/4006266459 conn(0x7f298c0feda0 msgr2=0x7f298c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 -- 172.21.15.150:0/4006266459 shutdown_connections 2024-09-15T22:02:55.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.373+0000 7f2992200640 1 -- 172.21.15.150:0/4006266459 wait complete. 2024-09-15T22:02:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2992200640 1 Processor -- start 2024-09-15T22:02:55.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2992200640 1 -- start start 2024-09-15T22:02:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2992200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2992200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f298c109720 con 0x7f298c103610 2024-09-15T22:02:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2990e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2990e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54726/0 (socket says 172.21.15.150:54726) 2024-09-15T22:02:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.375+0000 7f2990e00640 1 -- 172.21.15.150:0/2711439954 learned_addr learned my addr 172.21.15.150:0/2711439954 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:55.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2990e00640 1 -- 172.21.15.150:0/2711439954 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c1992f0 con 0x7f298c103610 2024-09-15T22:02:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2990e00640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c198db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2980004f60 tx=0x7f29800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f298003f070 con 0x7f298c103610 2024-09-15T22:02:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2980004cc0 con 0x7f298c103610 2024-09-15T22:02:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c199580 con 0x7f298c103610 2024-09-15T22:02:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2980035030 con 0x7f298c103610 2024-09-15T22:02:55.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.376+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c19c230 con 0x7f298c103610 2024-09-15T22:02:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.377+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f2980042070 con 0x7f298c103610 2024-09-15T22:02:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.378+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298c109ea0 con 0x7f298c103610 2024-09-15T22:02:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.378+0000 7f2989600640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2974039300 0x7f297403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.378+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f298006d000 con 0x7f298c103610 2024-09-15T22:02:55.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.378+0000 7f298be00640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2974039300 0x7f297403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:55.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.379+0000 7f298be00640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2974039300 0x7f297403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29780098c0 tx=0x7f2978006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:55.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.383+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2980040260 con 0x7f298c103610 2024-09-15T22:02:55.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.568+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f298c02d8a0 con 0x7f2974039300 2024-09-15T22:02:55.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.572+0000 7f2989600640 1 -- 172.21.15.150:0/2711439954 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f298c02d8a0 con 0x7f2974039300 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2974039300 msgr2=0x7f297403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2974039300 0x7f297403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29780098c0 tx=0x7f2978006db0 comp rx=0 tx=0).stop 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 msgr2=0x7f298c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c198db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2980004f60 tx=0x7f29800048f0 comp rx=0 tx=0).stop 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 shutdown_connections 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2974039300 0x7f297403b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 --2- 172.21.15.150:0/2711439954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298c103610 0x7f298c198db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:55.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 >> 172.21.15.150:0/2711439954 conn(0x7f298c0feda0 msgr2=0x7f298c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:55.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 shutdown_connections 2024-09-15T22:02:55.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:55.575+0000 7f2992200640 1 -- 172.21.15.150:0/2711439954 wait complete. 2024-09-15T22:02:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:55 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:55 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:55 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi150", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:02:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:55 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:55 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:55 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:56.332 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-09-15T22:02:56.333 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:02:56.333 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:02:56.353 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:02:56.353 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:02:56.411 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-09-15T22:02:56.411 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch host add smithi154 2024-09-15T22:02:56.904 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:56.904 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:56.904 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:02:56.904 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:02:56.905 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:02:56.905 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: Updating smithi150:/etc/ceph/ceph.conf 2024-09-15T22:02:56.905 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:56 smithi150 ceph-mon[30886]: Updating smithi150:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:02:57.373 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:02:57.858 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:57 smithi150 ceph-mon[30886]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:02:57.859 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:57 smithi150 ceph-mon[30886]: Updating smithi150:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:02:57.859 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:57.859 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:57.859 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.970+0000 7fd5d4000640 1 -- 172.21.15.150:0/1668309791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 msgr2=0x7fd5cc102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.971+0000 7fd5d4000640 1 --2- 172.21.15.150:0/1668309791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc102b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009880 tx=0x7fd5c002a670 comp rx=0 tx=0).stop 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.971+0000 7fd5d4000640 1 -- 172.21.15.150:0/1668309791 shutdown_connections 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.971+0000 7fd5d4000640 1 --2- 172.21.15.150:0/1668309791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc102b60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.971+0000 7fd5d4000640 1 -- 172.21.15.150:0/1668309791 >> 172.21.15.150:0/1668309791 conn(0x7fd5cc0fc1a0 msgr2=0x7fd5cc0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.971+0000 7fd5d4000640 1 -- 172.21.15.150:0/1668309791 shutdown_connections 2024-09-15T22:02:57.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.971+0000 7fd5d4000640 1 -- 172.21.15.150:0/1668309791 wait complete. 2024-09-15T22:02:57.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.972+0000 7fd5d4000640 1 Processor -- start 2024-09-15T22:02:57.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.972+0000 7fd5d4000640 1 -- start start 2024-09-15T22:02:57.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.972+0000 7fd5d4000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:57.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.972+0000 7fd5d4000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc10bcf0 con 0x7fd5cc102780 2024-09-15T22:02:57.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.972+0000 7fd5d1600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:57.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5d1600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54742/0 (socket says 172.21.15.150:54742) 2024-09-15T22:02:57.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5d1600640 1 -- 172.21.15.150:0/3470444416 learned_addr learned my addr 172.21.15.150:0/3470444416 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:02:57.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5d1600640 1 -- 172.21.15.150:0/3470444416 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc197770 con 0x7fd5cc102780 2024-09-15T22:02:57.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5d1600640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc197230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009230 tx=0x7fd5c0003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:57.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c003f070 con 0x7fd5cc102780 2024-09-15T22:02:57.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c003bd40 con 0x7fd5cc102780 2024-09-15T22:02:57.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc197a00 con 0x7fd5cc102780 2024-09-15T22:02:57.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.973+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5c0035030 con 0x7fd5cc102780 2024-09-15T22:02:57.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.974+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc197e60 con 0x7fd5cc102780 2024-09-15T22:02:57.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.975+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fd5c0042070 con 0x7fd5cc102780 2024-09-15T22:02:57.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.975+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc06a7c0 con 0x7fd5cc102780 2024-09-15T22:02:57.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.975+0000 7fd5ca000640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd5b4039300 0x7fd5b403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:02:57.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.975+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd5c006cc20 con 0x7fd5cc102780 2024-09-15T22:02:57.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.975+0000 7fd5d0c00640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd5b4039300 0x7fd5b403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:02:57.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.976+0000 7fd5d0c00640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd5b4039300 0x7fd5b403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80098c0 tx=0x7fd5b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:02:57.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:57.980+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5c0040260 con 0x7fd5cc102780 2024-09-15T22:02:58.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:02:58.160+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) -- 0x7fd5cc198590 con 0x7fd5b4039300 2024-09-15T22:02:58.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:58 smithi150 ceph-mon[30886]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:02:59.814 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:02:59 smithi150 ceph-mon[30886]: Deploying cephadm binary to smithi154 2024-09-15T22:03:01.394 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.393+0000 7fd5ca000640 1 -- 172.21.15.150:0/3470444416 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd5cc198590 con 0x7fd5b4039300 2024-09-15T22:03:01.395 INFO:teuthology.orchestra.run.smithi150.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-09-15T22:03:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd5b4039300 msgr2=0x7fd5b403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:01.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd5b4039300 0x7fd5b403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80098c0 tx=0x7fd5b8006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 msgr2=0x7fd5cc197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc197230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009230 tx=0x7fd5c0003d80 comp rx=0 tx=0).stop 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 shutdown_connections 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd5b4039300 0x7fd5b403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 --2- 172.21.15.150:0/3470444416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc102780 0x7fd5cc197230 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.395+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 >> 172.21.15.150:0/3470444416 conn(0x7fd5cc0fc1a0 msgr2=0x7fd5cc105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.396+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 shutdown_connections 2024-09-15T22:03:01.397 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:01.396+0000 7fd5d4000640 1 -- 172.21.15.150:0/3470444416 wait complete. 2024-09-15T22:03:01.984 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:03:02.343 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:02.648 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:02.648 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:02 smithi150 ceph-mon[30886]: Added host smithi154 2024-09-15T22:03:02.648 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:02.649 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:02.649 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.851+0000 7f5454c00640 1 -- 172.21.15.150:0/4277597954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 msgr2=0x7f5450108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.851+0000 7f5454c00640 1 --2- 172.21.15.150:0/4277597954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f5450108660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5440009880 tx=0x7f544002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.851+0000 7f5454c00640 1 -- 172.21.15.150:0/4277597954 shutdown_connections 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.851+0000 7f5454c00640 1 --2- 172.21.15.150:0/4277597954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f5450108660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.851+0000 7f5454c00640 1 -- 172.21.15.150:0/4277597954 >> 172.21.15.150:0/4277597954 conn(0x7f54500775f0 msgr2=0x7f5450079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.851+0000 7f5454c00640 1 -- 172.21.15.150:0/4277597954 shutdown_connections 2024-09-15T22:03:02.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.852+0000 7f5454c00640 1 -- 172.21.15.150:0/4277597954 wait complete. 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.853+0000 7f5454c00640 1 Processor -- start 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.853+0000 7f5454c00640 1 -- start start 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.853+0000 7f5454c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f545019d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.853+0000 7f5454c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5450112290 con 0x7f5450108280 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.853+0000 7f544de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f545019d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f544de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f545019d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41446/0 (socket says 172.21.15.150:41446) 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f544de00640 1 -- 172.21.15.150:0/2021483016 learned_addr learned my addr 172.21.15.150:0/2021483016 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f544de00640 1 -- 172.21.15.150:0/2021483016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545019dc80 con 0x7f5450108280 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f544de00640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f545019d740 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5440009230 tx=0x7f5440003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f544003f070 con 0x7f5450108280 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545019df70 con 0x7f5450108280 2024-09-15T22:03:02.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f544003bd40 con 0x7f5450108280 2024-09-15T22:03:02.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.854+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5440035030 con 0x7f5450108280 2024-09-15T22:03:02.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.855+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54501a2010 con 0x7f5450108280 2024-09-15T22:03:02.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.856+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f5440042070 con 0x7f5450108280 2024-09-15T22:03:02.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.856+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5450109330 con 0x7f5450108280 2024-09-15T22:03:02.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.856+0000 7f5446a00640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5434039300 0x7f543403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:02.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.856+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f544006cbb0 con 0x7f5450108280 2024-09-15T22:03:02.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.856+0000 7f544d400640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5434039300 0x7f543403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:02.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.857+0000 7f544d400640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5434039300 0x7f543403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f543c0098c0 tx=0x7f543c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:02.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:02.861+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5440044e10 con 0x7f5450108280 2024-09-15T22:03:03.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.040+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54501086e0 con 0x7f5434039300 2024-09-15T22:03:03.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.041+0000 7f5446a00640 1 -- 172.21.15.150:0/2021483016 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f54501086e0 con 0x7f5434039300 2024-09-15T22:03:03.042 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:03:03.042 INFO:teuthology.orchestra.run.smithi150.stdout:[{"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5434039300 msgr2=0x7f543403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5434039300 0x7f543403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f543c0098c0 tx=0x7f543c006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 msgr2=0x7f545019d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f545019d740 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5440009230 tx=0x7f5440003d80 comp rx=0 tx=0).stop 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 shutdown_connections 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5434039300 0x7f543403b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 --2- 172.21.15.150:0/2021483016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5450108280 0x7f545019d740 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 >> 172.21.15.150:0/2021483016 conn(0x7f54500775f0 msgr2=0x7f545010f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 shutdown_connections 2024-09-15T22:03:03.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:03.044+0000 7f5454c00640 1 -- 172.21.15.150:0/2021483016 wait complete. 2024-09-15T22:03:03.774 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi169 2024-09-15T22:03:03.775 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:03:03.775 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:03:03.795 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:03:03.795 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:03.854 INFO:tasks.cephadm:Adding host smithi169 to orchestrator... 2024-09-15T22:03:03.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch host add smithi169 2024-09-15T22:03:04.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:04.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:03 smithi150 ceph-mon[30886]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:03:04.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:03 smithi150 ceph-mon[30886]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:04.211 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:04.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.740+0000 7fd40e400640 1 -- 172.21.15.150:0/3426793955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 msgr2=0x7fd408109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:04.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.740+0000 7fd40e400640 1 --2- 172.21.15.150:0/3426793955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408109bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009880 tx=0x7fd3f802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:03:04.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.740+0000 7fd40e400640 1 -- 172.21.15.150:0/3426793955 shutdown_connections 2024-09-15T22:03:04.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.740+0000 7fd40e400640 1 --2- 172.21.15.150:0/3426793955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408109bb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:04.742 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.740+0000 7fd40e400640 1 -- 172.21.15.150:0/3426793955 >> 172.21.15.150:0/3426793955 conn(0x7fd4080ff4b0 msgr2=0x7fd4081018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:04.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.741+0000 7fd40e400640 1 -- 172.21.15.150:0/3426793955 shutdown_connections 2024-09-15T22:03:04.743 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.741+0000 7fd40e400640 1 -- 172.21.15.150:0/3426793955 wait complete. 2024-09-15T22:03:04.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd40e400640 1 Processor -- start 2024-09-15T22:03:04.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd40e400640 1 -- start start 2024-09-15T22:03:04.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd40e400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:04.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd40e400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd40810de90 con 0x7fd4081097d0 2024-09-15T22:03:04.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd407400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd407400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41472/0 (socket says 172.21.15.150:41472) 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.742+0000 7fd407400640 1 -- 172.21.15.150:0/2425985141 learned_addr learned my addr 172.21.15.150:0/2425985141 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.743+0000 7fd407400640 1 -- 172.21.15.150:0/2425985141 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd408199870 con 0x7fd4081097d0 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.743+0000 7fd407400640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408199330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009230 tx=0x7fd3f8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.743+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f803f070 con 0x7fd4081097d0 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.743+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3f803bc80 con 0x7fd4081097d0 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.743+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f8035030 con 0x7fd4081097d0 2024-09-15T22:03:04.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.743+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd408199b60 con 0x7fd4081097d0 2024-09-15T22:03:04.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.744+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40819dc00 con 0x7fd4081097d0 2024-09-15T22:03:04.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.745+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fd3f8042070 con 0x7fd4081097d0 2024-09-15T22:03:04.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.745+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd408104f10 con 0x7fd4081097d0 2024-09-15T22:03:04.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.745+0000 7fd404c00640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3ec039300 0x7fd3ec03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:04.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.745+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd3f806cff0 con 0x7fd4081097d0 2024-09-15T22:03:04.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.745+0000 7fd3fea00640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3ec039300 0x7fd3ec03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:04.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.746+0000 7fd3fea00640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3ec039300 0x7fd3ec03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098c0 tx=0x7fd3f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:04.751 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.750+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3f80372d0 con 0x7fd4081097d0 2024-09-15T22:03:04.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:04.928+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}) -- 0x7fd40819a690 con 0x7fd3ec039300 2024-09-15T22:03:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:06.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:06.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:06.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:03:06.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:06.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:07.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:07 smithi150 ceph-mon[30886]: Deploying cephadm binary to smithi169 2024-09-15T22:03:07.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:07 smithi150 ceph-mon[30886]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-15T22:03:07.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:07 smithi150 ceph-mon[30886]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:07.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:07.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:07.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:08.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.097+0000 7fd404c00640 1 -- 172.21.15.150:0/2425985141 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd40819a690 con 0x7fd3ec039300 2024-09-15T22:03:08.100 INFO:teuthology.orchestra.run.smithi150.stdout:Added host 'smithi169' with addr '172.21.15.169' 2024-09-15T22:03:08.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3ec039300 msgr2=0x7fd3ec03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:08.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3ec039300 0x7fd3ec03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098c0 tx=0x7fd3f0006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:08.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 msgr2=0x7fd408199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:08.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408199330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009230 tx=0x7fd3f8003d40 comp rx=0 tx=0).stop 2024-09-15T22:03:08.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 shutdown_connections 2024-09-15T22:03:08.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3ec039300 0x7fd3ec03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:08.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 --2- 172.21.15.150:0/2425985141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4081097d0 0x7fd408199330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:08.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 >> 172.21.15.150:0/2425985141 conn(0x7fd4080ff4b0 msgr2=0x7fd408100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:08.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 shutdown_connections 2024-09-15T22:03:08.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:08.100+0000 7fd40e400640 1 -- 172.21.15.150:0/2425985141 wait complete. 2024-09-15T22:03:08.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:08 smithi150 ceph-mon[30886]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:08.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:08 smithi150 ceph-mon[30886]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:03:08.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:08 smithi150 ceph-mon[30886]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:08.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:08.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:08.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:03:09.054 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:09.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:09 smithi150 ceph-mon[30886]: Added host smithi169 2024-09-15T22:03:09.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:09.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.580+0000 7f715a200640 1 -- 172.21.15.150:0/2522829513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 msgr2=0x7f7154074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.580+0000 7f715a200640 1 --2- 172.21.15.150:0/2522829513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f7154074970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7144009880 tx=0x7f714402a670 comp rx=0 tx=0).stop 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.581+0000 7f715a200640 1 -- 172.21.15.150:0/2522829513 shutdown_connections 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.581+0000 7f715a200640 1 --2- 172.21.15.150:0/2522829513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f7154074970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.581+0000 7f715a200640 1 -- 172.21.15.150:0/2522829513 >> 172.21.15.150:0/2522829513 conn(0x7f71540fd2b0 msgr2=0x7f71540ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.581+0000 7f715a200640 1 -- 172.21.15.150:0/2522829513 shutdown_connections 2024-09-15T22:03:09.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.581+0000 7f715a200640 1 -- 172.21.15.150:0/2522829513 wait complete. 2024-09-15T22:03:09.584 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f715a200640 1 Processor -- start 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f715a200640 1 -- start start 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f715a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f71541a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f715a200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f71541122f0 con 0x7f7154074590 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f7153400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f71541a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f7153400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f71541a33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41494/0 (socket says 172.21.15.150:41494) 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.582+0000 7f7153400640 1 -- 172.21.15.150:0/2386691208 learned_addr learned my addr 172.21.15.150:0/2386691208 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f7153400640 1 -- 172.21.15.150:0/2386691208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71541a3920 con 0x7f7154074590 2024-09-15T22:03:09.585 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f7153400640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f71541a33e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7144009230 tx=0x7f7144003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:09.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714403f070 con 0x7f7154074590 2024-09-15T22:03:09.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541a3bb0 con 0x7f7154074590 2024-09-15T22:03:09.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f714403bd40 con 0x7f7154074590 2024-09-15T22:03:09.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7144035030 con 0x7f7154074590 2024-09-15T22:03:09.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.583+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715419d5a0 con 0x7f7154074590 2024-09-15T22:03:09.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.584+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f7144042070 con 0x7f7154074590 2024-09-15T22:03:09.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.585+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154075cd0 con 0x7f7154074590 2024-09-15T22:03:09.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.585+0000 7f714be00640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7138039300 0x7f713803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:09.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.585+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f714406cf80 con 0x7f7154074590 2024-09-15T22:03:09.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.585+0000 7f7152a00640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7138039300 0x7f713803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:09.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.586+0000 7f7152a00640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7138039300 0x7f713803b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f71400098c0 tx=0x7f7140006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:09.592 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.590+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7144036df0 con 0x7f7154074590 2024-09-15T22:03:09.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.770+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f715419ead0 con 0x7f7138039300 2024-09-15T22:03:09.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.772+0000 7f714be00640 1 -- 172.21.15.150:0/2386691208 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f715419ead0 con 0x7f7138039300 2024-09-15T22:03:09.774 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:03:09.774 INFO:teuthology.orchestra.run.smithi150.stdout:[{"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}] 2024-09-15T22:03:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7138039300 msgr2=0x7f713803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7138039300 0x7f713803b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f71400098c0 tx=0x7f7140006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 msgr2=0x7f71541a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:09.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f71541a33e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7144009230 tx=0x7f7144003d80 comp rx=0 tx=0).stop 2024-09-15T22:03:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 shutdown_connections 2024-09-15T22:03:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7138039300 0x7f713803b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 --2- 172.21.15.150:0/2386691208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7154074590 0x7f71541a33e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 >> 172.21.15.150:0/2386691208 conn(0x7f71540fd2b0 msgr2=0x7f71540fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 shutdown_connections 2024-09-15T22:03:09.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:09.774+0000 7f715a200640 1 -- 172.21.15.150:0/2386691208 wait complete. 2024-09-15T22:03:10.381 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:10 smithi150 ceph-mon[30886]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:10.381 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:10.417 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T22:03:10.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T22:03:10.773 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:11.168 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:11 smithi150 ceph-mon[30886]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:03:11.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 -- 172.21.15.150:0/401996258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 msgr2=0x7f55601019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:11.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 --2- 172.21.15.150:0/401996258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f55601019e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5550009880 tx=0x7f555002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 -- 172.21.15.150:0/401996258 shutdown_connections 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 --2- 172.21.15.150:0/401996258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f55601019e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 -- 172.21.15.150:0/401996258 >> 172.21.15.150:0/401996258 conn(0x7f55600fd0a0 msgr2=0x7f55600ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 -- 172.21.15.150:0/401996258 shutdown_connections 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.378+0000 7f5565400640 1 -- 172.21.15.150:0/401996258 wait complete. 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f5565400640 1 Processor -- start 2024-09-15T22:03:11.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f5565400640 1 -- start start 2024-09-15T22:03:11.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f5565400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f5560197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:11.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f5565400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f556010ba50 con 0x7f5560101600 2024-09-15T22:03:11.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f555fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f5560197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:11.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f555fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f5560197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35332/0 (socket says 172.21.15.150:35332) 2024-09-15T22:03:11.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.379+0000 7f555fe00640 1 -- 172.21.15.150:0/1054918030 learned_addr learned my addr 172.21.15.150:0/1054918030 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.380+0000 7f555fe00640 1 -- 172.21.15.150:0/1054918030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5560197540 con 0x7f5560101600 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.380+0000 7f555fe00640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f5560197000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5550009230 tx=0x7f5550003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.380+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555003f070 con 0x7f5560101600 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.380+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f555003bc80 con 0x7f5560101600 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.380+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5560197830 con 0x7f5560101600 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.380+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5550035030 con 0x7f5560101600 2024-09-15T22:03:11.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.381+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556019b8d0 con 0x7f5560101600 2024-09-15T22:03:11.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.382+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f5550042070 con 0x7f5560101600 2024-09-15T22:03:11.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.382+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5560102ae0 con 0x7f5560101600 2024-09-15T22:03:11.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.382+0000 7f555d600640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55440392a0 0x7f554403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:11.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.382+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f555006d040 con 0x7f5560101600 2024-09-15T22:03:11.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.382+0000 7f5557e00640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55440392a0 0x7f554403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:11.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.383+0000 7f5557e00640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55440392a0 0x7f554403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55480098c0 tx=0x7f5548006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:11.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.387+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5550031e20 con 0x7f5560101600 2024-09-15T22:03:11.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:11.564+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5560101a60 con 0x7f5560101600 2024-09-15T22:03:12.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.113+0000 7f555d600640 1 -- 172.21.15.150:0/1054918030 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f55500372d0 con 0x7f5560101600 2024-09-15T22:03:12.115 INFO:teuthology.orchestra.run.smithi150.stderr:adjusted tunables profile to default 2024-09-15T22:03:12.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55440392a0 msgr2=0x7f554403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:12.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55440392a0 0x7f554403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55480098c0 tx=0x7f5548006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 msgr2=0x7f5560197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f5560197000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5550009230 tx=0x7f5550003d40 comp rx=0 tx=0).stop 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 shutdown_connections 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55440392a0 0x7f554403b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 --2- 172.21.15.150:0/1054918030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5560101600 0x7f5560197000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.116+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 >> 172.21.15.150:0/1054918030 conn(0x7f55600fd0a0 msgr2=0x7f5560109090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.117+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 shutdown_connections 2024-09-15T22:03:12.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:12.117+0000 7f5565400640 1 -- 172.21.15.150:0/1054918030 wait complete. 2024-09-15T22:03:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:12 smithi150 ceph-mon[30886]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:12 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1054918030' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:03:12.854 INFO:tasks.cephadm:Adding mon.a on smithi150 2024-09-15T22:03:12.936 INFO:tasks.cephadm:Adding mon.b on smithi154 2024-09-15T22:03:12.936 INFO:tasks.cephadm:Adding mon.c on smithi169 2024-09-15T22:03:12.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c' 2024-09-15T22:03:13.185 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:13.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1054918030' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:03:13.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:13.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:13.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:13.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:13.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:13.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:03:13.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:13.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:13.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 -- 172.21.15.169:0/1136177193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 msgr2=0x7fd060106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:13.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 --2- 172.21.15.169:0/1136177193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd060106970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009880 tx=0x7fd05c02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:03:13.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 -- 172.21.15.169:0/1136177193 shutdown_connections 2024-09-15T22:03:13.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 --2- 172.21.15.169:0/1136177193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd060106970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:13.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 -- 172.21.15.169:0/1136177193 >> 172.21.15.169:0/1136177193 conn(0x7fd0600fc1a0 msgr2=0x7fd0600fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:13.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 -- 172.21.15.169:0/1136177193 shutdown_connections 2024-09-15T22:03:13.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 -- 172.21.15.169:0/1136177193 wait complete. 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.569+0000 7fd067f19640 1 Processor -- start 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.570+0000 7fd067f19640 1 -- start start 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.570+0000 7fd067f19640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd0600fc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.570+0000 7fd067f19640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd06010abc0 con 0x7fd060106590 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.570+0000 7fd065cb5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd0600fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.570+0000 7fd065cb5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd0600fc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.169:56990/0 (socket says 172.21.15.169:56990) 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.570+0000 7fd065cb5640 1 -- 172.21.15.169:0/557891634 learned_addr learned my addr 172.21.15.169:0/557891634 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:13.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd065cb5640 1 -- 172.21.15.169:0/557891634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0600fe540 con 0x7fd060106590 2024-09-15T22:03:13.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd065cb5640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd0600fc650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009230 tx=0x7fd05c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:13.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd05c03f070 con 0x7fd060106590 2024-09-15T22:03:13.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd05c03bd40 con 0x7fd060106590 2024-09-15T22:03:13.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0600fcb90 con 0x7fd060106590 2024-09-15T22:03:13.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd05c035030 con 0x7fd060106590 2024-09-15T22:03:13.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.571+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0600fd050 con 0x7fd060106590 2024-09-15T22:03:13.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.572+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fd05c042070 con 0x7fd060106590 2024-09-15T22:03:13.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.572+0000 7fd056ffd640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd04c039300 0x7fd04c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:13.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.572+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd05c06cb40 con 0x7fd060106590 2024-09-15T22:03:13.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.572+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd060101c00 con 0x7fd060106590 2024-09-15T22:03:13.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.573+0000 7fd0654b4640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd04c039300 0x7fd04c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:13.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.573+0000 7fd0654b4640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd04c039300 0x7fd04c03b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0500098c0 tx=0x7fd050006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:13.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.578+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd05c040d50 con 0x7fd060106590 2024-09-15T22:03:13.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.765+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}) -- 0x7fd0600fdc40 con 0x7fd04c039300 2024-09-15T22:03:13.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.772+0000 7fd056ffd640 1 -- 172.21.15.169:0/557891634 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd0600fdc40 con 0x7fd04c039300 2024-09-15T22:03:13.774 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mon update... 2024-09-15T22:03:13.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd04c039300 msgr2=0x7fd04c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:13.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd04c039300 0x7fd04c03b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0500098c0 tx=0x7fd050006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:13.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 msgr2=0x7fd0600fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:13.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd0600fc650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009230 tx=0x7fd05c003d80 comp rx=0 tx=0).stop 2024-09-15T22:03:13.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 shutdown_connections 2024-09-15T22:03:13.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd04c039300 0x7fd04c03b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:13.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 --2- 172.21.15.169:0/557891634 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd060106590 0x7fd0600fc650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:13.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 >> 172.21.15.169:0/557891634 conn(0x7fd0600fc1a0 msgr2=0x7fd060069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:13.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 shutdown_connections 2024-09-15T22:03:13.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:13.775+0000 7fd067f19640 1 -- 172.21.15.169:0/557891634 wait complete. 2024-09-15T22:03:14.356 DEBUG:teuthology.orchestra.run.smithi154:mon.b> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T22:03:14.359 DEBUG:teuthology.orchestra.run.smithi169:mon.c> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T22:03:14.362 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:03:14.362 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:03:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-15T22:03:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:03:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:15.116 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:15.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:15 smithi150 ceph-mon[30886]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:15.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:15 smithi150 ceph-mon[30886]: Saving service mon spec with placement smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c;count:3 2024-09-15T22:03:15.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:15 smithi150 ceph-mon[30886]: Deploying daemon mon.c on smithi169 2024-09-15T22:03:15.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 -- 172.21.15.169:0/3235863481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 msgr2=0x7efce8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:15.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 --2- 172.21.15.169:0/3235863481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce8107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009c20 tx=0x7efcd802aa90 comp rx=0 tx=0).stop 2024-09-15T22:03:15.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 -- 172.21.15.169:0/3235863481 shutdown_connections 2024-09-15T22:03:15.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 --2- 172.21.15.169:0/3235863481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce8107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:15.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 -- 172.21.15.169:0/3235863481 >> 172.21.15.169:0/3235863481 conn(0x7efce80fd2b0 msgr2=0x7efce80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 -- 172.21.15.169:0/3235863481 shutdown_connections 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 -- 172.21.15.169:0/3235863481 wait complete. 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.561+0000 7efcede0f640 1 Processor -- start 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.562+0000 7efcede0f640 1 -- start start 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.562+0000 7efcede0f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.562+0000 7efcede0f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efce810bc70 con 0x7efce8107660 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.562+0000 7efce77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.562+0000 7efce77fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce81970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.169:57008/0 (socket says 172.21.15.169:57008) 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.562+0000 7efce77fe640 1 -- 172.21.15.169:0/1779164940 learned_addr learned my addr 172.21.15.169:0/1779164940 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:15.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efce77fe640 1 -- 172.21.15.169:0/1779164940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce81975e0 con 0x7efce8107660 2024-09-15T22:03:15.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efce77fe640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce81970a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcd8005e30 tx=0x7efcd802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:15.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8047070 con 0x7efce8107660 2024-09-15T22:03:15.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce81978d0 con 0x7efce8107660 2024-09-15T22:03:15.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcd8003df0 con 0x7efce8107660 2024-09-15T22:03:15.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8033050 con 0x7efce8107660 2024-09-15T22:03:15.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.563+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce819b970 con 0x7efce8107660 2024-09-15T22:03:15.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.564+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7efcd804a070 con 0x7efce8107660 2024-09-15T22:03:15.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.564+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce8102d10 con 0x7efce8107660 2024-09-15T22:03:15.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.565+0000 7efce4ff9640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efcd00392a0 0x7efcd003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:15.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.565+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efcd803e030 con 0x7efce8107660 2024-09-15T22:03:15.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.565+0000 7efce6ffd640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efcd00392a0 0x7efcd003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:15.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.566+0000 7efce6ffd640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efcd00392a0 0x7efcd003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098c0 tx=0x7efcdc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:15.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.570+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcd804a360 con 0x7efce8107660 2024-09-15T22:03:15.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.803+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efce8198400 con 0x7efce8107660 2024-09-15T22:03:15.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.804+0000 7efce4ff9640 1 -- 172.21.15.169:0/1779164940 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7efcd8051300 con 0x7efce8107660 2024-09-15T22:03:15.807 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:03:15.807 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","modified":"2024-09-15T22:01:47.047639Z","created":"2024-09-15T22:01:47.047639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T22:03:15.808 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-15T22:03:15.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efcd00392a0 msgr2=0x7efcd003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:15.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efcd00392a0 0x7efcd003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098c0 tx=0x7efcdc006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:15.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 msgr2=0x7efce81970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:15.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce81970a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcd8005e30 tx=0x7efcd802fc10 comp rx=0 tx=0).stop 2024-09-15T22:03:15.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 shutdown_connections 2024-09-15T22:03:15.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efcd00392a0 0x7efcd003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:15.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 --2- 172.21.15.169:0/1779164940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce8107660 0x7efce81970a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:15.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 >> 172.21.15.169:0/1779164940 conn(0x7efce80fd2b0 msgr2=0x7efce80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:15.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 shutdown_connections 2024-09-15T22:03:15.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:15.806+0000 7efcede0f640 1 -- 172.21.15.169:0/1779164940 wait complete. 2024-09-15T22:03:16.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:16 smithi150 ceph-mon[30886]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:16.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:16 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/1779164940' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:17.476 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:03:17.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:03:17.769 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1363155703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 msgr2=0x7f9d2c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 --2- 172.21.15.169:0/1363155703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c102c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009880 tx=0x7f9d1c02a670 comp rx=0 tx=0).stop 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1363155703 shutdown_connections 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 --2- 172.21.15.169:0/1363155703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c102c20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1363155703 >> 172.21.15.169:0/1363155703 conn(0x7f9d2c0fc280 msgr2=0x7f9d2c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1363155703 shutdown_connections 2024-09-15T22:03:18.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.348+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1363155703 wait complete. 2024-09-15T22:03:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.349+0000 7f9d30ac0640 1 Processor -- start 2024-09-15T22:03:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.349+0000 7f9d30ac0640 1 -- start start 2024-09-15T22:03:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.349+0000 7f9d30ac0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c1004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:18.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.349+0000 7f9d30ac0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c10bdb0 con 0x7f9d2c102840 2024-09-15T22:03:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.350+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c1004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:18.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.350+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c1004a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.169:57020/0 (socket says 172.21.15.169:57020) 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.350+0000 7f9d2a59c640 1 -- 172.21.15.169:0/1837501865 learned_addr learned my addr 172.21.15.169:0/1837501865 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.350+0000 7f9d2a59c640 1 -- 172.21.15.169:0/1837501865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c102390 con 0x7f9d2c102840 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.351+0000 7f9d2a59c640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c1004a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009230 tx=0x7f9d1c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.351+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c03f070 con 0x7f9d2c102840 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.351+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c1009e0 con 0x7f9d2c102840 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.351+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1c03bc80 con 0x7f9d2c102840 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.351+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c100ea0 con 0x7f9d2c102840 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.351+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c035030 con 0x7f9d2c102840 2024-09-15T22:03:18.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.352+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c06a4f0 con 0x7f9d2c102840 2024-09-15T22:03:18.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.352+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f9d1c042070 con 0x7f9d2c102840 2024-09-15T22:03:18.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.352+0000 7f9d1b7fe640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9d14039300 0x7f9d1403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:18.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.352+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9d1c06cf70 con 0x7f9d2c102840 2024-09-15T22:03:18.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.353+0000 7f9d29d9b640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9d14039300 0x7f9d1403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:18.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.353+0000 7f9d29d9b640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9d14039300 0x7f9d1403b7c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9d200098c0 tx=0x7f9d20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:18.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.358+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d1c0314c0 con 0x7f9d2c102840 2024-09-15T22:03:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:18 smithi150 ceph-mon[30886]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.608+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9d2c1019d0 con 0x7f9d2c102840 2024-09-15T22:03:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.609+0000 7f9d1b7fe640 1 -- 172.21.15.169:0/1837501865 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f9d1c040d20 con 0x7f9d2c102840 2024-09-15T22:03:18.611 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:03:18.611 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","modified":"2024-09-15T22:01:47.047639Z","created":"2024-09-15T22:01:47.047639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T22:03:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9d14039300 msgr2=0x7f9d1403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9d14039300 0x7f9d1403b7c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9d200098c0 tx=0x7f9d20006db0 comp rx=0 tx=0).stop 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 msgr2=0x7f9d2c1004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c1004a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009230 tx=0x7f9d1c003d40 comp rx=0 tx=0).stop 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 shutdown_connections 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9d14039300 0x7f9d1403b7c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 --2- 172.21.15.169:0/1837501865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d2c102840 0x7f9d2c1004a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.611+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 >> 172.21.15.169:0/1837501865 conn(0x7f9d2c0fc280 msgr2=0x7f9d2c105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.612+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 shutdown_connections 2024-09-15T22:03:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:18.612+0000 7f9d30ac0640 1 -- 172.21.15.169:0/1837501865 wait complete. 2024-09-15T22:03:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:19 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/1837501865' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:19.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:19 smithi169 systemd[1]: Started Ceph mon.c for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:03:20.158 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:03:20.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:03:20.412 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:03:24.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:03:24.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: mon.a calling monitor election 2024-09-15T22:03:24.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:24.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: mon.c calling monitor election 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: monmap epoch 2 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: last_changed 2024-09-15T22:03:19.596820+0000 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: min_mon_release 19 (squid) 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: election_strategy: 1 2024-09-15T22:03:24.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: fsmap 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: mgrmap e13: x(active, since 41s) 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: overall HEALTH_OK 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:24.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: mon.a calling monitor election 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: mon.c calling monitor election 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: monmap epoch 2 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: last_changed 2024-09-15T22:03:19.596820+0000 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: min_mon_release 19 (squid) 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: election_strategy: 1 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:24.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: fsmap 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: mgrmap e13: x(active, since 41s) 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: overall HEALTH_OK 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:24.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 -- 172.21.15.169:0/960798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe76c005740 msgr2=0x7fe76c007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 --2- 172.21.15.169:0/960798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe76c005740 0x7fe76c007bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7801016c0 tx=0x7fe77c02c490 comp rx=0 tx=0).stop 2024-09-15T22:03:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 -- 172.21.15.169:0/960798905 shutdown_connections 2024-09-15T22:03:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 --2- 172.21.15.169:0/960798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe76c005740 0x7fe76c007bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 -- 172.21.15.169:0/960798905 >> 172.21.15.169:0/960798905 conn(0x7fe7800fc280 msgr2=0x7fe7800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 -- 172.21.15.169:0/960798905 shutdown_connections 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.252+0000 7fe78773a640 1 -- 172.21.15.169:0/960798905 wait complete. 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe78773a640 1 Processor -- start 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe78773a640 1 -- start start 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe78773a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe78773a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7801955f0 0x7fe780199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe78773a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801075c0 con 0x7fe7801955f0 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe78773a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe780107440 con 0x7fe76c005740 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe7854d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe7854d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:32890/0 (socket says 172.21.15.169:32890) 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe7854d6640 1 -- 172.21.15.169:0/3052765695 learned_addr learned my addr 172.21.15.169:0/3052765695 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:25.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe7854d6640 1 -- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 msgr2=0x7fe7801950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe7854d6640 1 -- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 msgr2=0x7fe7801950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.253+0000 7fe7854d6640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe7854d6640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe784cd5640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7801955f0 0x7fe780199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe784cd5640 1 -- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 msgr2=0x7fe7801950b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe784cd5640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe784cd5640 1 -- 172.21.15.169:0/3052765695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe780195c10 con 0x7fe7801955f0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe784cd5640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7801955f0 0x7fe780199980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe77000b3d0 tx=0x7fe77000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.254+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe770011630 con 0x7fe7801955f0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.255+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe780199ec0 con 0x7fe7801955f0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.255+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe770011cb0 con 0x7fe7801955f0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.255+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe770010df0 con 0x7fe7801955f0 2024-09-15T22:03:25.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.255+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78019a480 con 0x7fe7801955f0 2024-09-15T22:03:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.256+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fe770018020 con 0x7fe7801955f0 2024-09-15T22:03:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.256+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78019a790 con 0x7fe7801955f0 2024-09-15T22:03:25.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.256+0000 7fe7767fc640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe764039040 0x7fe76403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:25.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.256+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe77004bef0 con 0x7fe7801955f0 2024-09-15T22:03:25.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.256+0000 7fe7854d6640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe764039040 0x7fe76403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:25.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.257+0000 7fe7854d6640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe764039040 0x7fe76403b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe77c012c10 tx=0x7fe77c0323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:25.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.261+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe77001f020 con 0x7fe7801955f0 2024-09-15T22:03:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.498+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe780196470 con 0x7fe7801955f0 2024-09-15T22:03:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.499+0000 7fe7767fc640 1 -- 172.21.15.169:0/3052765695 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7fe770017500 con 0x7fe7801955f0 2024-09-15T22:03:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:03:25.501 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","modified":"2024-09-15T22:03:19.596820Z","created":"2024-09-15T22:01:47.047639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:03:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-15T22:03:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe764039040 msgr2=0x7fe76403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe764039040 0x7fe76403b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe77c012c10 tx=0x7fe77c0323a0 comp rx=0 tx=0).stop 2024-09-15T22:03:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7801955f0 msgr2=0x7fe780199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7801955f0 0x7fe780199980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe77000b3d0 tx=0x7fe77000b890 comp rx=0 tx=0).stop 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 shutdown_connections 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe764039040 0x7fe76403b500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7801955f0 0x7fe780199980 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 --2- 172.21.15.169:0/3052765695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe76c005740 0x7fe7801950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.501+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 >> 172.21.15.169:0/3052765695 conn(0x7fe7800fc280 msgr2=0x7fe7800fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.502+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 shutdown_connections 2024-09-15T22:03:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:25.502+0000 7fe78773a640 1 -- 172.21.15.169:0/3052765695 wait complete. 2024-09-15T22:03:25.796 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:25 smithi169 ceph-mon[35850]: Deploying daemon mon.b on smithi154 2024-09-15T22:03:25.796 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:25 smithi169 ceph-mon[35850]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:25.796 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:25 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/3052765695' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:25.796 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:26.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:25 smithi150 ceph-mon[30886]: Deploying daemon mon.b on smithi154 2024-09-15T22:03:26.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:25 smithi150 ceph-mon[30886]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:26.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:25 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/3052765695' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:26.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:26.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:03:26 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:03:26.597+0000 7ff586000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:03:27.101 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:03:27.101 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:03:27.357 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:03:27.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 -- 172.21.15.169:0/3780139809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18102820 msgr2=0x7f4b18102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:27.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/3780139809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18102820 0x7f4b18102c00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009880 tx=0x7f4b0802a670 comp rx=0 tx=0).stop 2024-09-15T22:03:27.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 -- 172.21.15.169:0/3780139809 shutdown_connections 2024-09-15T22:03:27.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/3780139809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18102820 0x7f4b18102c00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:27.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 -- 172.21.15.169:0/3780139809 >> 172.21.15.169:0/3780139809 conn(0x7f4b180fc220 msgr2=0x7f4b180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:27.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 -- 172.21.15.169:0/3780139809 shutdown_connections 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.787+0000 7f4b1cb23640 1 -- 172.21.15.169:0/3780139809 wait complete. 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1cb23640 1 Processor -- start 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1cb23640 1 -- start start 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1cb23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1cb23640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18197970 0x7f4b1819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1cb23640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1810bd70 con 0x7f4b18197970 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1cb23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1810bbf0 con 0x7f4b18102820 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.788+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:32894/0 (socket says 172.21.15.169:32894) 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b1659c640 1 -- 172.21.15.169:0/2884767081 learned_addr learned my addr 172.21.15.169:0/2884767081 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b15d9b640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18197970 0x7f4b1819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:27.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b1659c640 1 -- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 msgr2=0x7f4b18197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:03:27.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b1659c640 1 -- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 msgr2=0x7f4b18197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:03:27.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b1659c640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:03:27.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b1659c640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:03:27.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b15d9b640 1 -- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 msgr2=0x7f4b18197430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:03:27.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b15d9b640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:27.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b15d9b640 1 -- 172.21.15.169:0/2884767081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b18197f90 con 0x7f4b18197970 2024-09-15T22:03:27.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b15d9b640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18197970 0x7f4b1819bd00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00b3d0 tx=0x7f4b0c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:27.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.789+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4b0c011630 con 0x7f4b18197970 2024-09-15T22:03:27.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.790+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1819c240 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.790+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0c011cb0 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.790+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f4b0c010df0 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.790+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1819c780 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.790+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f4b0c018020 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.790+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1806ad10 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.791+0000 7f4b077fe640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b00039040 0x7f4b0003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.791+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4b0c04bf90 con 0x7f4b18197970 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.791+0000 7f4b1659c640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b00039040 0x7f4b0003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:27.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.792+0000 7f4b1659c640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b00039040 0x7f4b0003b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4b080096c0 tx=0x7f4b08005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:27.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:27.796+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b0c01f020 con 0x7f4b18197970 2024-09-15T22:03:28.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.027+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4b1819ca90 con 0x7f4b18197970 2024-09-15T22:03:28.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.028+0000 7f4b077fe640 1 -- 172.21.15.169:0/2884767081 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f4b0c017500 con 0x7f4b18197970 2024-09-15T22:03:28.030 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:03:28.030 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","modified":"2024-09-15T22:03:19.596820Z","created":"2024-09-15T22:01:47.047639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:03:28.030 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b00039040 msgr2=0x7f4b0003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b00039040 0x7f4b0003b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4b080096c0 tx=0x7f4b08005a40 comp rx=0 tx=0).stop 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18197970 msgr2=0x7f4b1819bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18197970 0x7f4b1819bd00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00b3d0 tx=0x7f4b0c00b890 comp rx=0 tx=0).stop 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 shutdown_connections 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b00039040 0x7f4b0003b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b18197970 0x7f4b1819bd00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 --2- 172.21.15.169:0/2884767081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b18102820 0x7f4b18197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 >> 172.21.15.169:0/2884767081 conn(0x7f4b180fc220 msgr2=0x7f4b181055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:28.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 shutdown_connections 2024-09-15T22:03:28.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:28.030+0000 7f4b1cb23640 1 -- 172.21.15.169:0/2884767081 wait complete. 2024-09-15T22:03:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:28 smithi150 ceph-mon[30886]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:28 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/2884767081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 podman[34834]: 2024-09-15 22:03:28.433881447 +0000 UTC m=+0.368131025 container init 95a0988015cdad3cb89740d83b7a499183866ca27f6431974f5c8843cc10aa7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T22:03:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:28 smithi169 ceph-mon[35850]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:28 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/2884767081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 podman[34834]: 2024-09-15 22:03:28.4371925 +0000 UTC m=+0.371442084 container start 95a0988015cdad3cb89740d83b7a499183866ca27f6431974f5c8843cc10aa7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pidfile_write: ignore empty --pid-file 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: load: jerasure load: lrc 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Git sha 0 2024-09-15T22:03:28.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: DB SUMMARY 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: DB Session ID: XHBEC79YNFZO5EVJKN6Z 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:03:28.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:03:28.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.env: 0x560d25e00940 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.info_log: 0x560d26a056e0 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.statistics: (nil) 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.use_fsync: 0 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:03:28.775 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.db_log_dir: 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.wal_dir: 2024-09-15T22:03:28.776 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.write_buffer_manager: 0x560d26a14dc0 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:03:28.777 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.unordered_write: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.row_cache: None 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.wal_filter: None 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:03:28.778 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:03:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.wal_compression: 0 2024-09-15T22:03:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:03:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:03:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:03:28.779 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:03:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:03:28.782 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_open_files: -1 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Compression algorithms supported: 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kZSTD supported: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:03:28.783 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.merge_operator: 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_filter: None 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:03:28.784 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560d26a05320) 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_type: 0 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: data_block_index_type: 0 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_shortening: 1 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: checksum: 4 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: no_block_cache: 0 2024-09-15T22:03:28.785 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache: 0x560d269f91f0 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_options: 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: capacity : 536870912 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: num_shard_bits : 4 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: strict_capacity_limit : 0 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_cache_compressed: (nil) 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: persistent_cache: (nil) 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_size: 4096 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_size_deviation: 10 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_restart_interval: 16 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: index_block_restart_interval: 1 2024-09-15T22:03:28.786 INFO:journalctl@ceph.mon.b.smithi154.stdout: metadata_block_size: 4096 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: partition_filters: 0 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: use_delta_encoding: 1 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: filter_policy: bloomfilter 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: whole_key_filtering: 1 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: verify_compression: 0 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: format_version: 5 2024-09-15T22:03:28.787 INFO:journalctl@ceph.mon.b.smithi154.stdout: enable_index_compression: 1 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout: block_align: 0 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout: max_auto_readahead_size: 262144 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout: prepopulate_block_cache: 0 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression: NoCompression 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:03:28.788 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.num_levels: 7 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:03:28.789 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:03:28.790 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:03:28.791 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:03:28.792 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:03:28.793 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.ttl: 2592000 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:03:28.794 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 71cf8036-13ad-44ae-a6ee-1cdf5e447fa2 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437808465026, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437808465573, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726437808, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "71cf8036-13ad-44ae-a6ee-1cdf5e447fa2", "db_session_id": "XHBEC79YNFZO5EVJKN6Z", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437808465699, "job": 1, "event": "recovery_finished"} 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:03:28.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560d26a26e00 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: DB pointer 0x560d26b22000 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** DB Stats ** 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:03:28.796 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** Compaction Stats [default] ** 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-15T22:03:28.797 INFO:journalctl@ceph.mon.b.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Block cache BinnedLRUCache@0x560d269f91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-15T22:03:28.798 INFO:journalctl@ceph.mon.b.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: starting mon.b rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(???) e0 preinit fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).mds e1 new map 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: e1 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: btime 2024-09-15T22:01:51:172800+0000 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:03:28.799 INFO:journalctl@ceph.mon.b.smithi154.stdout: legacy client fscid: -1 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout: 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout: No filesystems configured 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:03:28.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:28.801 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Deploying cephadm binary to smithi169 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Added host smithi169 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.802 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1054918030' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1054918030' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:28.803 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:28.804 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Saving service mon spec with placement smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c;count:3 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Deploying daemon mon.c on smithi169 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/1779164940' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/1837501865' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.a calling monitor election 2024-09-15T22:03:28.805 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.c calling monitor election 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: monmap epoch 2 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: last_changed 2024-09-15T22:03:19.596820+0000 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:28.806 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: min_mon_release 19 (squid) 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: election_strategy: 1 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: fsmap 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mgrmap e13: x(active, since 41s) 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: overall HEALTH_OK 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: Deploying daemon mon.b on smithi154 2024-09-15T22:03:28.807 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/3052765695' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/2884767081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 ceph-mon[34853]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 bash[34834]: 95a0988015cdad3cb89740d83b7a499183866ca27f6431974f5c8843cc10aa7c 2024-09-15T22:03:28.808 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:28 smithi154 systemd[1]: Started Ceph mon.b for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:03:29.674 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:03:29.674 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:03:29.925 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:03:33.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.535+0000 7f93a328d640 1 -- 172.21.15.169:0/2976767830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9388003530 msgr2=0x7f93880059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:33.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.535+0000 7f93a328d640 1 --2- 172.21.15.169:0/2976767830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9388003530 0x7f93880059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f939c06a240 tx=0x7f939802c150 comp rx=0 tx=0).stop 2024-09-15T22:03:33.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.536+0000 7f93a328d640 1 -- 172.21.15.169:0/2976767830 shutdown_connections 2024-09-15T22:03:33.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.536+0000 7f93a328d640 1 --2- 172.21.15.169:0/2976767830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9388003530 0x7f93880059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.536+0000 7f93a328d640 1 -- 172.21.15.169:0/2976767830 >> 172.21.15.169:0/2976767830 conn(0x7f939c0fc280 msgr2=0x7f939c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:33.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.536+0000 7f93a328d640 1 -- 172.21.15.169:0/2976767830 shutdown_connections 2024-09-15T22:03:33.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.536+0000 7f93a328d640 1 -- 172.21.15.169:0/2976767830 wait complete. 2024-09-15T22:03:33.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.536+0000 7f93a328d640 1 Processor -- start 2024-09-15T22:03:33.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 -- start start 2024-09-15T22:03:33.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 0x7f939c1004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:33.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f939c1a3580 0x7f939c1a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1097a0 con 0x7f939c1a3580 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f939c109620 con 0x7f9388003530 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a328d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f939c109920 con 0x7f939c1009e0 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54892/0 (socket says 172.21.15.169:54892) 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 -- 172.21.15.169:0/2190742411 learned_addr learned my addr 172.21.15.169:0/2190742411 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a182a640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f939c1a3580 0x7f939c1a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 msgr2=0x7f939c100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 msgr2=0x7f939c100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a1029640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 0x7f939c1004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:33.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a0828640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a1029640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 msgr2=0x7f939c1004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a1029640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 msgr2=0x7f939c1004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a1029640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 0x7f939c1004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.537+0000 7f93a1029640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 0x7f939c1004a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a182a640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 msgr2=0x7f939c100e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a182a640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a182a640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 msgr2=0x7f939c1004a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a182a640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 0x7f939c1004a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a182a640 1 -- 172.21.15.169:0/2190742411 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c1a6040 con 0x7f939c1a3580 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a182a640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f939c1a3580 0x7f939c1a5970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f939400bd50 tx=0x7f939400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394019070 con 0x7f939c1a3580 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c1a6330 con 0x7f939c1a3580 2024-09-15T22:03:33.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9394014920 con 0x7f939c1a3580 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394012990 con 0x7f939c1a3580 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.538+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c1a6820 con 0x7f939c1a3580 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.539+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f939401c070 con 0x7f939c1a3580 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.539+0000 7f93927fc640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9380039730 0x7f938003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.539+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f939404c1c0 con 0x7f939c1a3580 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.539+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c10a8d0 con 0x7f939c1a3580 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.540+0000 7f93a1029640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9380039730 0x7f938003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:33.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.540+0000 7f93a1029640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9380039730 0x7f938003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9398005dc0 tx=0x7f9398005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:33.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.545+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9394013c30 con 0x7f939c1a3580 2024-09-15T22:03:33.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.789+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f939c1a6ae0 con 0x7f939c1a3580 2024-09-15T22:03:33.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.789+0000 7f93927fc640 1 -- 172.21.15.169:0/2190742411 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f939401d8d0 con 0x7f939c1a3580 2024-09-15T22:03:33.791 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:03:33.791 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":3,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","modified":"2024-09-15T22:03:28.494750Z","created":"2024-09-15T22:01:47.047639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:03:33.791 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 3 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: mon.a calling monitor election 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: mon.c calling monitor election 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:33.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: monmap epoch 3 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: last_changed 2024-09-15T22:03:28.494750+0000 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: min_mon_release 19 (squid) 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: election_strategy: 1 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: fsmap 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:33.793 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: mgrmap e13: x(active, since 50s) 2024-09-15T22:03:33.794 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: overall HEALTH_OK 2024-09-15T22:03:33.794 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.794 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.794 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.794 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.791+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9380039730 msgr2=0x7f938003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:33.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.791+0000 7f93a328d640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9380039730 0x7f938003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9398005dc0 tx=0x7f9398005d10 comp rx=0 tx=0).stop 2024-09-15T22:03:33.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.791+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f939c1a3580 msgr2=0x7f939c1a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.791+0000 7f93a328d640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f939c1a3580 0x7f939c1a5970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f939400bd50 tx=0x7f939400be40 comp rx=0 tx=0).stop 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 shutdown_connections 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9380039730 0x7f938003bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f939c1a3580 0x7f939c1a5970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f939c1009e0 0x7f939c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 --2- 172.21.15.169:0/2190742411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9388003530 0x7f939c1004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 >> 172.21.15.169:0/2190742411 conn(0x7f939c0fc280 msgr2=0x7f939c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 shutdown_connections 2024-09-15T22:03:33.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:33.792+0000 7f93a328d640 1 -- 172.21.15.169:0/2190742411 wait complete. 2024-09-15T22:03:33.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: mon.a calling monitor election 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: mon.c calling monitor election 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:33.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: monmap epoch 3 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: last_changed 2024-09-15T22:03:28.494750+0000 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: min_mon_release 19 (squid) 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: election_strategy: 1 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: fsmap 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: mgrmap e13: x(active, since 50s) 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: overall HEALTH_OK 2024-09-15T22:03:33.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:33.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:34.378 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T22:03:34.378 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T22:03:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:34 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/2190742411' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:34.749 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:34.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:34.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:34 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/2190742411' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:34.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 -- 172.21.15.150:0/2638377737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 msgr2=0x7f0820109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:35.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 --2- 172.21.15.150:0/2638377737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820109ba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0814009880 tx=0x7f081402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 -- 172.21.15.150:0/2638377737 shutdown_connections 2024-09-15T22:03:35.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 --2- 172.21.15.150:0/2638377737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820109ba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 -- 172.21.15.150:0/2638377737 >> 172.21.15.150:0/2638377737 conn(0x7f08200ff4e0 msgr2=0x7f0820101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:35.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 -- 172.21.15.150:0/2638377737 shutdown_connections 2024-09-15T22:03:35.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.318+0000 7f0827800640 1 -- 172.21.15.150:0/2638377737 wait complete. 2024-09-15T22:03:35.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.319+0000 7f0827800640 1 Processor -- start 2024-09-15T22:03:35.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.319+0000 7f0827800640 1 -- start start 2024-09-15T22:03:35.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0827800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:35.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0827800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 0x7f082019de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:35.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0827800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f082019e390 0x7f082019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0827800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f082010de20 con 0x7f08201097c0 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0827800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f082010dca0 con 0x7f0820199ac0 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0827800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f082010dfa0 con 0x7f082019e390 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0824e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0824e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:34296/0 (socket says 172.21.15.150:34296) 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0824e00640 1 -- 172.21.15.150:0/3707478259 learned_addr learned my addr 172.21.15.150:0/3707478259 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f0825800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f082019e390 0x7f082019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f081fe00640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 0x7f082019de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f081fe00640 1 -- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 msgr2=0x7f082019de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f081fe00640 1 -- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 msgr2=0x7f082019de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f081fe00640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 0x7f082019de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:03:35.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.320+0000 7f081fe00640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 0x7f082019de50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:03:35.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0825800640 1 -- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 msgr2=0x7f082019de50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:03:35.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0825800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 0x7f082019de50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0825800640 1 -- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 msgr2=0x7f0820199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:35.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0825800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.324 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0825800640 1 -- 172.21.15.150:0/3707478259 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08201a6100 con 0x7f082019e390 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0825800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f082019e390 0x7f082019e840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f081800bd50 tx=0x7f081800be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818019070 con 0x7f082019e390 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0818014920 con 0x7f082019e390 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08201a6330 con 0x7f082019e390 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.321+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818012990 con 0x7f082019e390 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.322+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201a6840 con 0x7f082019e390 2024-09-15T22:03:35.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.322+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f081801c070 con 0x7f082019e390 2024-09-15T22:03:35.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.323+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0820109c20 con 0x7f082019e390 2024-09-15T22:03:35.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.323+0000 7f081d600640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0808039730 0x7f080803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:35.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.323+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f081804c180 con 0x7f082019e390 2024-09-15T22:03:35.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.323+0000 7f0824e00640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0808039730 0x7f080803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:35.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.324+0000 7f0824e00640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0808039730 0x7f080803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0814009230 tx=0x7f081402aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:35.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.328+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0818013e80 con 0x7f082019e390 2024-09-15T22:03:35.516 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.514+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f08201a6c30 con 0x7f082019e390 2024-09-15T22:03:35.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.515+0000 7f081d600640 1 -- 172.21.15.150:0/3707478259 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f0818013960 con 0x7f082019e390 2024-09-15T22:03:35.517 INFO:teuthology.orchestra.run.smithi150.stdout:# minimal ceph.conf for faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:35.517 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-15T22:03:35.517 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:35.517 INFO:teuthology.orchestra.run.smithi150.stdout: mon_host = [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0808039730 msgr2=0x7f080803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0808039730 0x7f080803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0814009230 tx=0x7f081402aad0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f082019e390 msgr2=0x7f082019e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f082019e390 0x7f082019e840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f081800bd50 tx=0x7f081800be40 comp rx=0 tx=0).stop 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 shutdown_connections 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f082019e390 0x7f082019e840 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0820199ac0 0x7f082019de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0808039730 0x7f080803bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 --2- 172.21.15.150:0/3707478259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08201097c0 0x7f0820199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:35.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 >> 172.21.15.150:0/3707478259 conn(0x7f08200ff4e0 msgr2=0x7f08201072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:35.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 shutdown_connections 2024-09-15T22:03:35.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:35.518+0000 7f0827800640 1 -- 172.21.15.150:0/3707478259 wait complete. 2024-09-15T22:03:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: mon.a calling monitor election 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: mon.c calling monitor election 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:35.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: monmap epoch 3 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: last_changed 2024-09-15T22:03:28.494750+0000 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: min_mon_release 19 (squid) 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: election_strategy: 1 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: fsmap 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:35.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: mgrmap e13: x(active, since 50s) 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: overall HEALTH_OK 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/2190742411' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:03:35.774 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:36.252 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T22:03:36.252 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:03:36.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:03:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: mon.b calling monitor election 2024-09-15T22:03:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: mon.b calling monitor election 2024-09-15T22:03:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: mon.c calling monitor election 2024-09-15T22:03:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: mon.a calling monitor election 2024-09-15T22:03:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: monmap epoch 3 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: last_changed 2024-09-15T22:03:28.494750+0000 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: min_mon_release 19 (squid) 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: election_strategy: 1 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: fsmap 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: mgrmap e13: x(active, since 52s) 2024-09-15T22:03:36.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: overall HEALTH_OK 2024-09-15T22:03:36.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3707478259' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:36.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.310 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:03:36.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:36.408 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:03:36.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:03:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: mon.b calling monitor election 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: mon.b calling monitor election 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: mon.c calling monitor election 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: mon.a calling monitor election 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: monmap epoch 3 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: last_changed 2024-09-15T22:03:28.494750+0000 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: min_mon_release 19 (squid) 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: election_strategy: 1 2024-09-15T22:03:36.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: fsmap 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: mgrmap e13: x(active, since 52s) 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: overall HEALTH_OK 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3707478259' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.436 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:03:36.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:36.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: mon.b calling monitor election 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: mon.b calling monitor election 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: mon.c calling monitor election 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: mon.a calling monitor election 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: monmap epoch 3 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: last_changed 2024-09-15T22:03:28.494750+0000 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: created 2024-09-15T22:01:47.047639+0000 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: min_mon_release 19 (squid) 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: election_strategy: 1 2024-09-15T22:03:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: fsmap 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: mgrmap e13: x(active, since 52s) 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: overall HEALTH_OK 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3707478259' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:36.503 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:03:36.503 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:03:36.530 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:03:36.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:03:36.595 INFO:tasks.cephadm:Adding mgr.x on smithi150 2024-09-15T22:03:36.595 INFO:tasks.cephadm:Adding mgr.y on smithi154 2024-09-15T22:03:36.595 INFO:tasks.cephadm:Adding mgr.z on smithi169 2024-09-15T22:03:36.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi150=x;smithi154=y;smithi169=z' 2024-09-15T22:03:36.871 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:03:37.300 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.300 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: Updating smithi150:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:37.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 -- 172.21.15.169:0/3292165582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23600ff9a0 msgr2=0x7f23600ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 --2- 172.21.15.169:0/3292165582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23600ff9a0 0x7f23600ffda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2350009c20 tx=0x7f235002aa90 comp rx=0 tx=0).stop 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 -- 172.21.15.169:0/3292165582 shutdown_connections 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 --2- 172.21.15.169:0/3292165582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23600ff9a0 0x7f23600ffda0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 -- 172.21.15.169:0/3292165582 >> 172.21.15.169:0/3292165582 conn(0x7f23600fb510 msgr2=0x7f23600fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 -- 172.21.15.169:0/3292165582 shutdown_connections 2024-09-15T22:03:37.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.306+0000 7f23681b7640 1 -- 172.21.15.169:0/3292165582 wait complete. 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 Processor -- start 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 -- start start 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 0x7f2360196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2360197520 0x7f236019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23601979a0 0x7f236019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f23601077c0 con 0x7f23601979a0 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2360107640 con 0x7f2360197520 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f23681b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2360107940 con 0x7f23600ff9a0 2024-09-15T22:03:37.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f2365f53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 0x7f2360196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:37.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f2365f53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 0x7f2360196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54898/0 (socket says 172.21.15.169:54898) 2024-09-15T22:03:37.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f2365f53640 1 -- 172.21.15.169:0/513775195 learned_addr learned my addr 172.21.15.169:0/513775195 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:03:37.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f2366754640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23601979a0 0x7f236019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:37.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.307+0000 7f2365752640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2360197520 0x7f236019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:37.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f2365f53640 1 -- 172.21.15.169:0/513775195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2360197520 msgr2=0x7f236019c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f2365f53640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2360197520 0x7f236019c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f2365f53640 1 -- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23601979a0 msgr2=0x7f236019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f2365f53640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23601979a0 0x7f236019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f2365f53640 1 -- 172.21.15.169:0/513775195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236019f3e0 con 0x7f23600ff9a0 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f2365f53640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 0x7f2360196fe0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2350005cc0 tx=0x7f2350003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350047070 con 0x7f23600ff9a0 2024-09-15T22:03:37.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f235002fb50 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350033050 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2360100770 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.308+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2360100cd0 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.309+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f235004a070 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.309+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2360190580 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.309+0000 7f235effd640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2348039730 0x7f234803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.309+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f235006d870 con 0x7f23600ff9a0 2024-09-15T22:03:37.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.309+0000 7f2365752640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2348039730 0x7f234803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:37.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.310+0000 7f2365752640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2348039730 0x7f234803bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2360198500 tx=0x7f2354009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:37.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.314+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f235004bce0 con 0x7f23600ff9a0 2024-09-15T22:03:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: Updating smithi150:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:37.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.490+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=x;smithi154=y;smithi169=z", "target": ["mon-mgr", ""]}) -- 0x7f2360062630 con 0x7f2348039730 2024-09-15T22:03:37.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.497+0000 7f235effd640 1 -- 172.21.15.169:0/513775195 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2360062630 con 0x7f2348039730 2024-09-15T22:03:37.499 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mgr update... 2024-09-15T22:03:37.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2348039730 msgr2=0x7f234803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:37.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2348039730 0x7f234803bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2360198500 tx=0x7f2354009190 comp rx=0 tx=0).stop 2024-09-15T22:03:37.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 msgr2=0x7f2360196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:37.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 0x7f2360196fe0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2350005cc0 tx=0x7f2350003f10 comp rx=0 tx=0).stop 2024-09-15T22:03:37.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 shutdown_connections 2024-09-15T22:03:37.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2348039730 0x7f234803bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23601979a0 0x7f236019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2360197520 0x7f236019c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 --2- 172.21.15.169:0/513775195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23600ff9a0 0x7f2360196fe0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:37.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 >> 172.21.15.169:0/513775195 conn(0x7f23600fb510 msgr2=0x7f23600fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:37.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 shutdown_connections 2024-09-15T22:03:37.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:03:37.499+0000 7f23681b7640 1 -- 172.21.15.169:0/513775195 wait complete. 2024-09-15T22:03:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: Updating smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: Updating smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: Updating smithi150:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:37.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:37.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:37.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:03:38.140 DEBUG:teuthology.orchestra.run.smithi154:mgr.y> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T22:03:38.143 DEBUG:teuthology.orchestra.run.smithi169:mgr.z> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T22:03:38.145 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T22:03:38.145 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:03:38.145 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:03:38.182 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:03:38.183 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-15T22:03:38.260 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:03:38.260 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:38.260 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-15T22:03:38.260 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:38.260 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:38.260 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-15 22:02:56.223165497 +0000 2024-09-15T22:03:38.261 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-15 21:58:40.939510003 +0000 2024-09-15T22:03:38.261 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-15 21:58:40.940509984 +0000 2024-09-15T22:03:38.261 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-15 21:58:40.939510003 +0000 2024-09-15T22:03:38.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:03:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-15T22:03:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-15T22:03:38.357 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000284973 s, 1.8 MB/s 2024-09-15T22:03:38.359 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:03:38.396 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-15T22:03:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:03:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: Reconfiguring daemon mon.a on smithi150 2024-09-15T22:03:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:03:38.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: Reconfiguring daemon mon.a on smithi150 2024-09-15T22:03:38.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:38.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:38.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:38.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:38.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.462 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:03:38.462 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:38.462 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-15T22:03:38.462 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:38.462 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:38.463 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-15 22:02:56.275164493 +0000 2024-09-15T22:03:38.463 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-15 21:58:41.391501309 +0000 2024-09-15T22:03:38.464 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-15 21:58:41.391501309 +0000 2024-09-15T22:03:38.464 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-15 21:58:41.391501309 +0000 2024-09-15T22:03:38.464 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:03:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:03:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: Reconfiguring daemon mon.a on smithi150 2024-09-15T22:03:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:38.564 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-15T22:03:38.564 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-15T22:03:38.564 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000346675 s, 1.5 MB/s 2024-09-15T22:03:38.568 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:03:38.606 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-15 22:02:56.334163355 +0000 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-15 21:58:41.875491998 +0000 2024-09-15T22:03:38.681 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-15 21:58:41.875491998 +0000 2024-09-15T22:03:38.682 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-15 21:58:41.875491998 +0000 2024-09-15T22:03:38.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:03:38.778 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-15T22:03:38.778 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-15T22:03:38.778 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000522981 s, 979 kB/s 2024-09-15T22:03:38.780 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:03:38.818 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-15T22:03:38.893 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-15 22:02:56.383162409 +0000 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-15 21:58:42.345482957 +0000 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-15 21:58:42.345482957 +0000 2024-09-15T22:03:38.894 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-15 21:58:42.345482957 +0000 2024-09-15T22:03:38.894 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:03:38.987 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-15T22:03:38.988 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-15T22:03:38.988 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000286204 s, 1.8 MB/s 2024-09-15T22:03:38.990 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:03:39.027 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-15T22:03:39.027 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:03:39.047 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:03:39.047 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-15T22:03:39.106 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:03:39.106 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:39.106 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T22:03:39.106 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:39.106 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:39.106 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-15 22:03:27.892477936 +0000 2024-09-15T22:03:39.107 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-15 21:58:10.157923322 +0000 2024-09-15T22:03:39.107 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-15 21:58:10.157923322 +0000 2024-09-15T22:03:39.107 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-15 21:58:10.157923322 +0000 2024-09-15T22:03:39.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:03:39.174 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-15T22:03:39.174 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-15T22:03:39.174 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000280493 s, 1.8 MB/s 2024-09-15T22:03:39.175 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:03:39.233 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-15T22:03:39.291 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:03:39.291 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:39.291 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-09-15T22:03:39.291 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:39.292 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:39.292 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-15 22:03:27.892477936 +0000 2024-09-15T22:03:39.292 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-15 21:58:10.502913907 +0000 2024-09-15T22:03:39.292 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-15 21:58:10.502913907 +0000 2024-09-15T22:03:39.292 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-15 21:58:10.502913907 +0000 2024-09-15T22:03:39.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:03:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-15T22:03:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-15T22:03:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000226671 s, 2.3 MB/s 2024-09-15T22:03:39.358 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:03:39.416 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-15T22:03:39.435 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:39 smithi150 ceph-mon[30886]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=x;smithi154=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:39.435 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:39 smithi150 ceph-mon[30886]: Saving service mgr spec with placement smithi150=x;smithi154=y;smithi169=z;count:3 2024-09-15T22:03:39.435 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:39 smithi150 ceph-mon[30886]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:03:39.435 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:39 smithi150 ceph-mon[30886]: Reconfiguring daemon mgr.x on smithi150 2024-09-15T22:03:39.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:39 smithi169 ceph-mon[35850]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=x;smithi154=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:39.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:39 smithi169 ceph-mon[35850]: Saving service mgr spec with placement smithi150=x;smithi154=y;smithi169=z;count:3 2024-09-15T22:03:39.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:39 smithi169 ceph-mon[35850]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:03:39.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:39 smithi169 ceph-mon[35850]: Reconfiguring daemon mgr.x on smithi150 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 707 Links: 1 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-15 22:03:27.892477936 +0000 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-15 21:58:10.821905202 +0000 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-15 21:58:10.821905202 +0000 2024-09-15T22:03:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-15 21:58:10.821905202 +0000 2024-09-15T22:03:39.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:03:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:39 smithi154 ceph-mon[34853]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=x;smithi154=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:39 smithi154 ceph-mon[34853]: Saving service mgr spec with placement smithi150=x;smithi154=y;smithi169=z;count:3 2024-09-15T22:03:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:39 smithi154 ceph-mon[34853]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:03:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:39 smithi154 ceph-mon[34853]: Reconfiguring daemon mgr.x on smithi150 2024-09-15T22:03:39.538 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-15T22:03:39.538 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-15T22:03:39.538 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000305688 s, 1.7 MB/s 2024-09-15T22:03:39.539 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:03:39.595 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-15T22:03:39.651 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:03:39.651 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:39.651 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T22:03:39.651 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:39.651 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:39.652 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-15 22:03:27.893477910 +0000 2024-09-15T22:03:39.652 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-15 21:58:11.141896469 +0000 2024-09-15T22:03:39.652 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-15 21:58:11.141896469 +0000 2024-09-15T22:03:39.652 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-15 21:58:11.141896469 +0000 2024-09-15T22:03:39.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:03:39.715 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-15T22:03:39.716 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-15T22:03:39.716 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000237395 s, 2.2 MB/s 2024-09-15T22:03:39.717 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:03:39.774 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T22:03:39.775 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:03:39.794 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:03:39.795 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 22:03:18.509563638 +0000 2024-09-15T22:03:39.854 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 21:58:09.562376667 +0000 2024-09-15T22:03:39.855 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 21:58:09.562376667 +0000 2024-09-15T22:03:39.855 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-15 21:58:09.562376667 +0000 2024-09-15T22:03:39.855 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:03:39.922 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T22:03:39.922 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T22:03:39.922 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000271919 s, 1.9 MB/s 2024-09-15T22:03:39.923 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:03:39.983 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-15T22:03:40.040 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:03:40.040 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:40.040 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T22:03:40.040 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:40.040 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:40.041 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 22:03:18.509563638 +0000 2024-09-15T22:03:40.041 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 21:58:09.892369739 +0000 2024-09-15T22:03:40.041 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 21:58:09.892369739 +0000 2024-09-15T22:03:40.041 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-15 21:58:09.892369739 +0000 2024-09-15T22:03:40.041 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:03:40.106 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T22:03:40.106 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T22:03:40.106 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.00024213 s, 2.1 MB/s 2024-09-15T22:03:40.107 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:03:40.165 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 22:03:18.509563638 +0000 2024-09-15T22:03:40.222 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 21:58:10.210363063 +0000 2024-09-15T22:03:40.223 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 21:58:10.210363063 +0000 2024-09-15T22:03:40.223 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-15 21:58:10.210363063 +0000 2024-09-15T22:03:40.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:03:40.286 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T22:03:40.287 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T22:03:40.287 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000209178 s, 2.4 MB/s 2024-09-15T22:03:40.288 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:03:40.345 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 22:03:18.510563617 +0000 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 21:58:10.558355758 +0000 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 21:58:10.558355758 +0000 2024-09-15T22:03:40.402 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-15 21:58:10.558355758 +0000 2024-09-15T22:03:40.403 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:03:40.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:40 smithi169 ceph-mon[35850]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:40.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:40.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:40.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:40.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:40.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:40.466 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T22:03:40.466 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T22:03:40.466 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000239714 s, 2.1 MB/s 2024-09-15T22:03:40.467 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:03:40.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:40 smithi154 ceph-mon[34853]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:40.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:40.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:40.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:40.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:40.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:40.525 INFO:tasks.cephadm:Deploying osd.0 on smithi150 with /dev/vg_nvme/lv_4... 2024-09-15T22:03:40.525 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:03:40.574 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:40 smithi150 ceph-mon[30886]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:40.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:40.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:40.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:40.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:40.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:40.881 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:41.304 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:03:41.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: Reconfiguring daemon mon.b on smithi154 2024-09-15T22:03:41.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:41.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:41.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:41.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:41.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:41.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:03:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: Reconfiguring daemon mon.b on smithi154 2024-09-15T22:03:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:03:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: Reconfiguring daemon mon.b on smithi154 2024-09-15T22:03:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:41.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:03:41.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:03:41.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:42.291 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:42 smithi150 ceph-mon[30886]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:03:42.291 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:42 smithi150 ceph-mon[30886]: Reconfiguring daemon mon.c on smithi169 2024-09-15T22:03:42.291 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:42 smithi150 ceph-mon[30886]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:42.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:42 smithi169 ceph-mon[35850]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:03:42.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:42 smithi169 ceph-mon[35850]: Reconfiguring daemon mon.c on smithi169 2024-09-15T22:03:42.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:42 smithi169 ceph-mon[35850]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:42 smithi154 ceph-mon[34853]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:03:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:42 smithi154 ceph-mon[34853]: Reconfiguring daemon mon.c on smithi169 2024-09-15T22:03:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:42 smithi154 ceph-mon[34853]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.447 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:43.448 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:03:43.448 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:43.448 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:43.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:03:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:43.755 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:03:43.786 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_4 2024-09-15T22:03:44.136 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:43 smithi169 systemd[1]: Starting Ceph mgr.z for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:03:44.144 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:03:44.436 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-mon[35850]: Deploying daemon mgr.z on smithi169 2024-09-15T22:03:44.436 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-mon[35850]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:44.437 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 podman[37649]: 2024-09-15 22:03:44.134892873 +0000 UTC m=+0.107658527 container create 373cce3569b1ce1bf581c1b05987ef67d712389c677eea79f5f94a1438b20b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:03:44.437 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 podman[37649]: 2024-09-15 22:03:44.043044 +0000 UTC m=+0.015809667 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:03:44.437 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 podman[37649]: 2024-09-15 22:03:44.312267837 +0000 UTC m=+0.285033498 container init 373cce3569b1ce1bf581c1b05987ef67d712389c677eea79f5f94a1438b20b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-15T22:03:44.437 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 podman[37649]: 2024-09-15 22:03:44.31574177 +0000 UTC m=+0.288507422 container start 373cce3569b1ce1bf581c1b05987ef67d712389c677eea79f5f94a1438b20b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:03:44.437 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-mgr[37668]: -- 172.21.15.169:0/4023323689 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56196ad450e0 con 0x56196ad22800 2024-09-15T22:03:44.437 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:44.434+0000 7fbb26956040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:03:44.492 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:44 smithi150 ceph-mon[30886]: Deploying daemon mgr.z on smithi169 2024-09-15T22:03:44.492 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:44 smithi150 ceph-mon[30886]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:44 smithi154 ceph-mon[34853]: Deploying daemon mgr.z on smithi169 2024-09-15T22:03:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:44 smithi154 ceph-mon[34853]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 -- 172.21.15.150:0/85108249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 msgr2=0x7f50281053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 --2- 172.21.15.150:0/85108249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f50281053e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5014009900 tx=0x7f501402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 -- 172.21.15.150:0/85108249 shutdown_connections 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 --2- 172.21.15.150:0/85108249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5028105920 0x7f502810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 --2- 172.21.15.150:0/85108249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f50281053e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 --2- 172.21.15.150:0/85108249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f5028104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:44.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 -- 172.21.15.150:0/85108249 >> 172.21.15.150:0/85108249 conn(0x7f50280ff5b0 msgr2=0x7f50281019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:03:44.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 -- 172.21.15.150:0/85108249 shutdown_connections 2024-09-15T22:03:44.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.603+0000 7f502e000640 1 -- 172.21.15.150:0/85108249 wait complete. 2024-09-15T22:03:44.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.604+0000 7f502e000640 1 Processor -- start 2024-09-15T22:03:44.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.604+0000 7f502e000640 1 -- start start 2024-09-15T22:03:44.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f502e000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f502819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:44.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f502e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f502819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:44.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f502e000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5028105920 0x7f50281a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:44.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f502e000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f502810fae0 con 0x7f5028104f60 2024-09-15T22:03:44.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f502e000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f502810f960 con 0x7f5028105920 2024-09-15T22:03:44.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f502e000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f502810fc60 con 0x7f5028103e00 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5026a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f502819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f502819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f502819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43698/0 (socket says 172.21.15.150:43698) 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 -- 172.21.15.150:0/2472816250 learned_addr learned my addr 172.21.15.150:0/2472816250 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5026a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f502819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53150/0 (socket says 172.21.15.150:53150) 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027e00640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5028105920 0x7f50281a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 -- 172.21.15.150:0/2472816250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5028105920 msgr2=0x7f50281a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5028105920 0x7f50281a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 -- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 msgr2=0x7f502819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f502819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5027400640 1 -- 172.21.15.150:0/2472816250 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50281a1d60 con 0x7f5028103e00 2024-09-15T22:03:44.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.605+0000 7f5026a00640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f502819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:03:44.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.606+0000 7f5027400640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f502819a130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f501800ea60 tx=0x7f501800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:44.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.606+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501800cde0 con 0x7f5028103e00 2024-09-15T22:03:44.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.606+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50180035f0 con 0x7f5028103e00 2024-09-15T22:03:44.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.606+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50281a1ff0 con 0x7f5028103e00 2024-09-15T22:03:44.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.606+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50281a24a0 con 0x7f5028103e00 2024-09-15T22:03:44.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.606+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018010670 con 0x7f5028103e00 2024-09-15T22:03:44.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.607+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f5018010810 con 0x7f5028103e00 2024-09-15T22:03:44.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.607+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502810b150 con 0x7f5028103e00 2024-09-15T22:03:44.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.607+0000 7f501fe00640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f500c039500 0x7f500c03b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:03:44.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.608+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f501804ca40 con 0x7f5028103e00 2024-09-15T22:03:44.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.608+0000 7f5026a00640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f500c039500 0x7f500c03b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:03:44.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.608+0000 7f5026a00640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f500c039500 0x7f500c03b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f501402a9e0 tx=0x7f50140315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:03:44.614 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.613+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f501801d250 con 0x7f5028103e00 2024-09-15T22:03:44.709 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:44.491+0000 7fbb26956040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:03:44.709 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 bash[37649]: 373cce3569b1ce1bf581c1b05987ef67d712389c677eea79f5f94a1438b20b6d 2024-09-15T22:03:44.709 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 systemd[1]: Started Ceph mgr.z for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:03:44.710 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:44.652+0000 7fbb26956040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:03:44.803 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:44.801+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5028062630 con 0x7f500c039500 2024-09-15T22:03:45.007 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:44.719+0000 7fbb26956040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:03:45.007 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:44.867+0000 7fbb26956040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:03:45.007 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:45.005+0000 7fbb26956040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:03:45.617 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:45.318+0000 7fbb26956040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:03:45.617 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:45.379+0000 7fbb26956040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:03:45.617 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:45.563+0000 7fbb26956040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:03:45.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: Deploying daemon mgr.y on smithi154 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:45 smithi150 ceph-mon[30886]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: Deploying daemon mgr.y on smithi154 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:03:45.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:03:45.889 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:45.889 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:45 smithi169 ceph-mon[35850]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: Deploying daemon mgr.y on smithi154 2024-09-15T22:03:45.992 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:03:45.993 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:03:45.993 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:03:45.993 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:45.993 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:45 smithi154 ceph-mon[34853]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:46.521 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 systemd[1]: Starting Ceph mgr.y for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:03:46.883 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:46.487+0000 7fbb26956040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:03:46.883 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:46.557+0000 7fbb26956040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:03:46.922 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 podman[36201]: 2024-09-15 22:03:46.626872517 +0000 UTC m=+0.106338948 container create b1940ca9085b1ef6bdf780e40f20a4c5a2a3ef5451ce33000e3080369ffefb04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:03:46.922 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 podman[36201]: 2024-09-15 22:03:46.536748163 +0000 UTC m=+0.016214564 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:03:46.922 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 podman[36201]: 2024-09-15 22:03:46.845822099 +0000 UTC m=+0.325288491 container init b1940ca9085b1ef6bdf780e40f20a4c5a2a3ef5451ce33000e3080369ffefb04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T22:03:46.922 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 podman[36201]: 2024-09-15 22:03:46.84896331 +0000 UTC m=+0.328429696 container start b1940ca9085b1ef6bdf780e40f20a4c5a2a3ef5451ce33000e3080369ffefb04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-15T22:03:46.922 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 ceph-mgr[36220]: -- 172.21.15.154:0/3455172503 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a848a9d0e0 con 0x55a848a7b000 2024-09-15T22:03:47.194 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 bash[36201]: b1940ca9085b1ef6bdf780e40f20a4c5a2a3ef5451ce33000e3080369ffefb04 2024-09-15T22:03:47.194 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 systemd[1]: Started Ceph mgr.y for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:03:47.195 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:46 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:46.978+0000 7f8c88757040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:03:47.195 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.037+0000 7f8c88757040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:03:47.195 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.192+0000 7f8c88757040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:03:47.521 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.262+0000 7f8c88757040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:03:47.521 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.420+0000 7f8c88757040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:03:47.594 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.303+0000 7fbb26956040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:03:47.595 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.429+0000 7fbb26956040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:03:47.595 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.592+0000 7fbb26956040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:03:47.875 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.655+0000 7fbb26956040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:03:47.875 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.813+0000 7fbb26956040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:03:47.882 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.579+0000 7f8c88757040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:03:48.161 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.906+0000 7f8c88757040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:03:48.161 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:47.967+0000 7f8c88757040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1925783531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]: dispatch 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]: dispatch 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]': finished 2024-09-15T22:03:48.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:03:48.163 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.886+0000 7fbb26956040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:47.947+0000 7fbb26956040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:48.112+0000 7fbb26956040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:48.178+0000 7fbb26956040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:48.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:48.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1925783531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]: dispatch 2024-09-15T22:03:48.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]: dispatch 2024-09-15T22:03:48.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]': finished 2024-09-15T22:03:48.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:03:48.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1925783531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]: dispatch 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]: dispatch 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "defc4d93-c2c6-464f-a12c-3081cad7a002"}]': finished 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:03:48.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:03:48.459 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:48.257+0000 7fbb26956040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:03:48.459 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:48.341+0000 7fbb26956040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:03:48.460 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:48.402+0000 7fbb26956040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:03:48.521 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:48 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:48.159+0000 7f8c88757040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:03:48.959 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:48.464+0000 7fbb26956040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:03:49.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2058375255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:03:49.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:49.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:49.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:49.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.459 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z[37664]: 2024-09-15T22:03:49.258+0000 7fbb26956040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:03:49.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2058375255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:49.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.521 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:49.058+0000 7f8c88757040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:03:49.521 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:49.126+0000 7f8c88757040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:03:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2058375255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:03:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:03:50.097 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:49.840+0000 7f8c88757040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:03:50.097 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:49.953+0000 7f8c88757040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:03:50.097 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.094+0000 7f8c88757040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:03:50.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:50.109+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mgrmap(e 14) ==== 92409+0+0 (secure 0 0 0) 0x7f5018021950 con 0x7f5028103e00 2024-09-15T22:03:50.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-mon[34853]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:50.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-mon[34853]: Standby manager daemon z started 2024-09-15T22:03:50.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:03:50.373 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:03:50.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:03:50.374 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:03:50.374 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.156+0000 7f8c88757040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:03:50.374 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.303+0000 7f8c88757040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:03:50.374 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.370+0000 7f8c88757040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:03:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:50 smithi150 ceph-mon[30886]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:50 smithi150 ceph-mon[30886]: Standby manager daemon z started 2024-09-15T22:03:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:50 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:03:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:50 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:03:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:50 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:03:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:50 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:03:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:50 smithi169 ceph-mon[35850]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:50 smithi169 ceph-mon[35850]: Standby manager daemon z started 2024-09-15T22:03:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:50 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:03:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:50 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:03:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:50 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:03:50.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:50 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.169:0/594664172' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:03:50.655 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.430+0000 7f8c88757040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:03:50.655 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.588+0000 7f8c88757040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:03:50.655 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.652+0000 7f8c88757040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:03:50.920 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.718+0000 7f8c88757040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:03:50.920 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.800+0000 7f8c88757040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:03:50.920 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.859+0000 7f8c88757040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:03:50.920 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:50.917+0000 7f8c88757040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:03:51.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:51 smithi154 ceph-mon[34853]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:03:51.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:03:51.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:51 smithi150 ceph-mon[30886]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:03:51.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:03:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:51 smithi169 ceph-mon[35850]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-15T22:03:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:03:52.021 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:03:51 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y[36216]: 2024-09-15T22:03:51.703+0000 7f8c88757040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:03:52.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:03:52.135+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mon.1 v2:172.21.15.169:3300/0 8 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f501800fcc0 con 0x7f5028103e00 2024-09-15T22:03:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:52 smithi150 ceph-mon[30886]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:52 smithi150 ceph-mon[30886]: Standby manager daemon y started 2024-09-15T22:03:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:52 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:03:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:52 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:03:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:52 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:03:52.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:52 smithi150 ceph-mon[30886]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:03:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:52 smithi169 ceph-mon[35850]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:52 smithi169 ceph-mon[35850]: Standby manager daemon y started 2024-09-15T22:03:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:52 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:03:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:52 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:03:52.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:52 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:03:52.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:52 smithi169 ceph-mon[35850]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:03:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:52 smithi154 ceph-mon[34853]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:52 smithi154 ceph-mon[34853]: Standby manager daemon y started 2024-09-15T22:03:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:52 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:03:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:52 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:03:52.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:52 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:03:52.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:52 smithi154 ceph-mon[34853]: from='mgr.? 172.21.15.154:0/3844553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:03:53.401 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:53 smithi150 ceph-mon[30886]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:03:53.401 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:03:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:53 smithi169 ceph-mon[35850]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:03:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:03:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:53 smithi154 ceph-mon[34853]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-15T22:03:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:03:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:54 smithi150 ceph-mon[30886]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:54 smithi169 ceph-mon[35850]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:54 smithi154 ceph-mon[34853]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:56 smithi150 ceph-mon[30886]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:56.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:56 smithi169 ceph-mon[35850]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:56 smithi154 ceph-mon[34853]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:58.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:58 smithi150 ceph-mon[30886]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:58.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:03:58.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:58.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:58 smithi169 ceph-mon[35850]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:58.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:03:58.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:58 smithi154 ceph-mon[34853]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:03:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:03:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:03:59.405 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:03:59 smithi150 ceph-mon[30886]: Deploying daemon osd.0 on smithi150 2024-09-15T22:03:59.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:03:59 smithi169 ceph-mon[35850]: Deploying daemon osd.0 on smithi150 2024-09-15T22:03:59.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:03:59 smithi154 ceph-mon[34853]: Deploying daemon osd.0 on smithi150 2024-09-15T22:04:00.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:00 smithi150 ceph-mon[30886]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:00.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:00 smithi169 ceph-mon[35850]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:00 smithi154 ceph-mon[34853]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:02.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:02 smithi150 ceph-mon[30886]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:02.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:02 smithi169 ceph-mon[35850]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:02 smithi154 ceph-mon[34853]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:04.258 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:04 smithi150 ceph-mon[30886]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:04.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:04 smithi169 ceph-mon[35850]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:04 smithi154 ceph-mon[34853]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:05.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:05.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:05.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:05.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:05.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:05.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:05.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:05.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:05.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:06 smithi150 ceph-mon[30886]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:06.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:06 smithi169 ceph-mon[35850]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:06 smithi154 ceph-mon[34853]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:08.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:08 smithi150 ceph-mon[30886]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:08 smithi169 ceph-mon[35850]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:08 smithi154 ceph-mon[34853]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:08.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:09.594 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.591+0000 7f501fe00640 1 -- 172.21.15.150:0/2472816250 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5028062630 con 0x7f500c039500 2024-09-15T22:04:09.594 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 0 on host 'smithi150' 2024-09-15T22:04:09.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f500c039500 msgr2=0x7f500c03b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f500c039500 0x7f500c03b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f501402a9e0 tx=0x7f50140315b0 comp rx=0 tx=0).stop 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 msgr2=0x7f502819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f502819a130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f501800ea60 tx=0x7f501800ef20 comp rx=0 tx=0).stop 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 shutdown_connections 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5028105920 0x7f50281a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f500c039500 0x7f500c03b9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5028104f60 0x7f502819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 --2- 172.21.15.150:0/2472816250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5028103e00 0x7f502819a130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.594+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 >> 172.21.15.150:0/2472816250 conn(0x7f50280ff5b0 msgr2=0x7f5028108320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.595+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 shutdown_connections 2024-09-15T22:04:09.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:04:09.595+0000 7f502e000640 1 -- 172.21.15.150:0/2472816250 wait complete. 2024-09-15T22:04:10.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:10 smithi150 ceph-mon[30886]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:10.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:10.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:10.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:10.226 DEBUG:teuthology.orchestra.run.smithi150:osd.0> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T22:04:10.231 INFO:tasks.cephadm:Deploying osd.1 on smithi154 with /dev/vg_nvme/lv_4... 2024-09-15T22:04:10.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:04:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:10 smithi169 ceph-mon[35850]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:10.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:10.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:10.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:10.481 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:04:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:10 smithi154 ceph-mon[34853]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:10.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:11.677 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:04:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0[44633]: 2024-09-15T22:04:11.421+0000 7f663fe0b640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:04:12.302 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:12 smithi154 ceph-mon[34853]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:12.302 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:12 smithi154 ceph-mon[34853]: from='osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:04:12.302 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:12 smithi154 ceph-mon[34853]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:04:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:12 smithi150 ceph-mon[30886]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:12 smithi150 ceph-mon[30886]: from='osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:04:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:12 smithi150 ceph-mon[30886]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:04:12.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:12 smithi169 ceph-mon[35850]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:12.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:12 smithi169 ceph-mon[35850]: from='osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:04:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:12 smithi169 ceph-mon[35850]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:04:12.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:04:12.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:04:13.456 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:13 smithi154 ceph-mon[34853]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:04:13.456 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:13 smithi154 ceph-mon[34853]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:04:13.456 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:13.456 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:13 smithi154 ceph-mon[34853]: from='osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:04:13.457 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:13 smithi154 ceph-mon[34853]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:04:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:13 smithi169 ceph-mon[35850]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:04:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:13 smithi169 ceph-mon[35850]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:04:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:13 smithi169 ceph-mon[35850]: from='osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:04:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:13 smithi169 ceph-mon[35850]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:04:13.636 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:13 smithi150 ceph-mon[30886]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:04:13.637 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:13 smithi150 ceph-mon[30886]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:04:13.637 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:13.637 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:13 smithi150 ceph-mon[30886]: from='osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:04:13.637 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:13 smithi150 ceph-mon[30886]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.680+0000 7fb9ad819640 1 -- 172.21.15.154:0/2459591544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a81026d0 msgr2=0x7fb9a8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.680+0000 7fb9ad819640 1 --2- 172.21.15.154:0/2459591544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a81026d0 0x7fb9a8108f60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009ca0 tx=0x7fb9a002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 -- 172.21.15.154:0/2459591544 shutdown_connections 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 --2- 172.21.15.154:0/2459591544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a81026d0 0x7fb9a8108f60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 --2- 172.21.15.154:0/2459591544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9a8101d10 0x7fb9a8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 --2- 172.21.15.154:0/2459591544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a8100b10 0x7fb9a8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 -- 172.21.15.154:0/2459591544 >> 172.21.15.154:0/2459591544 conn(0x7fb9a80fc2a0 msgr2=0x7fb9a80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 -- 172.21.15.154:0/2459591544 shutdown_connections 2024-09-15T22:04:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 -- 172.21.15.154:0/2459591544 wait complete. 2024-09-15T22:04:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 Processor -- start 2024-09-15T22:04:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.681+0000 7fb9ad819640 1 -- start start 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ad819640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9a8100b10 0x7fb9a806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ad819640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 0x7fb9a819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ad819640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a81026d0 0x7fb9a819f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ad819640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810c790 con 0x7fb9a8100b10 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ad819640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810c610 con 0x7fb9a8101d10 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ad819640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810c910 con 0x7fb9a81026d0 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 0x7fb9a819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 0x7fb9a819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59468/0 (socket says 172.21.15.154:59468) 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 -- 172.21.15.154:0/3732797765 learned_addr learned my addr 172.21.15.154:0/3732797765 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a6ffd640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9a8100b10 0x7fb9a806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a77fe640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a81026d0 0x7fb9a819f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:13.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 -- 172.21.15.154:0/3732797765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a81026d0 msgr2=0x7fb9a819f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a81026d0 0x7fb9a819f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 -- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9a8100b10 msgr2=0x7fb9a806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9a8100b10 0x7fb9a806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 -- 172.21.15.154:0/3732797765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a819fb40 con 0x7fb9a8101d10 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a77fe640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a81026d0 0x7fb9a819f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9a67fc640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 0x7fb9a819cc10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00c890 tx=0x7fb99c00cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.682+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c004220 con 0x7fb9a8101d10 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.683+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a819fdd0 con 0x7fb9a8101d10 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.683+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb99c0043c0 con 0x7fb9a8101d10 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.683+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0049e0 con 0x7fb9a8101d10 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.683+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a81a0280 con 0x7fb9a8101d10 2024-09-15T22:04:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.684+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a8107ee0 con 0x7fb9a8101d10 2024-09-15T22:04:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.685+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fb99c0079b0 con 0x7fb9a8101d10 2024-09-15T22:04:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.686+0000 7fb9ac817640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9900a31b0 0x7fb9900a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.686+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fb99c0cdd70 con 0x7fb9a8101d10 2024-09-15T22:04:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.686+0000 7fb9a6ffd640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9900a31b0 0x7fb9900a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.686+0000 7fb9a6ffd640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9900a31b0 0x7fb9900a5670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb998005fd0 tx=0x7fb99800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:04:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.689+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb99c014030 con 0x7fb9a8101d10 2024-09-15T22:04:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:13.870+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb9a8062630 con 0x7fb9900a31b0 2024-09-15T22:04:14.426 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0[44633]: 2024-09-15T22:04:14.083+0000 7f663b400640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:04:14.427 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0[44633]: 2024-09-15T22:04:14.106+0000 7f6630a00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:04:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:04:14.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:04:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:04:14.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:14.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:14.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:04:14.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:04:14.430 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:14.430 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:14 smithi150 ceph-mon[30886]: from='osd.0 ' entity='osd.0' 2024-09-15T22:04:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:04:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:04:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:04:14.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:04:14.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:14.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:14 smithi169 ceph-mon[35850]: from='osd.0 ' entity='osd.0' 2024-09-15T22:04:14.500 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:14.501 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:14.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:04:14.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:04:14.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:14.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:14 smithi154 ceph-mon[34853]: from='osd.0 ' entity='osd.0' 2024-09-15T22:04:15.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:04:15.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:04:15.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi150 2024-09-15T22:04:15.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi150 to 17089M 2024-09-15T22:04:15.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:04:15.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:15.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] boot 2024-09-15T22:04:15.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:04:15.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:15.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi150 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi150 to 17089M 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] boot 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:04:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:04:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:04:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi150 2024-09-15T22:04:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi150 to 17089M 2024-09-15T22:04:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:04:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: osd.0 [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] boot 2024-09-15T22:04:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:04:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:04:16.457 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:16 smithi154 ceph-mon[34853]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:16.457 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:16 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/2772530164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]: dispatch 2024-09-15T22:04:16.458 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:16 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]: dispatch 2024-09-15T22:04:16.458 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:16 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]': finished 2024-09-15T22:04:16.458 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:16 smithi154 ceph-mon[34853]: osdmap e9: 2 total, 1 up, 2 in 2024-09-15T22:04:16.458 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:16 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:16 smithi169 ceph-mon[35850]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:16 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/2772530164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]: dispatch 2024-09-15T22:04:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:16 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]: dispatch 2024-09-15T22:04:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:16 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]': finished 2024-09-15T22:04:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:16 smithi169 ceph-mon[35850]: osdmap e9: 2 total, 1 up, 2 in 2024-09-15T22:04:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:16 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:16 smithi150 ceph-mon[30886]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:04:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:16 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/2772530164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]: dispatch 2024-09-15T22:04:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:16 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]: dispatch 2024-09-15T22:04:16.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:16 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "042fff78-7cda-42c3-b58a-ad6488a3dece"}]': finished 2024-09-15T22:04:16.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:16 smithi150 ceph-mon[30886]: osdmap e9: 2 total, 1 up, 2 in 2024-09-15T22:04:16.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:16 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:17.494 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:17 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/2743059449' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:04:17.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:17 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/2743059449' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:04:17.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:17 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/2743059449' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:04:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:18 smithi154 ceph-mon[34853]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:18 smithi150 ceph-mon[30886]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:18 smithi169 ceph-mon[35850]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:19 smithi154 ceph-mon[34853]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:19.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:19 smithi150 ceph-mon[30886]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:19.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:19 smithi169 ceph-mon[35850]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:22.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:22 smithi154 ceph-mon[34853]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:22.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:22 smithi150 ceph-mon[30886]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:22.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:22 smithi169 ceph-mon[35850]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:24.250 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:24 smithi154 ceph-mon[34853]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:24.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:24 smithi150 ceph-mon[30886]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:24.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:24 smithi169 ceph-mon[35850]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:25.261 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:04:25.261 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:25.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:04:25.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:25.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:04:25.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:26.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:26 smithi154 ceph-mon[34853]: Deploying daemon osd.1 on smithi154 2024-09-15T22:04:26.418 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:26 smithi154 ceph-mon[34853]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:26 smithi150 ceph-mon[30886]: Deploying daemon osd.1 on smithi154 2024-09-15T22:04:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:26 smithi150 ceph-mon[30886]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:26.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:26 smithi169 ceph-mon[35850]: Deploying daemon osd.1 on smithi154 2024-09-15T22:04:26.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:26 smithi169 ceph-mon[35850]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:28.169 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:28 smithi154 ceph-mon[34853]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:28 smithi150 ceph-mon[30886]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:28 smithi169 ceph-mon[35850]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:30 smithi150 ceph-mon[30886]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:30.450 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:30 smithi154 ceph-mon[34853]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:30 smithi169 ceph-mon[35850]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:31.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:31 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:31.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:31 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:31.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:31 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:31.443 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:31 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:31.444 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:31 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:31.444 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:31 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:31.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:31 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:31.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:31 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:31.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:31 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:32.235 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:32 smithi154 ceph-mon[34853]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:32 smithi150 ceph-mon[30886]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:32 smithi169 ceph-mon[35850]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:34 smithi150 ceph-mon[30886]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:34 smithi169 ceph-mon[35850]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:34 smithi154 ceph-mon[34853]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:34.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:34.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.822+0000 7fb9ac817640 1 -- 172.21.15.154:0/3732797765 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb9a8062630 con 0x7fb9900a31b0 2024-09-15T22:04:34.832 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 1 on host 'smithi154' 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9900a31b0 msgr2=0x7fb9900a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9900a31b0 0x7fb9900a5670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb998005fd0 tx=0x7fb99800b390 comp rx=0 tx=0).stop 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 msgr2=0x7fb9a819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 0x7fb9a819cc10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00c890 tx=0x7fb99c00cd50 comp rx=0 tx=0).stop 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 shutdown_connections 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9a81026d0 0x7fb9a819f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9a8101d10 0x7fb9a819cc10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9900a31b0 0x7fb9900a5670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 --2- 172.21.15.154:0/3732797765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9a8100b10 0x7fb9a806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 >> 172.21.15.154:0/3732797765 conn(0x7fb9a80fc2a0 msgr2=0x7fb9a81050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:04:34.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 shutdown_connections 2024-09-15T22:04:34.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:04:34.825+0000 7fb9ad819640 1 -- 172.21.15.154:0/3732797765 wait complete. 2024-09-15T22:04:35.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:35.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:35.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:35.406 DEBUG:teuthology.orchestra.run.smithi154:osd.1> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T22:04:35.408 INFO:tasks.cephadm:Deploying osd.2 on smithi169 with /dev/vg_nvme/lv_4... 2024-09-15T22:04:35.408 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:04:35.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:35.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:35.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:35.436 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:35.436 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:35.436 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:35.665 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:04:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:36 smithi150 ceph-mon[30886]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:36.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:36 smithi169 ceph-mon[35850]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:36.485 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:36 smithi154 ceph-mon[34853]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:37.383 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:04:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1[39352]: 2024-09-15T22:04:37.105+0000 7ff296201640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:04:38.065 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:04:38.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_4 2024-09-15T22:04:38.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:38.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:04:38.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:04:38.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:04:38.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:38.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:38.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.387 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:04:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:04:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:04:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:04:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:04:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:04:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:04:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:38.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3028368308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4102690 msgr2=0x7fb8b4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:38.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3028368308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4102690 0x7fb8b4108f20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009ca0 tx=0x7fb8a402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:04:38.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3028368308 shutdown_connections 2024-09-15T22:04:38.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3028368308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4102690 0x7fb8b4108f20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3028368308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b4101cd0 0x7fb8b4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3028368308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b4100ad0 0x7fb8b4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3028368308 >> 172.21.15.169:0/3028368308 conn(0x7fb8b40fc280 msgr2=0x7fb8b40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3028368308 shutdown_connections 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.840+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3028368308 wait complete. 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.841+0000 7fb8b89c5640 1 Processor -- start 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.841+0000 7fb8b89c5640 1 -- start start 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.841+0000 7fb8b89c5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b4100ad0 0x7fb8b4104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b89c5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 0x7fb8b41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b89c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b4102690 0x7fb8b41035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:38.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b89c5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b410c7b0 con 0x7fb8b4100ad0 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b89c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b410c630 con 0x7fb8b4102690 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b89c5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b410c930 con 0x7fb8b4101cd0 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 0x7fb8b41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 0x7fb8b41030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:44970/0 (socket says 172.21.15.169:44970) 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 -- 172.21.15.169:0/3249342716 learned_addr learned my addr 172.21.15.169:0/3249342716 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b2d9d640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b4102690 0x7fb8b41035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b259c640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b4100ad0 0x7fb8b4104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 -- 172.21.15.169:0/3249342716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b4102690 msgr2=0x7fb8b41035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b4102690 0x7fb8b41035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:38.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 -- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b4100ad0 msgr2=0x7fb8b4104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b4100ad0 0x7fb8b4104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 -- 172.21.15.169:0/3249342716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b4103eb0 con 0x7fb8b4101cd0 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b1d9b640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 0x7fb8b41030b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00b4a0 tx=0x7fb89c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c014070 con 0x7fb8b4101cd0 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb89c010af0 con 0x7fb8b4101cd0 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c017d10 con 0x7fb8b4101cd0 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.842+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b41a20c0 con 0x7fb8b4101cd0 2024-09-15T22:04:38.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.843+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b41a25d0 con 0x7fb8b4101cd0 2024-09-15T22:04:38.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.844+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b41a2860 con 0x7fb8b4101cd0 2024-09-15T22:04:38.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.845+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fb89c017070 con 0x7fb8b4101cd0 2024-09-15T22:04:38.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.845+0000 7fb8ab7fe640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb8a00a31b0 0x7fb8a00a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:04:38.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.845+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7fb89c0cd610 con 0x7fb8b4101cd0 2024-09-15T22:04:38.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.846+0000 7fb8b259c640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb8a00a31b0 0x7fb8a00a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:04:38.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.846+0000 7fb8b259c640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb8a00a31b0 0x7fb8a00a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac005d00 tx=0x7fb8ac005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:04:38.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:38.853+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb89c09bd00 con 0x7fb8b4101cd0 2024-09-15T22:04:39.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:39.028+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb8b406a6f0 con 0x7fb8a00a31b0 2024-09-15T22:04:39.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi154 2024-09-15T22:04:39.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-15T22:04:39.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:04:39.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:04:39.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:04:39.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:39.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:04:39.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:04:39.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:04:39.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi154 2024-09-15T22:04:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-15T22:04:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:04:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:04:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:04:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:04:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:04:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:04:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi154 2024-09-15T22:04:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-15T22:04:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:04:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:04:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:04:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:39.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:04:39.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:04:39.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:04:39.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:40.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:04:40.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:40.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:04:40.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:04:40.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:40.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:40.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:40 smithi154 ceph-mon[34853]: from='osd.1 ' entity='osd.1' 2024-09-15T22:04:40.273 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1[39352]: 2024-09-15T22:04:39.871+0000 7ff292998640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:04:40.273 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:04:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1[39352]: 2024-09-15T22:04:39.875+0000 7ff289f93640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:40.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:40 smithi169 ceph-mon[35850]: from='osd.1 ' entity='osd.1' 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:40 smithi150 ceph-mon[30886]: from='osd.1 ' entity='osd.1' 2024-09-15T22:04:41.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:41 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:04:41.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:41 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:04:41.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:41.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:41 smithi150 ceph-mon[30886]: osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] boot 2024-09-15T22:04:41.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:41 smithi150 ceph-mon[30886]: osdmap e12: 2 total, 2 up, 2 in 2024-09-15T22:04:41.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:41.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:41 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:04:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:41 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:04:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:41 smithi169 ceph-mon[35850]: osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] boot 2024-09-15T22:04:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:41 smithi169 ceph-mon[35850]: osdmap e12: 2 total, 2 up, 2 in 2024-09-15T22:04:41.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:41 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:04:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:41 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:04:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:41 smithi154 ceph-mon[34853]: osd.1 [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] boot 2024-09-15T22:04:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:41 smithi154 ceph-mon[34853]: osdmap e12: 2 total, 2 up, 2 in 2024-09-15T22:04:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:04:42.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:42.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/258955787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]: dispatch 2024-09-15T22:04:42.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]: dispatch 2024-09-15T22:04:42.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]': finished 2024-09-15T22:04:42.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: osdmap e13: 3 total, 2 up, 3 in 2024-09-15T22:04:42.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:04:42.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:42 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/1139507796' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:04:42.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:42.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/258955787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]: dispatch 2024-09-15T22:04:42.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]: dispatch 2024-09-15T22:04:42.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]': finished 2024-09-15T22:04:42.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: osdmap e13: 3 total, 2 up, 3 in 2024-09-15T22:04:42.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:04:42.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:42 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/1139507796' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/258955787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]: dispatch 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]: dispatch 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82099aa0-3e95-412f-8801-880ea1f6d9aa"}]': finished 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: osdmap e13: 3 total, 2 up, 3 in 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:04:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:42 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/1139507796' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:04:44.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:44 smithi150 ceph-mon[30886]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:44.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:44 smithi169 ceph-mon[35850]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:44 smithi154 ceph-mon[34853]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:46.378 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:46 smithi169 ceph-mon[35850]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:46.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:46 smithi150 ceph-mon[30886]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:46 smithi154 ceph-mon[34853]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:48.328 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:48 smithi169 ceph-mon[35850]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:48 smithi150 ceph-mon[30886]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:48 smithi154 ceph-mon[34853]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:50.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:50 smithi169 ceph-mon[35850]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:50.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:04:50.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:50 smithi150 ceph-mon[30886]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:04:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:50 smithi154 ceph-mon[34853]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:04:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:51.326 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:51 smithi169 ceph-mon[35850]: Deploying daemon osd.2 on smithi169 2024-09-15T22:04:51.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:51 smithi150 ceph-mon[30886]: Deploying daemon osd.2 on smithi169 2024-09-15T22:04:51.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:51 smithi154 ceph-mon[34853]: Deploying daemon osd.2 on smithi169 2024-09-15T22:04:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:52 smithi150 ceph-mon[30886]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:52 smithi169 ceph-mon[35850]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:52 smithi154 ceph-mon[34853]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:54 smithi150 ceph-mon[30886]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:54 smithi169 ceph-mon[35850]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:54 smithi154 ceph-mon[34853]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:56.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:56 smithi169 ceph-mon[35850]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:56.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:56 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:56.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:56 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:56.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:56 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:56 smithi150 ceph-mon[30886]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:56 smithi154 ceph-mon[34853]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:56 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:04:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:56 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:56 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:58.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:58 smithi150 ceph-mon[30886]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:58.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:58 smithi169 ceph-mon[35850]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:58 smithi154 ceph-mon[34853]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:59.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:59 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:59.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:59 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:59.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:59 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:59.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:59 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:59.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:59 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:59.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:04:59 smithi169 ceph-mon[35850]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:04:59.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.765+0000 7fb8ab7fe640 1 -- 172.21.15.169:0/3249342716 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb8b406a6f0 con 0x7fb8a00a31b0 2024-09-15T22:04:59.767 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 2 on host 'smithi169' 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb8a00a31b0 msgr2=0x7fb8a00a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb8a00a31b0 0x7fb8a00a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac005d00 tx=0x7fb8ac005c50 comp rx=0 tx=0).stop 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 msgr2=0x7fb8b41030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 0x7fb8b41030b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00b4a0 tx=0x7fb89c00b960 comp rx=0 tx=0).stop 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 shutdown_connections 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b4102690 0x7fb8b41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8b4101cd0 0x7fb8b41030b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb8a00a31b0 0x7fb8a00a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 --2- 172.21.15.169:0/3249342716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b4100ad0 0x7fb8b4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 >> 172.21.15.169:0/3249342716 conn(0x7fb8b40fc280 msgr2=0x7fb8b4069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:04:59.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 shutdown_connections 2024-09-15T22:04:59.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:04:59.767+0000 7fb8b89c5640 1 -- 172.21.15.169:0/3249342716 wait complete. 2024-09-15T22:04:59.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:59 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:59.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:59 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:59.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:59 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:04:59.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:59 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:04:59.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:59 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:04:59.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:04:59 smithi150 ceph-mon[30886]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:59 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:59 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:59 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:59 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:00.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:59 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:00.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:04:59 smithi154 ceph-mon[34853]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:00.439 DEBUG:teuthology.orchestra.run.smithi169:osd.2> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T22:05:00.441 INFO:tasks.cephadm:Deploying osd.3 on smithi150 with /dev/vg_nvme/lv_3... 2024-09-15T22:05:00.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:05:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:00.804 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:05:00.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:00.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:00.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:01.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:01.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:01.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:01.827 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:01 smithi169 ceph-mon[35850]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:01.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:01 smithi150 ceph-mon[30886]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:02.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:01 smithi154 ceph-mon[34853]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:02.210 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2[40857]: 2024-09-15T22:05:01.975+0000 7fe6dd986640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:05:02.561 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:02 smithi150 ceph-mon[30886]: from='osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:05:02.561 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:02 smithi150 ceph-mon[30886]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:05:02.908 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:02 smithi169 ceph-mon[35850]: from='osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:05:02.908 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:02 smithi169 ceph-mon[35850]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:05:03.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:02 smithi154 ceph-mon[34853]: from='osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:05:03.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:02 smithi154 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi169 2024-09-15T22:05:03.854 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.855 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.855 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:03.855 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.855 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:03.855 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:03.855 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.860 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:05:03.891 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_3 2024-09-15T22:05:03.959 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2[40857]: 2024-09-15T22:05:03.574+0000 7fe6d90e6640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:05:03.960 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2[40857]: 2024-09-15T22:05:03.577+0000 7fe6d5720640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi169 2024-09-15T22:05:03.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:03.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:03.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:03.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:03.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:04.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:05:04.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:05:04.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi169 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:04.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:04.250 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:05:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:04 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-15T22:05:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:04 smithi150 ceph-mon[30886]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:05:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:04 smithi150 ceph-mon[30886]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:05:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:04 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:04 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 -- 172.21.15.150:0/3972193400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24481037d0 msgr2=0x7f244810a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 --2- 172.21.15.150:0/3972193400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24481037d0 0x7f244810a060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ca0 tx=0x7f244002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 -- 172.21.15.150:0/3972193400 shutdown_connections 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 --2- 172.21.15.150:0/3972193400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24481037d0 0x7f244810a060 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 --2- 172.21.15.150:0/3972193400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2448102e10 0x7f2448103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 --2- 172.21.15.150:0/3972193400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 0x7f2448102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 -- 172.21.15.150:0/3972193400 >> 172.21.15.150:0/3972193400 conn(0x7f24480fd3c0 msgr2=0x7f24480ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:05:04.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 -- 172.21.15.150:0/3972193400 shutdown_connections 2024-09-15T22:05:04.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.791+0000 7f244ec00640 1 -- 172.21.15.150:0/3972193400 wait complete. 2024-09-15T22:05:04.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.792+0000 7f244ec00640 1 Processor -- start 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.792+0000 7f244ec00640 1 -- start start 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244ec00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 0x7f2448197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244ec00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 0x7f2448198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244ec00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24481037d0 0x7f244819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244ec00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f244810d870 con 0x7f2448102e10 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244ec00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f244810d6f0 con 0x7f24481037d0 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244ec00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f244810d9f0 con 0x7f2448101c10 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f2447400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 0x7f2448198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:04.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f2447400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 0x7f2448198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33600/0 (socket says 172.21.15.150:33600) 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f2447400640 1 -- 172.21.15.150:0/3256285205 learned_addr learned my addr 172.21.15.150:0/3256285205 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f2447e00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 0x7f2448197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.793+0000 7f244cc00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24481037d0 0x7f244819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447400640 1 -- 172.21.15.150:0/3256285205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 msgr2=0x7f2448197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447400640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 0x7f2448197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447400640 1 -- 172.21.15.150:0/3256285205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24481037d0 msgr2=0x7f244819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447400640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24481037d0 0x7f244819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447400640 1 -- 172.21.15.150:0/3256285205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244819fa70 con 0x7f2448102e10 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447e00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 0x7f2448197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2447400640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 0x7f2448198380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f243400d950 tx=0x7f243400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434017070 con 0x7f2448102e10 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2434009c30 con 0x7f2448102e10 2024-09-15T22:05:04.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243400f6b0 con 0x7f2448102e10 2024-09-15T22:05:04.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244819fd60 con 0x7f2448102e10 2024-09-15T22:05:04.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.794+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24481a01f0 con 0x7f2448102e10 2024-09-15T22:05:04.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.796+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2448108f40 con 0x7f2448102e10 2024-09-15T22:05:04.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.798+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f24340109d0 con 0x7f2448102e10 2024-09-15T22:05:04.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.799+0000 7f2444c00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f242c0a3260 0x7f242c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:04.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.799+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2851+0+0 (secure 0 0 0) 0x7f24340cde10 con 0x7f2448102e10 2024-09-15T22:05:04.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.800+0000 7f2447e00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f242c0a3260 0x7f242c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:04.802 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.800+0000 7f2447e00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f242c0a3260 0x7f242c0a5720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2448102c70 tx=0x7f2438005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:05:04.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.803+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2434009de0 con 0x7f2448102e10 2024-09-15T22:05:04.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:04 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-15T22:05:04.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:04 smithi169 ceph-mon[35850]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:05:04.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:04 smithi169 ceph-mon[35850]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:05:04.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:04 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:04.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:04 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:04.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:04.987+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2448062630 con 0x7f242c0a3260 2024-09-15T22:05:05.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:04 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-15T22:05:05.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:04 smithi154 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:05:05.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:04 smithi154 ceph-mon[34853]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:05:05.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:04 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:05.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:04 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:05.837 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:05:05.837 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:05:05.837 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] boot 2024-09-15T22:05:05.837 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: osdmap e16: 3 total, 3 up, 3 in 2024-09-15T22:05:05.837 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:05.837 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:05.838 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:05.838 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:05:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:05:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] boot 2024-09-15T22:05:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: osdmap e16: 3 total, 3 up, 3 in 2024-09-15T22:05:05.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:05.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:05.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:05.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:05:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:05:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: osd.2 [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] boot 2024-09-15T22:05:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: osdmap e16: 3 total, 3 up, 3 in 2024-09-15T22:05:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:05:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:06.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:06.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:06.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:06 smithi150 ceph-mon[30886]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:06.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:06 smithi150 ceph-mon[30886]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:06.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:05:06.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:05:06.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:06 smithi150 ceph-mon[30886]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T22:05:06.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:05:06.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:06 smithi169 ceph-mon[35850]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:06.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:06 smithi169 ceph-mon[35850]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:06.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:05:06.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:05:06.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:06 smithi169 ceph-mon[35850]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T22:05:06.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:05:07.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:06 smithi154 ceph-mon[34853]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:07.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:06 smithi154 ceph-mon[34853]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:07.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:05:07.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:05:07.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:06 smithi154 ceph-mon[34853]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T22:05:07.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:05:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:05:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:07 smithi150 ceph-mon[30886]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:05:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:07 smithi150 ceph-mon[30886]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:07.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:05:07.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:07 smithi169 ceph-mon[35850]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:05:07.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:07 smithi169 ceph-mon[35850]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:05:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:07 smithi154 ceph-mon[34853]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:05:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:07 smithi154 ceph-mon[34853]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:08.327 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49527]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:05:08.328 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49527]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:08.328 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:08.328 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49527]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:08.926 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:05:08.926 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:08.926 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:08.926 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:05:08 smithi150 sudo[49559]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3795605087' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]: dispatch 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]: dispatch 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]': finished 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:08.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:08.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:05:08.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3795605087' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]: dispatch 2024-09-15T22:05:08.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]: dispatch 2024-09-15T22:05:08.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]': finished 2024-09-15T22:05:08.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:05:08.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:08.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:09.024 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:08 smithi154 sudo[43066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:05:09.025 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:08 smithi154 sudo[43066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:09.025 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:08 smithi154 sudo[43066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:09.025 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:08 smithi154 sudo[43066]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3795605087' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]: dispatch 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]: dispatch 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c82106b6-b1f8-47e1-9be8-631d67fbb09e"}]': finished 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:09.025 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:09.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:09 smithi154 sudo[43069]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:05:09.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:09 smithi154 sudo[43069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:09.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:09 smithi154 sudo[43069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:09.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:05:09 smithi154 sudo[43069]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:09.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:09.687+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f24340d4080 con 0x7f2448102e10 2024-09-15T22:05:09.909 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:09 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2117701115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:05:09.910 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:09 smithi169 ceph-mon[35850]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:09.910 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:09.910 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44918]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:05:09.910 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44918]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:09.910 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:09.910 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44918]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:09.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:09 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2117701115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:05:09.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:09 smithi150 ceph-mon[30886]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:09.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:09 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2117701115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:05:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:09 smithi154 ceph-mon[34853]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:10.209 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44921]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:05:10.210 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:10.210 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:10.210 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:05:09 smithi169 sudo[44921]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:10.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:10 smithi150 sudo[49989]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:05:10.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:10 smithi150 sudo[49989]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:10.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:10 smithi150 sudo[49989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:10.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:10 smithi150 sudo[49989]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 ceph-mon[35850]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 ceph-mon[35850]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44924]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:11.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44924]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 sudo[49998]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:05:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 sudo[49998]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 sudo[49998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 sudo[49998]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 ceph-mon[30886]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:05:11.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:11.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:11 smithi150 ceph-mon[30886]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:11.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 ceph-mon[34853]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:05:11.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:11.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44927]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:05:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44927]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:11 smithi169 sudo[44927]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:12.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 sudo[43072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:05:12.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 sudo[43072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:12.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 sudo[43072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:12.038 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:11 smithi154 sudo[43072]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 sudo[43075]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:05:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 sudo[43075]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:05:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 sudo[43075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:05:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 sudo[43075]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:05:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:05:12.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:05:13.358 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:13 smithi150 ceph-mon[30886]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:13 smithi169 ceph-mon[35850]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:13.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:13 smithi154 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:05:14.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:14 smithi150 ceph-mon[30886]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:14.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:14 smithi169 ceph-mon[35850]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:14 smithi154 ceph-mon[34853]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:16.361 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:16 smithi150 ceph-mon[30886]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:16 smithi169 ceph-mon[35850]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:16 smithi154 ceph-mon[34853]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:18.400 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:18 smithi150 ceph-mon[30886]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-15T22:05:18.401 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:05:18.401 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:18.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:18 smithi169 ceph-mon[35850]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-15T22:05:18.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:05:18.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:18 smithi154 ceph-mon[34853]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-15T22:05:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:05:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:19 smithi150 ceph-mon[30886]: Deploying daemon osd.3 on smithi150 2024-09-15T22:05:19.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:19 smithi169 ceph-mon[35850]: Deploying daemon osd.3 on smithi150 2024-09-15T22:05:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:19 smithi154 ceph-mon[34853]: Deploying daemon osd.3 on smithi150 2024-09-15T22:05:20.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:20 smithi150 ceph-mon[30886]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:05:20.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:20 smithi169 ceph-mon[35850]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:05:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:20 smithi154 ceph-mon[34853]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-15T22:05:22.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:22 smithi150 ceph-mon[30886]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:05:22.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:22 smithi169 ceph-mon[35850]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:05:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:22 smithi154 ceph-mon[34853]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-15T22:05:24.425 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:24 smithi150 ceph-mon[30886]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:05:24.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:24 smithi169 ceph-mon[35850]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:05:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:24 smithi154 ceph-mon[34853]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:05:25.419 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:25.419 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:25.419 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:25.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:25.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:25.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:26.380 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:26 smithi150 ceph-mon[30886]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:05:26.424 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:26 smithi154 ceph-mon[34853]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:05:26.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:26 smithi169 ceph-mon[35850]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:05:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:28 smithi150 ceph-mon[30886]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:05:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:28 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:28 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:28 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:28.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:28 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:28 smithi169 ceph-mon[35850]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:05:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:28 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:28 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:28 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:28 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:28 smithi154 ceph-mon[34853]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-15T22:05:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:29.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:29 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:29.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:29 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:29.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:29 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:29.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.845+0000 7f2444c00640 1 -- 172.21.15.150:0/3256285205 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2448062630 con 0x7f242c0a3260 2024-09-15T22:05:29.848 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 3 on host 'smithi150' 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f242c0a3260 msgr2=0x7f242c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f242c0a3260 0x7f242c0a5720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2448102c70 tx=0x7f2438005f90 comp rx=0 tx=0).stop 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 msgr2=0x7f2448198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 0x7f2448198380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f243400d950 tx=0x7f243400de10 comp rx=0 tx=0).stop 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 shutdown_connections 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24481037d0 0x7f244819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f242c0a3260 0x7f242c0a5720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2448102e10 0x7f2448198380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:29.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 --2- 172.21.15.150:0/3256285205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2448101c10 0x7f2448197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:29.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 >> 172.21.15.150:0/3256285205 conn(0x7f24480fd3c0 msgr2=0x7f2448106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:05:29.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 shutdown_connections 2024-09-15T22:05:29.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:05:29.848+0000 7f244ec00640 1 -- 172.21.15.150:0/3256285205 wait complete. 2024-09-15T22:05:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:30 smithi150 ceph-mon[30886]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:30 smithi169 ceph-mon[35850]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:30 smithi154 ceph-mon[34853]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:30.562 DEBUG:teuthology.orchestra.run.smithi150:osd.3> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T22:05:30.566 INFO:tasks.cephadm:Deploying osd.4 on smithi154 with /dev/vg_nvme/lv_3... 2024-09-15T22:05:30.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:05:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:05:31.888 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:05:31 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:05:31.545+0000 7f319122d640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:05:32.205 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:32 smithi154 ceph-mon[34853]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:32.206 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:32 smithi154 ceph-mon[34853]: from='osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:05:32.206 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:32 smithi154 ceph-mon[34853]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:05:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:32 smithi150 ceph-mon[30886]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:32 smithi150 ceph-mon[30886]: from='osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:05:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:32 smithi150 ceph-mon[30886]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:05:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:32 smithi169 ceph-mon[35850]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:32 smithi169 ceph-mon[35850]: from='osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:05:32.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:32 smithi169 ceph-mon[35850]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:05:33.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:05:33.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-09-15T22:05:33.361 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:05:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:33 smithi154 ceph-mon[34853]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:05:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:33 smithi154 ceph-mon[34853]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:05:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:33 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:33 smithi154 ceph-mon[34853]: from='osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:05:33.388 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:33 smithi154 ceph-mon[34853]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:05:33.454 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:33 smithi150 ceph-mon[30886]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:05:33.454 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:33 smithi150 ceph-mon[30886]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:05:33.454 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:33.454 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:33 smithi150 ceph-mon[30886]: from='osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:05:33.454 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:33 smithi150 ceph-mon[30886]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:05:33.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:33 smithi169 ceph-mon[35850]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:05:33.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:33 smithi169 ceph-mon[35850]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:05:33.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:33.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:33 smithi169 ceph-mon[35850]: from='osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:05:33.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:33 smithi169 ceph-mon[35850]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 -- 172.21.15.154:0/1156768208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 msgr2=0x7f2fc8107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/1156768208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8107400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009900 tx=0x7f2fb402a410 comp rx=0 tx=0).stop 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 -- 172.21.15.154:0/1156768208 shutdown_connections 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/1156768208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc8107940 0x7f2fc8109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/1156768208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8107400 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/1156768208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc81026e0 0x7f2fc8104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 -- 172.21.15.154:0/1156768208 >> 172.21.15.154:0/1156768208 conn(0x7f2fc80fc280 msgr2=0x7f2fc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 -- 172.21.15.154:0/1156768208 shutdown_connections 2024-09-15T22:05:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 -- 172.21.15.154:0/1156768208 wait complete. 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.781+0000 7f2fceaa8640 1 Processor -- start 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 -- start start 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc81026e0 0x7f2fc8102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc8107940 0x7f2fc8100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d850 con 0x7f2fc8107940 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d6d0 con 0x7f2fc8105010 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fceaa8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d9d0 con 0x7f2fc81026e0 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:33.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8100690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45268/0 (socket says 172.21.15.154:45268) 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 -- 172.21.15.154:0/523975807 learned_addr learned my addr 172.21.15.154:0/523975807 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fcd045640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc8107940 0x7f2fc8100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fcc844640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc81026e0 0x7f2fc8102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 -- 172.21.15.154:0/523975807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc81026e0 msgr2=0x7f2fc8102040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc81026e0 0x7f2fc8102040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 -- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc8107940 msgr2=0x7f2fc8100bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc8107940 0x7f2fc8100bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 -- 172.21.15.154:0/523975807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc8101490 con 0x7f2fc8105010 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc7fff640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8100690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4031610 tx=0x7f2fb40043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.782+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb403f030 con 0x7f2fc8105010 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.783+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc81a2090 con 0x7f2fc8105010 2024-09-15T22:05:33.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.783+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fb4003ce0 con 0x7f2fc8105010 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.783+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4035070 con 0x7f2fc8105010 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.783+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc81a2590 con 0x7f2fc8105010 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.784+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc81053f0 con 0x7f2fc8105010 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.785+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f2fb4042030 con 0x7f2fc8105010 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.786+0000 7f2fc5ffb640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2fb80a3240 0x7f2fb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.786+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f2fb40eeb90 con 0x7f2fc8105010 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.786+0000 7f2fcc844640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2fb80a3240 0x7f2fb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.786+0000 7f2fcc844640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2fb80a3240 0x7f2fb80a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc005fd0 tx=0x7f2fbc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:05:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.790+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fb40bcbf0 con 0x7f2fc8105010 2024-09-15T22:05:33.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:33.984+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2fc8062630 con 0x7f2fb80a3240 2024-09-15T22:05:34.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:34.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:05:34.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:05:34.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:34.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:34.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:34.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:34.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:34.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:34 smithi154 ceph-mon[34853]: from='osd.3 ' entity='osd.3' 2024-09-15T22:05:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-mon[30886]: from='osd.3 ' entity='osd.3' 2024-09-15T22:05:34.427 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:05:34.094+0000 7f318b000640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:05:34.427 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:05:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:05:34.113+0000 7f3181a00640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:05:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:05:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:05:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:05:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:34 smithi169 ceph-mon[35850]: from='osd.3 ' entity='osd.3' 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] boot 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: osdmap e23: 4 total, 4 up, 4 in 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:35.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi150 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:35.314 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] boot 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: osdmap e23: 4 total, 4 up, 4 in 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi150 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:35.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:35.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:05:35.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:05:35.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:35.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: osd.3 [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] boot 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: osdmap e23: 4 total, 4 up, 4 in 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi150 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:36.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:36 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi150 to 8544M 2024-09-15T22:05:36.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:36 smithi169 ceph-mon[35850]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 517 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:36 smithi169 ceph-mon[35850]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:05:36.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:36 smithi169 ceph-mon[35850]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:05:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:36 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi150 to 8544M 2024-09-15T22:05:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:36 smithi154 ceph-mon[34853]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 517 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:36 smithi154 ceph-mon[34853]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:05:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:36 smithi154 ceph-mon[34853]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:05:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:36 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi150 to 8544M 2024-09-15T22:05:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:36 smithi150 ceph-mon[30886]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 517 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:36 smithi150 ceph-mon[30886]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:05:36.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:36 smithi150 ceph-mon[30886]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:05:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:37 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/1103962274' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]: dispatch 2024-09-15T22:05:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:37 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]: dispatch 2024-09-15T22:05:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:37 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]': finished 2024-09-15T22:05:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:37 smithi154 ceph-mon[34853]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:05:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:37 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/2493159994' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:05:37.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:37 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/1103962274' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]: dispatch 2024-09-15T22:05:37.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:37 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]: dispatch 2024-09-15T22:05:37.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:37 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]': finished 2024-09-15T22:05:37.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:37 smithi150 ceph-mon[30886]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:05:37.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:37.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:37 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/2493159994' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:05:37.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:37 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/1103962274' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]: dispatch 2024-09-15T22:05:37.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:37 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]: dispatch 2024-09-15T22:05:37.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:37 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d7e1830-827c-415b-b6e2-a495eb3914fb"}]': finished 2024-09-15T22:05:37.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:37 smithi169 ceph-mon[35850]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:05:37.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:37.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:37 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/2493159994' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:05:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:38 smithi154 ceph-mon[34853]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:38 smithi154 ceph-mon[34853]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:05:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:38 smithi150 ceph-mon[30886]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:38 smithi150 ceph-mon[30886]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:05:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:38 smithi169 ceph-mon[35850]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:38 smithi169 ceph-mon[35850]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:05:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:39 smithi154 ceph-mon[34853]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:39.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:39 smithi150 ceph-mon[30886]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:39 smithi169 ceph-mon[35850]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:42.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:42 smithi154 ceph-mon[34853]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:42.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:42 smithi150 ceph-mon[30886]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:42.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:42 smithi169 ceph-mon[35850]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:44.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:44 smithi150 ceph-mon[30886]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:05:44.447 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:44 smithi154 ceph-mon[34853]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:05:44.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:44 smithi169 ceph-mon[35850]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:05:45.209 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:05:45.209 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:05:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:45.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:05:45.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:46.364 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:46 smithi154 ceph-mon[34853]: Deploying daemon osd.4 on smithi154 2024-09-15T22:05:46.364 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:46 smithi154 ceph-mon[34853]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:05:46.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:46 smithi150 ceph-mon[30886]: Deploying daemon osd.4 on smithi154 2024-09-15T22:05:46.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:46 smithi150 ceph-mon[30886]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:05:46.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:46 smithi169 ceph-mon[35850]: Deploying daemon osd.4 on smithi154 2024-09-15T22:05:46.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:46 smithi169 ceph-mon[35850]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:05:48.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:48 smithi154 ceph-mon[34853]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:05:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:48 smithi150 ceph-mon[30886]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:05:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:48 smithi169 ceph-mon[35850]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:05:50.287 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:50 smithi154 ceph-mon[34853]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:05:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:50 smithi150 ceph-mon[30886]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:05:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:50 smithi169 ceph-mon[35850]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:05:51.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:51.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:51.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:51.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:51.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:51.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:52 smithi150 ceph-mon[30886]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:05:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:52 smithi169 ceph-mon[35850]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:05:52.465 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:52 smithi154 ceph-mon[34853]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:05:53.853 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.853 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.853 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:53.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:53.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:53 smithi154 ceph-mon[34853]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:05:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:53 smithi150 ceph-mon[30886]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:05:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:53.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:53.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:53.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:53 smithi169 ceph-mon[35850]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:05:54.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.185+0000 7f2fc5ffb640 1 -- 172.21.15.154:0/523975807 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2fc8062630 con 0x7f2fb80a3240 2024-09-15T22:05:54.187 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 4 on host 'smithi154' 2024-09-15T22:05:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2fb80a3240 msgr2=0x7f2fb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2fb80a3240 0x7f2fb80a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc005fd0 tx=0x7f2fbc005850 comp rx=0 tx=0).stop 2024-09-15T22:05:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 msgr2=0x7f2fc8100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8100690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4031610 tx=0x7f2fb40043b0 comp rx=0 tx=0).stop 2024-09-15T22:05:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 shutdown_connections 2024-09-15T22:05:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2fb80a3240 0x7f2fb80a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc8107940 0x7f2fc8100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fc8105010 0x7f2fc8100690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 --2- 172.21.15.154:0/523975807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc81026e0 0x7f2fc8102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.187+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 >> 172.21.15.154:0/523975807 conn(0x7f2fc80fc280 msgr2=0x7f2fc8103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:05:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.188+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 shutdown_connections 2024-09-15T22:05:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:05:54.188+0000 7f2fceaa8640 1 -- 172.21.15.154:0/523975807 wait complete. 2024-09-15T22:05:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:54.801 DEBUG:teuthology.orchestra.run.smithi154:osd.4> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T22:05:54.803 INFO:tasks.cephadm:Deploying osd.5 on smithi169 with /dev/vg_nvme/lv_3... 2024-09-15T22:05:54.803 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:05:54.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:54.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:54.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:54.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:05:54.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:54.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:55.068 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:05:55.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:55 smithi169 ceph-mon[35850]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:55 smithi150 ceph-mon[30886]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:56.003 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:55 smithi154 ceph-mon[34853]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:56.968 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:56 smithi154 ceph-mon[34853]: from='osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:05:56.985 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:56 smithi154 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:05:56.986 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:05:56 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:05:56.715+0000 7fa6472f9640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:05:57.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:56 smithi150 ceph-mon[30886]: from='osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:05:57.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:56 smithi150 ceph-mon[30886]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:05:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:56 smithi169 ceph-mon[35850]: from='osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:05:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:56 smithi169 ceph-mon[35850]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:05:57.412 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:05:57.437 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_3 2024-09-15T22:05:57.686 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:05:58.077 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:58.078 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:58.079 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.079 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:57 smithi150 ceph-mon[30886]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:05:58.079 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:58.080 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:58.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.081 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:57 smithi169 ceph-mon[35850]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:05:58.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 -- 172.21.15.169:0/3584116923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 msgr2=0x7f10f0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:58.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 --2- 172.21.15.169:0/3584116923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0100f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009900 tx=0x7f10e002a410 comp rx=0 tx=0).stop 2024-09-15T22:05:58.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 -- 172.21.15.169:0/3584116923 shutdown_connections 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 --2- 172.21.15.169:0/3584116923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f01026d0 0x7f10f0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 --2- 172.21.15.169:0/3584116923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f0101d10 0x7f10f0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 --2- 172.21.15.169:0/3584116923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0100f10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 -- 172.21.15.169:0/3584116923 >> 172.21.15.169:0/3584116923 conn(0x7f10f00fc2a0 msgr2=0x7f10f00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 -- 172.21.15.169:0/3584116923 shutdown_connections 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.161+0000 7f10f6429640 1 -- 172.21.15.169:0/3584116923 wait complete. 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 Processor -- start 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 -- start start 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0104c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0101d10 0x7f10f01032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:58.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f01026d0 0x7f10f0103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f10f010c7a0 con 0x7f10f01026d0 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f10f010c620 con 0x7f10f0101d10 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10f6429640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10f010c920 con 0x7f10f0100b10 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10effff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0104c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10effff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0104c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:50024/0 (socket says 172.21.15.169:50024) 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10effff640 1 -- 172.21.15.169:0/212276279 learned_addr learned my addr 172.21.15.169:0/212276279 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.162+0000 7f10ef7fe640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0101d10 0x7f10f01032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:58.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10f49c6640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f01026d0 0x7f10f0103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10effff640 1 -- 172.21.15.169:0/212276279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0101d10 msgr2=0x7f10f01032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10effff640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0101d10 0x7f10f01032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10effff640 1 -- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f01026d0 msgr2=0x7f10f0103820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10effff640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f01026d0 0x7f10f0103820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10effff640 1 -- 172.21.15.169:0/212276279 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f01040e0 con 0x7f10f0100b10 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10f49c6640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f01026d0 0x7f10f0103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10effff640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0104c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f10e0031610 tx=0x7f10e0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e003f030 con 0x7f10f0100b10 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10e0003ad0 con 0x7f10f0100b10 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f01a2020 con 0x7f10f0100b10 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0035070 con 0x7f10f0100b10 2024-09-15T22:05:58.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.163+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f01a24d0 con 0x7f10f0100b10 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.164+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f0108a50 con 0x7f10f0100b10 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.165+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f10e0042030 con 0x7f10f0100b10 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.166+0000 7f10ed7fa640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f10d80a3240 0x7f10d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.166+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f10e00eef00 con 0x7f10f0100b10 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.166+0000 7f10ef7fe640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f10d80a3240 0x7f10d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.167+0000 7f10ef7fe640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f10d80a3240 0x7f10d80a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10f0104a10 tx=0x7f10e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:05:58.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.170+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10e00bcdb0 con 0x7f10f0100b10 2024-09-15T22:05:58.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:05:58.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:05:58.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:05:58.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:58.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:05:58.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:58.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:05:58.273 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:05:58.274 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:57 smithi154 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:05:58.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:05:58.346+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f10f0062630 con 0x7f10d80a3240 2024-09-15T22:05:58.878 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:05:58.597+0000 7fa643a90640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:05:58.878 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:05:58.603+0000 7fa63b08b640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:05:58.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi154 2024-09-15T22:05:58.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-15T22:05:58.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:05:58.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:58.878 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:58.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:58.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:58.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:58.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='osd.4 ' entity='osd.4' 2024-09-15T22:05:58.879 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:58 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi154 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='osd.4 ' entity='osd.4' 2024-09-15T22:05:59.049 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:58 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi154 2024-09-15T22:05:59.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-15T22:05:59.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:05:59.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:05:59.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:05:59.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:05:59.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='osd.4 ' entity='osd.4' 2024-09-15T22:05:59.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:58 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] boot 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: osdmap e30: 5 total, 5 up, 5 in 2024-09-15T22:05:59.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:05:59 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] boot 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: osdmap e30: 5 total, 5 up, 5 in 2024-09-15T22:06:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:05:59 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:06:00.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:06:00.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:06:00.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:00.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:06:00.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: osd.4 [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] boot 2024-09-15T22:06:00.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: osdmap e30: 5 total, 5 up, 5 in 2024-09-15T22:06:00.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:05:59 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:06:01.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:00 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/2702760870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]: dispatch 2024-09-15T22:06:01.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:00 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]: dispatch 2024-09-15T22:06:01.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:00 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]': finished 2024-09-15T22:06:01.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:00 smithi150 ceph-mon[30886]: osdmap e31: 6 total, 5 up, 6 in 2024-09-15T22:06:01.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:01.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:00 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/2702760870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]: dispatch 2024-09-15T22:06:01.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:00 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]: dispatch 2024-09-15T22:06:01.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:00 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]': finished 2024-09-15T22:06:01.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:00 smithi169 ceph-mon[35850]: osdmap e31: 6 total, 5 up, 6 in 2024-09-15T22:06:01.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:01.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:00 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/2702760870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]: dispatch 2024-09-15T22:06:01.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:00 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]: dispatch 2024-09-15T22:06:01.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:00 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8835e251-fc59-4515-b973-ee290b8c9093"}]': finished 2024-09-15T22:06:01.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:00 smithi154 ceph-mon[34853]: osdmap e31: 6 total, 5 up, 6 in 2024-09-15T22:06:01.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:02.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:01 smithi150 ceph-mon[30886]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:02.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:01 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/2548507563' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:02.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:01 smithi169 ceph-mon[35850]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:02.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:01 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/2548507563' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:02.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:01 smithi154 ceph-mon[34853]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:02.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:01 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/2548507563' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:04.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:04 smithi150 ceph-mon[30886]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:04.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:04 smithi169 ceph-mon[35850]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:04 smithi154 ceph-mon[34853]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:06.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:06 smithi169 ceph-mon[35850]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:06 smithi150 ceph-mon[30886]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:06 smithi154 ceph-mon[34853]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:08.259 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:08 smithi169 ceph-mon[35850]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:08.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:08 smithi150 ceph-mon[30886]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:08 smithi154 ceph-mon[34853]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:10 smithi150 ceph-mon[30886]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:06:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:10 smithi169 ceph-mon[35850]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:06:10.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:10 smithi154 ceph-mon[34853]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:10.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:06:10.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:11 smithi150 ceph-mon[30886]: Deploying daemon osd.5 on smithi169 2024-09-15T22:06:11.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:11 smithi169 ceph-mon[35850]: Deploying daemon osd.5 on smithi169 2024-09-15T22:06:11.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:11 smithi154 ceph-mon[34853]: Deploying daemon osd.5 on smithi169 2024-09-15T22:06:12.395 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:12 smithi169 ceph-mon[35850]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:12.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:12 smithi150 ceph-mon[30886]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:12 smithi154 ceph-mon[34853]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:14.367 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:14 smithi169 ceph-mon[35850]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:14.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:14 smithi150 ceph-mon[30886]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:14 smithi154 ceph-mon[34853]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:16.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:16 smithi169 ceph-mon[35850]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:16.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:16 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:16.336 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:16 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:16.336 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:16 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:16.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:16 smithi150 ceph-mon[30886]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:16.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:16 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:16.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:16 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:16.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:16 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:16 smithi154 ceph-mon[34853]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:16 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:16 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:16 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:18 smithi150 ceph-mon[30886]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:18.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:18 smithi169 ceph-mon[35850]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:18.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:18.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:18.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:18 smithi154 ceph-mon[34853]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:18.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.944+0000 7f10ed7fa640 1 -- 172.21.15.169:0/212276279 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10f0062630 con 0x7f10d80a3240 2024-09-15T22:06:18.947 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 5 on host 'smithi169' 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f10d80a3240 msgr2=0x7f10d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f10d80a3240 0x7f10d80a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10f0104a10 tx=0x7f10e400b390 comp rx=0 tx=0).stop 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 msgr2=0x7f10f0104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0104c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f10e0031610 tx=0x7f10e0004270 comp rx=0 tx=0).stop 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 shutdown_connections 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f10d80a3240 0x7f10d80a5700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f01026d0 0x7f10f0103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0101d10 0x7f10f01032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:18.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 --2- 172.21.15.169:0/212276279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10f0100b10 0x7f10f0104c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:18.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 >> 172.21.15.169:0/212276279 conn(0x7f10f00fc2a0 msgr2=0x7f10f00fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:18.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 shutdown_connections 2024-09-15T22:06:18.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:06:18.946+0000 7f10f6429640 1 -- 172.21.15.169:0/212276279 wait complete. 2024-09-15T22:06:19.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:19.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:19.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:19.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:19.645 DEBUG:teuthology.orchestra.run.smithi169:osd.5> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T22:06:19.647 INFO:tasks.cephadm:Deploying osd.6 on smithi150 with /dev/vg_nvme/lv_2... 2024-09-15T22:06:19.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:06:20.019 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:06:20.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:20 smithi150 ceph-mon[30886]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:20.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:20 smithi169 ceph-mon[35850]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:20 smithi154 ceph-mon[34853]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:21.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:06:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:06:21.543+0000 7fa90bd4b640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:06:22.256 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:22 smithi150 ceph-mon[30886]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:22.256 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:22 smithi150 ceph-mon[30886]: from='osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:06:22.256 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:22 smithi150 ceph-mon[30886]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:06:22.313 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:22 smithi169 ceph-mon[35850]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:22.314 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:22 smithi169 ceph-mon[35850]: from='osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:06:22.314 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:22 smithi169 ceph-mon[35850]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:06:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:22 smithi154 ceph-mon[34853]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:22 smithi154 ceph-mon[34853]: from='osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:06:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:22 smithi154 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:06:23.163 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:06:23.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_2 2024-09-15T22:06:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:23.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:23.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:06:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:23.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:06:23.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:23.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:23.604 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 -- 172.21.15.150:0/2769133557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd60074b40 msgr2=0x7fdd60074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 --2- 172.21.15.150:0/2769133557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd60074b40 0x7fdd60074fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009900 tx=0x7fdd4c02a410 comp rx=0 tx=0).stop 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 -- 172.21.15.150:0/2769133557 shutdown_connections 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 --2- 172.21.15.150:0/2769133557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd60109a70 0x7fdd6010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 --2- 172.21.15.150:0/2769133557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd60074b40 0x7fdd60074fa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 --2- 172.21.15.150:0/2769133557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd600761a0 0x7fdd60074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:24.133 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 -- 172.21.15.150:0/2769133557 >> 172.21.15.150:0/2769133557 conn(0x7fdd600fd390 msgr2=0x7fdd600ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:24.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 -- 172.21.15.150:0/2769133557 shutdown_connections 2024-09-15T22:06:24.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.130+0000 7fdd66400640 1 -- 172.21.15.150:0/2769133557 wait complete. 2024-09-15T22:06:24.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.131+0000 7fdd66400640 1 Processor -- start 2024-09-15T22:06:24.134 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.131+0000 7fdd66400640 1 -- start start 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.131+0000 7fdd66400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd60074b40 0x7fdd6019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.131+0000 7fdd66400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd600761a0 0x7fdd6019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.131+0000 7fdd66400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 0x7fdd601a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.131+0000 7fdd66400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6010fa70 con 0x7fdd600761a0 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd66400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6010f8f0 con 0x7fdd60074b40 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd66400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6010fbf0 con 0x7fdd60109a70 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 0x7fdd601a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd600761a0 0x7fdd6019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 0x7fdd601a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:53248/0 (socket says 172.21.15.150:53248) 2024-09-15T22:06:24.136 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd600761a0 0x7fdd6019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33302/0 (socket says 172.21.15.150:33302) 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 -- 172.21.15.150:0/582499460 learned_addr learned my addr 172.21.15.150:0/582499460 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5f400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd60074b40 0x7fdd6019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 -- 172.21.15.150:0/582499460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd60074b40 msgr2=0x7fdd6019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd60074b40 0x7fdd6019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 -- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd600761a0 msgr2=0x7fdd6019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd600761a0 0x7fdd6019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 -- 172.21.15.150:0/582499460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd601a1d00 con 0x7fdd60109a70 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.132+0000 7fdd5fe00640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 0x7fdd601a1690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800eb10 tx=0x7fdd5800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.133+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58004b20 con 0x7fdd60109a70 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.133+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd58004cc0 con 0x7fdd60109a70 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.133+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58010760 con 0x7fdd60109a70 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.133+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd601a1ff0 con 0x7fdd60109a70 2024-09-15T22:06:24.137 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.133+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd601a24a0 con 0x7fdd60109a70 2024-09-15T22:06:24.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.134+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd60108880 con 0x7fdd60109a70 2024-09-15T22:06:24.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.136+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fdd58005020 con 0x7fdd60109a70 2024-09-15T22:06:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.137+0000 7fdd57e00640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdd440a32f0 0x7fdd440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.137+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4253+0+0 (secure 0 0 0) 0x7fdd580ceeb0 con 0x7fdd60109a70 2024-09-15T22:06:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.137+0000 7fdd5f400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdd440a32f0 0x7fdd440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:24.139 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.138+0000 7fdd5f400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdd440a32f0 0x7fdd440a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009bd0 tx=0x7fdd50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:24.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.140+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd5809cb10 con 0x7fdd60109a70 2024-09-15T22:06:24.333 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:24.331+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fdd60062630 con 0x7fdd440a32f0 2024-09-15T22:06:24.333 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi169 2024-09-15T22:06:24.333 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-15T22:06:24.333 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:24.333 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:06:24.333 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:06:24.334 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:24.334 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:24.334 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:24 smithi150 ceph-mon[30886]: from='osd.5 ' entity='osd.5' 2024-09-15T22:06:24.361 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:06:23.969+0000 7fa9084e2640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:06:24.361 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:06:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:06:23.980+0000 7fa8ffadd640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi169 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:24.362 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:24 smithi169 ceph-mon[35850]: from='osd.5 ' entity='osd.5' 2024-09-15T22:06:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi169 2024-09-15T22:06:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-15T22:06:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:06:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:06:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:24 smithi154 ceph-mon[34853]: from='osd.5 ' entity='osd.5' 2024-09-15T22:06:25.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:06:25.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:06:25.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:25.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] boot 2024-09-15T22:06:25.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: osdmap e34: 6 total, 6 up, 6 in 2024-09-15T22:06:25.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:25.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:06:25.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:06:25.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] boot 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: osdmap e34: 6 total, 6 up, 6 in 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:06:25.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:06:25.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:06:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:06:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: osd.5 [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] boot 2024-09-15T22:06:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: osdmap e34: 6 total, 6 up, 6 in 2024-09-15T22:06:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:06:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:06:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:06:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:26 smithi150 ceph-mon[30886]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:26 smithi150 ceph-mon[30886]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:26 smithi150 ceph-mon[30886]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:06:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:26 smithi154 ceph-mon[34853]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:26 smithi154 ceph-mon[34853]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:26 smithi154 ceph-mon[34853]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:06:26.603 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:26 smithi169 ceph-mon[35850]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:26.603 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:26 smithi169 ceph-mon[35850]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:06:26.603 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:26 smithi169 ceph-mon[35850]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:06:27.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:27 smithi150 ceph-mon[30886]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:06:27.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:27 smithi150 ceph-mon[30886]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:06:27.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:27 smithi154 ceph-mon[34853]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:06:27.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:27 smithi154 ceph-mon[34853]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:06:27.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:27 smithi169 ceph-mon[35850]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:06:27.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:27 smithi169 ceph-mon[35850]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:06:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:28 smithi150 ceph-mon[30886]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:28 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1544631348' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6debad2-ff5e-42e8-941d-5568a5d7d9dc"}]: dispatch 2024-09-15T22:06:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:28 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1544631348' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6debad2-ff5e-42e8-941d-5568a5d7d9dc"}]': finished 2024-09-15T22:06:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:28 smithi150 ceph-mon[30886]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:06:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:28 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:28 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1939327797' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:28 smithi154 ceph-mon[34853]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1544631348' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6debad2-ff5e-42e8-941d-5568a5d7d9dc"}]: dispatch 2024-09-15T22:06:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1544631348' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6debad2-ff5e-42e8-941d-5568a5d7d9dc"}]': finished 2024-09-15T22:06:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:28 smithi154 ceph-mon[34853]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:06:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:28 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1939327797' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:28 smithi169 ceph-mon[35850]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:28 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1544631348' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6debad2-ff5e-42e8-941d-5568a5d7d9dc"}]: dispatch 2024-09-15T22:06:28.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:28 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1544631348' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6debad2-ff5e-42e8-941d-5568a5d7d9dc"}]': finished 2024-09-15T22:06:28.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:28 smithi169 ceph-mon[35850]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:06:28.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:28 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:28.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:28 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1939327797' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:30 smithi154 ceph-mon[34853]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:30.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:30 smithi150 ceph-mon[30886]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:30 smithi169 ceph-mon[35850]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:32 smithi154 ceph-mon[34853]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:32.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:32 smithi150 ceph-mon[30886]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:32 smithi169 ceph-mon[35850]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:33.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:33 smithi150 ceph-mon[30886]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:06:33.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:33 smithi154 ceph-mon[34853]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:06:33.712 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:33 smithi169 ceph-mon[35850]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:06:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:36 smithi150 ceph-mon[30886]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-15T22:06:36.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:36 smithi169 ceph-mon[35850]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-15T22:06:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:36 smithi154 ceph-mon[34853]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-15T22:06:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:06:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:37.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:06:37.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:06:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:38 smithi150 ceph-mon[30886]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:06:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:38 smithi150 ceph-mon[30886]: Deploying daemon osd.6 on smithi150 2024-09-15T22:06:38.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:38 smithi169 ceph-mon[35850]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:06:38.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:38 smithi169 ceph-mon[35850]: Deploying daemon osd.6 on smithi150 2024-09-15T22:06:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:38 smithi154 ceph-mon[34853]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:06:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:38 smithi154 ceph-mon[34853]: Deploying daemon osd.6 on smithi150 2024-09-15T22:06:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:40 smithi150 ceph-mon[30886]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:06:40.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:40 smithi169 ceph-mon[35850]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:06:40.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:40 smithi154 ceph-mon[34853]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:06:42.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:42 smithi150 ceph-mon[30886]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:06:42.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:42 smithi169 ceph-mon[35850]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:06:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:42 smithi154 ceph-mon[34853]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:06:44.405 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:44 smithi150 ceph-mon[30886]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:06:44.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:44 smithi169 ceph-mon[35850]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:06:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:44 smithi154 ceph-mon[34853]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:06:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:45.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:45.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:45.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:46.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:46 smithi150 ceph-mon[30886]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:46.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:46 smithi169 ceph-mon[35850]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:46 smithi154 ceph-mon[34853]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:48 smithi150 ceph-mon[30886]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:48 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:48 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:48 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:48.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:48 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:48.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:48 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:48 smithi169 ceph-mon[35850]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:48 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:48 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:48 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:48.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:48 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:48.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:48 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:48 smithi154 ceph-mon[34853]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:48 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:48 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:48 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:48 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:48 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:49.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.224+0000 7fdd57e00640 1 -- 172.21.15.150:0/582499460 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdd60062630 con 0x7fdd440a32f0 2024-09-15T22:06:49.227 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 6 on host 'smithi150' 2024-09-15T22:06:49.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdd440a32f0 msgr2=0x7fdd440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:49.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdd440a32f0 0x7fdd440a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009bd0 tx=0x7fdd50005f90 comp rx=0 tx=0).stop 2024-09-15T22:06:49.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 msgr2=0x7fdd601a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:49.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 0x7fdd601a1690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800eb10 tx=0x7fdd5800c2d0 comp rx=0 tx=0).stop 2024-09-15T22:06:49.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 shutdown_connections 2024-09-15T22:06:49.229 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd60109a70 0x7fdd601a1690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:49.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdd440a32f0 0x7fdd440a57b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:49.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd600761a0 0x7fdd6019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:49.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 --2- 172.21.15.150:0/582499460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd60074b40 0x7fdd6019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:49.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 >> 172.21.15.150:0/582499460 conn(0x7fdd600fd390 msgr2=0x7fdd60105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:49.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 shutdown_connections 2024-09-15T22:06:49.230 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:06:49.227+0000 7fdd66400640 1 -- 172.21.15.150:0/582499460 wait complete. 2024-09-15T22:06:49.924 DEBUG:teuthology.orchestra.run.smithi150:osd.6> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T22:06:49.928 INFO:tasks.cephadm:Deploying osd.7 on smithi154 with /dev/vg_nvme/lv_2... 2024-09-15T22:06:49.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:06:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:06:50.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:50 smithi154 ceph-mon[34853]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:50.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:50.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:50.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:50 smithi169 ceph-mon[35850]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:50.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:50.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:50.480 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:50 smithi150 ceph-mon[30886]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:50.480 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:50.480 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:50.480 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:51.177 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:06:51 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:06:51.038+0000 7fea52893640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:06:51.443 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:51 smithi150 ceph-mon[30886]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:06:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:51 smithi169 ceph-mon[35850]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:06:51.515 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:51 smithi154 ceph-mon[34853]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:06:52.413 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:52 smithi154 ceph-mon[34853]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:52.413 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:52 smithi154 ceph-mon[34853]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:06:52.413 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:52 smithi154 ceph-mon[34853]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:06:52.413 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:52 smithi154 ceph-mon[34853]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:06:52.413 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:52 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:52 smithi169 ceph-mon[35850]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:52 smithi169 ceph-mon[35850]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:06:52.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:52 smithi169 ceph-mon[35850]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:06:52.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:52 smithi169 ceph-mon[35850]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:06:52.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:52 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:52.617 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-mon[30886]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:52.617 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-mon[30886]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:06:52.617 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-mon[30886]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:06:52.617 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-mon[30886]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:06:52.618 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:52.618 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:06:52.209+0000 7fea4ce00640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:06:52.618 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:06:52 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:06:52.218+0000 7fea48800640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:06:52.735 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:06:52.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-09-15T22:06:53.014 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:06:53.384 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:53 smithi154 ceph-mon[34853]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:06:53.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:53 smithi154 ceph-mon[34853]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:06:53.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:53.385 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:53 smithi169 ceph-mon[35850]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:06:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:53 smithi169 ceph-mon[35850]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:06:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:53.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 -- 172.21.15.154:0/2119268927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 msgr2=0x7f98f8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:53.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 --2- 172.21.15.154:0/2119268927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f8103280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009900 tx=0x7f98e802a410 comp rx=0 tx=0).stop 2024-09-15T22:06:53.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 -- 172.21.15.154:0/2119268927 shutdown_connections 2024-09-15T22:06:53.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 --2- 172.21.15.154:0/2119268927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f81037c0 0x7f98f810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 --2- 172.21.15.154:0/2119268927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f8103280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 --2- 172.21.15.154:0/2119268927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f8101c00 0x7f98f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 -- 172.21.15.154:0/2119268927 >> 172.21.15.154:0/2119268927 conn(0x7f98f80fd390 msgr2=0x7f98f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 -- 172.21.15.154:0/2119268927 shutdown_connections 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.471+0000 7f99003e9640 1 -- 172.21.15.154:0/2119268927 wait complete. 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 Processor -- start 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 -- start start 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8101c00 0x7f98f8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f81037c0 0x7f98f819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98f810d900 con 0x7f98f81037c0 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98f810d780 con 0x7f98f8102e00 2024-09-15T22:06:53.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f99003e9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98f810da80 con 0x7f98f8101c00 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f81984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46276/0 (socket says 172.21.15.154:46276) 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 -- 172.21.15.154:0/1820430758 learned_addr learned my addr 172.21.15.154:0/1820430758 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fe986640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f81037c0 0x7f98f819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fe185640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8101c00 0x7f98f8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 -- 172.21.15.154:0/1820430758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8101c00 msgr2=0x7f98f8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8101c00 0x7f98f8197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 -- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f81037c0 msgr2=0x7f98f819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f81037c0 0x7f98f819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fd984640 1 -- 172.21.15.154:0/1820430758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f819fbb0 con 0x7f98f8102e00 2024-09-15T22:06:53.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.472+0000 7f98fe185640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8101c00 0x7f98f8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.473+0000 7f98fd984640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f81984c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009230 tx=0x7f98e8004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.473+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e803f030 con 0x7f98f8102e00 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.473+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98e8003ce0 con 0x7f98f8102e00 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.473+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8035070 con 0x7f98f8102e00 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.473+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f819fe40 con 0x7f98f8102e00 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.473+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81a02c0 con 0x7f98f8102e00 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.474+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8108fa0 con 0x7f98f8102e00 2024-09-15T22:06:53.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.475+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f98e8042030 con 0x7f98f8102e00 2024-09-15T22:06:53.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.476+0000 7f98ef7fe640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f98e40a32f0 0x7f98e40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.476+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4965+0+0 (secure 0 0 0) 0x7f98e80ef230 con 0x7f98f8102e00 2024-09-15T22:06:53.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.476+0000 7f98fe185640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f98e40a32f0 0x7f98e40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.476+0000 7f98fe185640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f98e40a32f0 0x7f98e40a57b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98f4006fd0 tx=0x7f98f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:53.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.480+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98e80bcc60 con 0x7f98f8102e00 2024-09-15T22:06:53.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:06:53.659+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f98f8062630 con 0x7f98e40a32f0 2024-09-15T22:06:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:53 smithi150 ceph-mon[30886]: from='osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:06:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:53 smithi150 ceph-mon[30886]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:06:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] boot 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: osdmap e41: 7 total, 7 up, 7 in 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.339 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:06:54.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:54 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] boot 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: osdmap e41: 7 total, 7 up, 7 in 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:54.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:54.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:06:54.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:06:54.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:54 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:06:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:06:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:06:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: osd.6 [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] boot 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: osdmap e41: 7 total, 7 up, 7 in 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:06:54.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:54 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:55.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:55 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi150 2024-09-15T22:06:55.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:55 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi150 to 5696M 2024-09-15T22:06:55.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:55 smithi154 ceph-mon[34853]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:55.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:55 smithi154 ceph-mon[34853]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:06:55.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:55 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi150 2024-09-15T22:06:55.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:55 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi150 to 5696M 2024-09-15T22:06:55.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:55 smithi169 ceph-mon[35850]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:55.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:55 smithi169 ceph-mon[35850]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:06:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:55 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi150 2024-09-15T22:06:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:55 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi150 to 5696M 2024-09-15T22:06:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:55 smithi150 ceph-mon[30886]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:55 smithi150 ceph-mon[30886]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:06:56.354 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:56 smithi154 ceph-mon[34853]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:06:56.354 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:56 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/1365774113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]: dispatch 2024-09-15T22:06:56.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:56 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]: dispatch 2024-09-15T22:06:56.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:56 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]': finished 2024-09-15T22:06:56.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:56 smithi154 ceph-mon[34853]: osdmap e43: 8 total, 7 up, 8 in 2024-09-15T22:06:56.355 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:56 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:06:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:56 smithi150 ceph-mon[30886]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:06:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:56 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/1365774113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]: dispatch 2024-09-15T22:06:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:56 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]: dispatch 2024-09-15T22:06:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:56 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]': finished 2024-09-15T22:06:56.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:56 smithi150 ceph-mon[30886]: osdmap e43: 8 total, 7 up, 8 in 2024-09-15T22:06:56.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:06:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:56 smithi169 ceph-mon[35850]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:06:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:56 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/1365774113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]: dispatch 2024-09-15T22:06:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:56 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]: dispatch 2024-09-15T22:06:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:56 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2fe39e3-34ef-4b27-a7ab-688f0497e893"}]': finished 2024-09-15T22:06:56.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:56 smithi169 ceph-mon[35850]: osdmap e43: 8 total, 7 up, 8 in 2024-09-15T22:06:56.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:56 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:06:57.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:57 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/1610534675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:57.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:57 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/1610534675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:57.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:57 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/1610534675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:06:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:06:58 smithi154 ceph-mon[34853]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:06:58.577 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:06:58 smithi150 ceph-mon[30886]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:06:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:06:58 smithi169 ceph-mon[35850]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:00 smithi154 ceph-mon[34853]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:00 smithi150 ceph-mon[30886]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:00 smithi169 ceph-mon[35850]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:02.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:02 smithi154 ceph-mon[34853]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:02.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:02 smithi150 ceph-mon[30886]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:02 smithi169 ceph-mon[35850]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:04.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:04 smithi154 ceph-mon[34853]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:04 smithi150 ceph-mon[30886]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:04 smithi169 ceph-mon[35850]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:05.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:07:05.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:05.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:05 smithi154 ceph-mon[34853]: Deploying daemon osd.7 on smithi154 2024-09-15T22:07:05.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:05 smithi154 ceph-mon[34853]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:05.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:07:05.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:05.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:05 smithi150 ceph-mon[30886]: Deploying daemon osd.7 on smithi154 2024-09-15T22:07:05.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:05 smithi150 ceph-mon[30886]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:07:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:05 smithi169 ceph-mon[35850]: Deploying daemon osd.7 on smithi154 2024-09-15T22:07:05.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:05 smithi169 ceph-mon[35850]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:08.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:08 smithi150 ceph-mon[30886]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:08 smithi169 ceph-mon[35850]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:08.507 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:08 smithi154 ceph-mon[34853]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:10 smithi150 ceph-mon[30886]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:10 smithi169 ceph-mon[35850]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:10.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:10 smithi154 ceph-mon[34853]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:10.495 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:10.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:10.496 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:12.326 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:12 smithi154 ceph-mon[34853]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:12 smithi150 ceph-mon[30886]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:12.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:12 smithi169 ceph-mon[35850]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.415+0000 7f98ef7fe640 1 -- 172.21.15.154:0/1820430758 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f98f8062630 con 0x7f98e40a32f0 2024-09-15T22:07:13.417 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 7 on host 'smithi154' 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f98e40a32f0 msgr2=0x7f98e40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f98e40a32f0 0x7f98e40a57b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98f4006fd0 tx=0x7f98f4008040 comp rx=0 tx=0).stop 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 msgr2=0x7f98f81984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f81984c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009230 tx=0x7f98e8004360 comp rx=0 tx=0).stop 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 shutdown_connections 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f98e40a32f0 0x7f98e40a57b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f81037c0 0x7f98f819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8102e00 0x7f98f81984c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 --2- 172.21.15.154:0/1820430758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98f8101c00 0x7f98f8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 >> 172.21.15.154:0/1820430758 conn(0x7f98f80fd390 msgr2=0x7f98f8106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 shutdown_connections 2024-09-15T22:07:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:07:13.417+0000 7f99003e9640 1 -- 172.21.15.154:0/1820430758 wait complete. 2024-09-15T22:07:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:13.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:13.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:13.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:13.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:14.078 DEBUG:teuthology.orchestra.run.smithi154:osd.7> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T22:07:14.080 INFO:tasks.cephadm:Deploying osd.8 on smithi169 with /dev/vg_nvme/lv_2... 2024-09-15T22:07:14.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:07:14.337 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:07:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:14.678 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:14.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:15.429 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:15 smithi154 ceph-mon[34853]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:15 smithi150 ceph-mon[30886]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:15.702 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:15 smithi169 ceph-mon[35850]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:16.428 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:07:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:07:16.259+0000 7f8887427640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:07:16.575 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:16 smithi169 ceph-mon[35850]: from='osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:07:16.575 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:16 smithi169 ceph-mon[35850]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:07:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:16 smithi154 ceph-mon[34853]: from='osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:07:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:16 smithi154 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:07:16.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:16 smithi150 ceph-mon[30886]: from='osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:07:16.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:16 smithi150 ceph-mon[30886]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:07:16.969 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:07:16.995 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_2 2024-09-15T22:07:17.247 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:07:17.636 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:07:17.636 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:07:17.636 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:07:17.636 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi154 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:17.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:07:17.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:07:17.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:17 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 -- 172.21.15.169:0/1898740126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88100ad0 msgr2=0x7f3a88100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 --2- 172.21.15.169:0/1898740126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88100ad0 0x7f3a88100ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009900 tx=0x7f3a7c02a410 comp rx=0 tx=0).stop 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 -- 172.21.15.169:0/1898740126 shutdown_connections 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 --2- 172.21.15.169:0/1898740126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a88102690 0x7f3a88108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 --2- 172.21.15.169:0/1898740126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a88101cd0 0x7f3a88102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 --2- 172.21.15.169:0/1898740126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88100ad0 0x7f3a88100ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 -- 172.21.15.169:0/1898740126 >> 172.21.15.169:0/1898740126 conn(0x7f3a880fc280 msgr2=0x7f3a880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 -- 172.21.15.169:0/1898740126 shutdown_connections 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.719+0000 7f3a900e2640 1 -- 172.21.15.169:0/1898740126 wait complete. 2024-09-15T22:07:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 Processor -- start 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 -- start start 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a88100ad0 0x7f3a8810b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a88101cd0 0x7f3a88109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 0x7f3a88109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8810d8e0 con 0x7f3a88101cd0 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8810d760 con 0x7f3a88100ad0 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8810da60 con 0x7f3a88102690 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 0x7f3a88109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 0x7f3a88109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39338/0 (socket says 172.21.15.169:39338) 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 -- 172.21.15.169:0/2442195843 learned_addr learned my addr 172.21.15.169:0/2442195843 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:07:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8de7e640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a88100ad0 0x7f3a8810b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 -- 172.21.15.169:0/2442195843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a88100ad0 msgr2=0x7f3a8810b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a88100ad0 0x7f3a8810b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 -- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a88101cd0 msgr2=0x7f3a88109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a88101cd0 0x7f3a88109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 -- 172.21.15.169:0/2442195843 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8810a8a0 con 0x7f3a88102690 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a8e67f640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 0x7f3a88109fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000b970 tx=0x7f3a8000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80019070 con 0x7f3a88102690 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a881a2100 con 0x7f3a88102690 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.720+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a8000cb40 con 0x7f3a88102690 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.721+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80007650 con 0x7f3a88102690 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.721+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a881a2640 con 0x7f3a88102690 2024-09-15T22:07:17.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.722+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a88107f20 con 0x7f3a88102690 2024-09-15T22:07:17.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.723+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f3a8001c070 con 0x7f3a88102690 2024-09-15T22:07:17.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.723+0000 7f3a7affd640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.723+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f3a800ce270 con 0x7f3a88102690 2024-09-15T22:07:17.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.724+0000 7f3a8de7e640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:17.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.724+0000 7f3a8de7e640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3a740a3240 0x7f3a740a5700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c005ab0 tx=0x7f3a7c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:17.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.727+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a8009b5c0 con 0x7f3a88102690 2024-09-15T22:07:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:07:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:07:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:07:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:07:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi154 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:07:17.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:07:17.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:17 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:17.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:17.901+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3a88062630 con 0x7f3a740a3240 2024-09-15T22:07:17.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:07:17.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:07:17.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:07:17.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi154 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:17.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:07:17.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:07:17.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:07:17.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:17 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:18.521 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:07:18.225+0000 7f8882b87640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:07:18.521 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:07:18.237+0000 7f887b1b9640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:07:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='osd.7 ' entity='osd.7' 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] boot 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: osdmap e46: 8 total, 8 up, 8 in 2024-09-15T22:07:18.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:18 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:18.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='osd.7 ' entity='osd.7' 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] boot 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: osdmap e46: 8 total, 8 up, 8 in 2024-09-15T22:07:18.639 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:18 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:18.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:18.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:18.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:07:18.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:07:18.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:18.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='osd.7 ' entity='osd.7' 2024-09-15T22:07:18.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: osd.7 [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] boot 2024-09-15T22:07:18.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: osdmap e46: 8 total, 8 up, 8 in 2024-09-15T22:07:18.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:18 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:07:19.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:19 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:07:19.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:19 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:07:19.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:19 smithi169 ceph-mon[35850]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:19 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:07:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:19 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:07:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:19 smithi154 ceph-mon[34853]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:19 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:07:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:19 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:07:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:19 smithi150 ceph-mon[30886]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:20.678 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:20 smithi169 ceph-mon[35850]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:07:20.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:20 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/731225574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]: dispatch 2024-09-15T22:07:20.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:20 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]: dispatch 2024-09-15T22:07:20.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:20 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]': finished 2024-09-15T22:07:20.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:20 smithi169 ceph-mon[35850]: osdmap e48: 9 total, 8 up, 9 in 2024-09-15T22:07:20.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:20 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:20 smithi154 ceph-mon[34853]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:07:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:20 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/731225574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]: dispatch 2024-09-15T22:07:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:20 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]: dispatch 2024-09-15T22:07:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:20 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]': finished 2024-09-15T22:07:20.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:20 smithi154 ceph-mon[34853]: osdmap e48: 9 total, 8 up, 9 in 2024-09-15T22:07:20.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:20 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:20.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:20 smithi150 ceph-mon[30886]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:07:20.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:20 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/731225574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]: dispatch 2024-09-15T22:07:20.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:20 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]: dispatch 2024-09-15T22:07:20.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:20 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0cfc7ba-4548-480a-9251-906ba609e9cf"}]': finished 2024-09-15T22:07:20.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:20 smithi150 ceph-mon[30886]: osdmap e48: 9 total, 8 up, 9 in 2024-09-15T22:07:20.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:20 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:21.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:21 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/1051744894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:07:21.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:21 smithi169 ceph-mon[35850]: pgmap v177: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:21.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:21 smithi169 ceph-mon[35850]: osdmap e49: 9 total, 8 up, 9 in 2024-09-15T22:07:21.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:21 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:21 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/1051744894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:07:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:21 smithi154 ceph-mon[34853]: pgmap v177: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:21 smithi154 ceph-mon[34853]: osdmap e49: 9 total, 8 up, 9 in 2024-09-15T22:07:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:21 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:21 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/1051744894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:07:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:21 smithi150 ceph-mon[30886]: pgmap v177: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:21 smithi150 ceph-mon[30886]: osdmap e49: 9 total, 8 up, 9 in 2024-09-15T22:07:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:21 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:23 smithi150 ceph-mon[30886]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:07:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:23 smithi169 ceph-mon[35850]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:07:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:23.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:23 smithi154 ceph-mon[34853]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:07:23.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:24.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:24 smithi150 ceph-mon[30886]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:24.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:24 smithi169 ceph-mon[35850]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:24 smithi154 ceph-mon[34853]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:26 smithi150 ceph-mon[30886]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:26.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:26 smithi169 ceph-mon[35850]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:26 smithi154 ceph-mon[34853]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:28.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:28 smithi150 ceph-mon[30886]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:28.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:28 smithi169 ceph-mon[35850]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:28.524 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:28 smithi154 ceph-mon[34853]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:29.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:29 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:07:29.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:29 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:29.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:29 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:07:29.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:29 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:29.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:29 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:07:29.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:29 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:30 smithi150 ceph-mon[30886]: Deploying daemon osd.8 on smithi169 2024-09-15T22:07:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:30 smithi150 ceph-mon[30886]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:30 smithi169 ceph-mon[35850]: Deploying daemon osd.8 on smithi169 2024-09-15T22:07:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:30 smithi169 ceph-mon[35850]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:30 smithi154 ceph-mon[34853]: Deploying daemon osd.8 on smithi169 2024-09-15T22:07:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:30 smithi154 ceph-mon[34853]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:32.375 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:32 smithi169 ceph-mon[35850]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:32 smithi150 ceph-mon[30886]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:32 smithi154 ceph-mon[34853]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:34 smithi150 ceph-mon[30886]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:34.440 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:34 smithi169 ceph-mon[35850]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:34 smithi154 ceph-mon[34853]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:35.411 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:35.411 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:35.411 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:35.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:35.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:35.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:36 smithi150 ceph-mon[30886]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:36.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:36 smithi169 ceph-mon[35850]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:36 smithi154 ceph-mon[34853]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:38.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.201+0000 7f3a7affd640 1 -- 172.21.15.169:0/2442195843 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3a88062630 con 0x7f3a740a3240 2024-09-15T22:07:38.203 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 8 on host 'smithi169' 2024-09-15T22:07:38.203 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:38 smithi169 ceph-mon[35850]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:38.203 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.204 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.204 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:38.204 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:38.204 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.203+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3a740a3240 msgr2=0x7f3a740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:38.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3a740a3240 0x7f3a740a5700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c005ab0 tx=0x7f3a7c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:07:38.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 msgr2=0x7f3a88109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:38.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 0x7f3a88109fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000b970 tx=0x7f3a8000be30 comp rx=0 tx=0).stop 2024-09-15T22:07:38.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 shutdown_connections 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a88102690 0x7f3a88109fe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a88101cd0 0x7f3a88109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 --2- 172.21.15.169:0/2442195843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a88100ad0 0x7f3a8810b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 >> 172.21.15.169:0/2442195843 conn(0x7f3a880fc280 msgr2=0x7f3a881050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 shutdown_connections 2024-09-15T22:07:38.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:07:38.204+0000 7f3a900e2640 1 -- 172.21.15.169:0/2442195843 wait complete. 2024-09-15T22:07:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:38 smithi150 ceph-mon[30886]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:38 smithi154 ceph-mon[34853]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:38.871 DEBUG:teuthology.orchestra.run.smithi169:osd.8> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T22:07:38.874 INFO:tasks.cephadm:Deploying osd.9 on smithi150 with /dev/vg_nvme/lv_1... 2024-09-15T22:07:38.874 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:07:39.252 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:39.389 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:39.389 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:39.389 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:39.390 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:39.390 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:39.390 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:40 smithi150 ceph-mon[30886]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:40.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:40 smithi169 ceph-mon[35850]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:40.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:40 smithi154 ceph-mon[34853]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:41.210 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:07:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:07:40.937+0000 7f384c1c0640 -1 osd.8 0 log_to_monitors true 2024-09-15T22:07:41.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:41 smithi150 ceph-mon[30886]: from='osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:07:41.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:41 smithi150 ceph-mon[30886]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:07:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:41 smithi154 ceph-mon[34853]: from='osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:07:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:41 smithi154 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:07:41.582 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:41 smithi169 ceph-mon[35850]: from='osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:07:41.583 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:41 smithi169 ceph-mon[35850]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:07:42.308 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:42.308 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:42.309 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:42.310 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:07:42.353 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_1 2024-09-15T22:07:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:07:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:07:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:42.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.709 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:07:42.217+0000 7f3847920640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T22:07:42.710 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:07:42.229+0000 7f3843f5a640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:42.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:42.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:42.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:07:42.731 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:43.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 -- 172.21.15.150:0/2821300905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc103e00 msgr2=0x7f07bc104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 --2- 172.21.15.150:0/2821300905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc103e00 0x7f07bc104200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009900 tx=0x7f07ac02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 -- 172.21.15.150:0/2821300905 shutdown_connections 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 --2- 172.21.15.150:0/2821300905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07bc105920 0x7f07bc10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 --2- 172.21.15.150:0/2821300905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc104f60 0x7f07bc1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 --2- 172.21.15.150:0/2821300905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc103e00 0x7f07bc104200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 -- 172.21.15.150:0/2821300905 >> 172.21.15.150:0/2821300905 conn(0x7f07bc0ff5b0 msgr2=0x7f07bc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 -- 172.21.15.150:0/2821300905 shutdown_connections 2024-09-15T22:07:43.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.235+0000 7f07c1c00640 1 -- 172.21.15.150:0/2821300905 wait complete. 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.236+0000 7f07c1c00640 1 Processor -- start 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.236+0000 7f07c1c00640 1 -- start start 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07c1c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 0x7f07bc19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07c1c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc104f60 0x7f07bc19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07c1c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07bc105920 0x7f07bc1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07c1c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10fb00 con 0x7f07bc105920 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07c1c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10f980 con 0x7f07bc104f60 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07c1c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10fc80 con 0x7f07bc103e00 2024-09-15T22:07:43.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 0x7f07bc19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07ba000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc104f60 0x7f07bc19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07bb400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07bc105920 0x7f07bc1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 0x7f07bc19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:42376/0 (socket says 172.21.15.150:42376) 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 -- 172.21.15.150:0/139259736 learned_addr learned my addr 172.21.15.150:0/139259736 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07ba000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc104f60 0x7f07bc19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:39698/0 (socket says 172.21.15.150:39698) 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 -- 172.21.15.150:0/139259736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc104f60 msgr2=0x7f07bc19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc104f60 0x7f07bc19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 -- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07bc105920 msgr2=0x7f07bc1a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07bc105920 0x7f07bc1a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.237+0000 7f07baa00640 1 -- 172.21.15.150:0/139259736 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc1a1d00 con 0x7f07bc103e00 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.238+0000 7f07baa00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 0x7f07bc19a0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f07ac031440 tx=0x7f07ac032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.238+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac03f030 con 0x7f07bc103e00 2024-09-15T22:07:43.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.238+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07ac003ce0 con 0x7f07bc103e00 2024-09-15T22:07:43.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.238+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc1a1f90 con 0x7f07bc103e00 2024-09-15T22:07:43.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.238+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac035070 con 0x7f07bc103e00 2024-09-15T22:07:43.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.238+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc1a2380 con 0x7f07bc103e00 2024-09-15T22:07:43.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.239+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07bc10b1a0 con 0x7f07bc103e00 2024-09-15T22:07:43.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.241+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f07ac042030 con 0x7f07bc103e00 2024-09-15T22:07:43.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.242+0000 7f07b3400640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f07a00a3270 0x7f07a00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:43.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.243+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5862+0+0 (secure 0 0 0) 0x7f07ac0ef530 con 0x7f07bc103e00 2024-09-15T22:07:43.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.243+0000 7f07ba000640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f07a00a3270 0x7f07a00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:43.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.243+0000 7f07ba000640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f07a00a3270 0x7f07a00a5730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07bc19b5f0 tx=0x7f07a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:43.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.246+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07ac0bc4f0 con 0x7f07bc103e00 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi169 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] boot 2024-09-15T22:07:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: osdmap e53: 9 total, 9 up, 9 in 2024-09-15T22:07:43.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:07:43.433+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f07bc062630 con 0x7f07a00a3270 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi169 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] boot 2024-09-15T22:07:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: osdmap e53: 9 total, 9 up, 9 in 2024-09-15T22:07:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi169 2024-09-15T22:07:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-15T22:07:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:07:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:07:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: osd.8 [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] boot 2024-09-15T22:07:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: osdmap e53: 9 total, 9 up, 9 in 2024-09-15T22:07:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:44.329 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:44 smithi150 ceph-mon[30886]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:07:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:07:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:07:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:07:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:07:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:44 smithi154 ceph-mon[34853]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:07:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:07:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:07:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:07:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:07:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:07:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:44 smithi169 ceph-mon[35850]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:07:45.389 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:45 smithi150 ceph-mon[30886]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:45.390 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:45 smithi150 ceph-mon[30886]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:07:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:45 smithi154 ceph-mon[34853]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:45 smithi154 ceph-mon[34853]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:07:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:45 smithi169 ceph-mon[35850]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:45 smithi169 ceph-mon[35850]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:07:46.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:46 smithi150 ceph-mon[30886]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:07:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:46 smithi154 ceph-mon[34853]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:07:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:46 smithi169 ceph-mon[35850]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:07:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:07:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/4013830781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]: dispatch 2024-09-15T22:07:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]: dispatch 2024-09-15T22:07:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]': finished 2024-09-15T22:07:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: osdmap e57: 10 total, 9 up, 10 in 2024-09-15T22:07:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:07:47.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:47 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/298600272' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:07:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:07:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/4013830781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]: dispatch 2024-09-15T22:07:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]: dispatch 2024-09-15T22:07:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]': finished 2024-09-15T22:07:47.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: osdmap e57: 10 total, 9 up, 10 in 2024-09-15T22:07:47.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:07:47.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:47 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/298600272' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:07:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:07:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/4013830781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]: dispatch 2024-09-15T22:07:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]: dispatch 2024-09-15T22:07:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f871001-d0f3-4b56-ab67-15c4c7ac88d9"}]': finished 2024-09-15T22:07:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: osdmap e57: 10 total, 9 up, 10 in 2024-09-15T22:07:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:07:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:47 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/298600272' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:07:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:48 smithi154 ceph-mon[34853]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:07:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:48 smithi150 ceph-mon[30886]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:07:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:48 smithi169 ceph-mon[35850]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:07:49.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:49 smithi150 ceph-mon[30886]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T22:07:49.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:49 smithi169 ceph-mon[35850]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T22:07:49.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:49 smithi154 ceph-mon[34853]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T22:07:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:52 smithi150 ceph-mon[30886]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:07:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:52 smithi169 ceph-mon[35850]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:07:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:52 smithi154 ceph-mon[34853]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:07:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:54 smithi150 ceph-mon[30886]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T22:07:54.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:54 smithi169 ceph-mon[35850]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T22:07:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:54 smithi154 ceph-mon[34853]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T22:07:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:56 smithi150 ceph-mon[30886]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:07:56.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:56 smithi169 ceph-mon[35850]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:07:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:56 smithi154 ceph-mon[34853]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T22:07:57.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:07:57.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:57.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:07:57.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:57.600 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:07:57.601 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:58.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:58 smithi169 ceph-mon[35850]: Deploying daemon osd.9 on smithi150 2024-09-15T22:07:58.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:07:58 smithi169 ceph-mon[35850]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:07:58.467 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:58 smithi150 ceph-mon[30886]: Deploying daemon osd.9 on smithi150 2024-09-15T22:07:58.467 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:07:58 smithi150 ceph-mon[30886]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:07:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:58 smithi154 ceph-mon[34853]: Deploying daemon osd.9 on smithi150 2024-09-15T22:07:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:07:58 smithi154 ceph-mon[34853]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:08:00.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:00 smithi150 ceph-mon[30886]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:08:00.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:00 smithi169 ceph-mon[35850]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:08:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:00 smithi154 ceph-mon[34853]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:08:02.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:02 smithi169 ceph-mon[35850]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:02 smithi154 ceph-mon[34853]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:02.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:02 smithi150 ceph-mon[30886]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:04.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:04 smithi150 ceph-mon[30886]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:04.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:04 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:04.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:04 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:04.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:04 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:04.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:04 smithi169 ceph-mon[35850]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:04.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:04 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:04.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:04 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:04.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:04 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:04 smithi154 ceph-mon[34853]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:04 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:04 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:04 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:06.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:06 smithi169 ceph-mon[35850]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:06 smithi154 ceph-mon[34853]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:06 smithi150 ceph-mon[30886]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:07.387 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 9 on host 'smithi150' 2024-09-15T22:08:07.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.385+0000 7f07b3400640 1 -- 172.21.15.150:0/139259736 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f07bc062630 con 0x7f07a00a3270 2024-09-15T22:08:07.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f07a00a3270 msgr2=0x7f07a00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f07a00a3270 0x7f07a00a5730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07bc19b5f0 tx=0x7f07a800b390 comp rx=0 tx=0).stop 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 msgr2=0x7f07bc19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 0x7f07bc19a0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f07ac031440 tx=0x7f07ac032ce0 comp rx=0 tx=0).stop 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 shutdown_connections 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f07a00a3270 0x7f07a00a5730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07bc105920 0x7f07bc1a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07bc104f60 0x7f07bc19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 --2- 172.21.15.150:0/139259736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07bc103e00 0x7f07bc19a0d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 >> 172.21.15.150:0/139259736 conn(0x7f07bc0ff5b0 msgr2=0x7f07bc108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 shutdown_connections 2024-09-15T22:08:07.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:07.389+0000 7f07c1c00640 1 -- 172.21.15.150:0/139259736 wait complete. 2024-09-15T22:08:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:08.113 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.114 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.149 DEBUG:teuthology.orchestra.run.smithi150:osd.9> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T22:08:08.153 INFO:tasks.cephadm:Deploying osd.10 on smithi154 with /dev/vg_nvme/lv_1... 2024-09-15T22:08:08.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:08:08.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:08.412 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:08:09.813 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:08:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:08:09.698+0000 7fada528d640 -1 osd.9 0 log_to_monitors true 2024-09-15T22:08:10.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:10 smithi154 ceph-mon[34853]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:10.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:10 smithi154 ceph-mon[34853]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:08:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:10 smithi150 ceph-mon[30886]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:10 smithi150 ceph-mon[30886]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:08:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:10 smithi169 ceph-mon[35850]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:10 smithi169 ceph-mon[35850]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:08:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-15T22:08:10.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-09-15T22:08:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:08:11.437 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:08:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:08:11.198+0000 7fad9f800640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T22:08:11.437 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:08:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:08:11.211+0000 7fad9b200640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:08:11.437 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:11 smithi150 ceph-mon[30886]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:08:11.437 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:11 smithi150 ceph-mon[30886]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:08:11.438 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:11 smithi150 ceph-mon[30886]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:08:11.438 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:11.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:11 smithi169 ceph-mon[35850]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:08:11.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:11 smithi169 ceph-mon[35850]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:08:11.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:11 smithi169 ceph-mon[35850]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:08:11.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:11.488 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:11 smithi154 ceph-mon[34853]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:08:11.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:11 smithi154 ceph-mon[34853]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:08:11.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:11 smithi154 ceph-mon[34853]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-09-15T22:08:11.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:11.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 -- 172.21.15.154:0/1640010406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e4102690 msgr2=0x7f41e4104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:11.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/1640010406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e4102690 0x7f41e4104a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009ca0 tx=0x7f41e002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:08:11.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 -- 172.21.15.154:0/1640010406 shutdown_connections 2024-09-15T22:08:11.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/1640010406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e41078f0 0x7f41e4109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:11.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/1640010406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41e4104fc0 0x7f41e41073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:11.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/1640010406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e4102690 0x7f41e4104a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:11.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 -- 172.21.15.154:0/1640010406 >> 172.21.15.154:0/1640010406 conn(0x7f41e40fc270 msgr2=0x7f41e40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:11.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 -- 172.21.15.154:0/1640010406 shutdown_connections 2024-09-15T22:08:11.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 -- 172.21.15.154:0/1640010406 wait complete. 2024-09-15T22:08:11.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 Processor -- start 2024-09-15T22:08:11.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.734+0000 7f41eb7d7640 1 -- start start 2024-09-15T22:08:11.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41e4102690 0x7f41e4198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:11.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4104fc0 0x7f41e4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:11.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 0x7f41e419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:11.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f41e410d910 con 0x7f41e4102690 2024-09-15T22:08:11.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41e410d790 con 0x7f41e41078f0 2024-09-15T22:08:11.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41e410da90 con 0x7f41e4104fc0 2024-09-15T22:08:11.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 0x7f41e419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:11.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 0x7f41e419f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40382/0 (socket says 172.21.15.154:40382) 2024-09-15T22:08:11.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 -- 172.21.15.154:0/3688575059 learned_addr learned my addr 172.21.15.154:0/3688575059 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-15T22:08:11.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e8d72640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4104fc0 0x7f41e4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:11.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 -- 172.21.15.154:0/3688575059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4104fc0 msgr2=0x7f41e4198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:11.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4104fc0 0x7f41e4198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:11.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 -- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41e4102690 msgr2=0x7f41e4198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:11.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41e4102690 0x7f41e4198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:11.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 -- 172.21.15.154:0/3688575059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e419fc30 con 0x7f41e41078f0 2024-09-15T22:08:11.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e8d72640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4104fc0 0x7f41e4198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:08:11.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41e9d74640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 0x7f41e419f5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009fd0 tx=0x7f41dc00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:11.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc011830 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e419ff20 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41dc016070 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.735+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00f2e0 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.736+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e41a0450 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.736+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e40fdd60 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.738+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f41dc0119d0 con 0x7f41e41078f0 2024-09-15T22:08:11.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.739+0000 7f41da7fc640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f41d00a3270 0x7f41d00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:11.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.739+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5981+0+0 (secure 0 0 0) 0x7f41dc0cedf0 con 0x7f41e41078f0 2024-09-15T22:08:11.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.739+0000 7f41e9573640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f41d00a3270 0x7f41d00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:11.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.740+0000 7f41e9573640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f41d00a3270 0x7f41d00a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f41e0004af0 tx=0x7f41e0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:11.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.742+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41dc09c390 con 0x7f41e41078f0 2024-09-15T22:08:11.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:11.928+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f41e4062630 con 0x7f41d00a3270 2024-09-15T22:08:12.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:12.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.489 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:12.490 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-09-15T22:08:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:12.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:12.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:12.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.312 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:08:13.312 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:08:13.312 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi150 2024-09-15T22:08:13.312 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi150 to 4272M 2024-09-15T22:08:13.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:13.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:13.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] boot 2024-09-15T22:08:13.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: osdmap e60: 10 total, 10 up, 10 in 2024-09-15T22:08:13.313 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:08:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:08:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi150 2024-09-15T22:08:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi150 to 4272M 2024-09-15T22:08:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] boot 2024-09-15T22:08:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: osdmap e60: 10 total, 10 up, 10 in 2024-09-15T22:08:13.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:08:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:08:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi150 2024-09-15T22:08:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi150 to 4272M 2024-09-15T22:08:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: osd.9 [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] boot 2024-09-15T22:08:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: osdmap e60: 10 total, 10 up, 10 in 2024-09-15T22:08:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:08:14.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:14 smithi169 ceph-mon[35850]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:14 smithi169 ceph-mon[35850]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:08:14.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:14 smithi154 ceph-mon[34853]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:14.502 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:14 smithi154 ceph-mon[34853]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:08:14.560 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:14 smithi150 ceph-mon[30886]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:08:14.560 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:14 smithi150 ceph-mon[30886]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:08:15.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:15 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/2845065582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]: dispatch 2024-09-15T22:08:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:15 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]: dispatch 2024-09-15T22:08:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:15 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]': finished 2024-09-15T22:08:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:15 smithi169 ceph-mon[35850]: osdmap e62: 11 total, 10 up, 11 in 2024-09-15T22:08:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:15.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:15 smithi169 ceph-mon[35850]: from='client.? 172.21.15.154:0/1145212693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:15 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/2845065582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]: dispatch 2024-09-15T22:08:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:15 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]: dispatch 2024-09-15T22:08:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:15 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]': finished 2024-09-15T22:08:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:15 smithi154 ceph-mon[34853]: osdmap e62: 11 total, 10 up, 11 in 2024-09-15T22:08:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:15 smithi154 ceph-mon[34853]: from='client.? 172.21.15.154:0/1145212693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:15 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/2845065582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]: dispatch 2024-09-15T22:08:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:15 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]: dispatch 2024-09-15T22:08:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:15 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbf9fa28-8307-41a7-8c98-b00697d3c837"}]': finished 2024-09-15T22:08:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:15 smithi150 ceph-mon[30886]: osdmap e62: 11 total, 10 up, 11 in 2024-09-15T22:08:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:15 smithi150 ceph-mon[30886]: from='client.? 172.21.15.154:0/1145212693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:16 smithi169 ceph-mon[35850]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:16 smithi154 ceph-mon[34853]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:16 smithi150 ceph-mon[30886]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:18 smithi154 ceph-mon[34853]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:18 smithi150 ceph-mon[30886]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:18 smithi169 ceph-mon[35850]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:20.304 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:20 smithi154 ceph-mon[34853]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:20.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:20 smithi150 ceph-mon[30886]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:20 smithi169 ceph-mon[35850]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:22.475 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:22 smithi154 ceph-mon[34853]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:22 smithi150 ceph-mon[30886]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:22 smithi169 ceph-mon[35850]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:23.520 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:08:23.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:23.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:08:23.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:23.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:08:23.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:24.483 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:24 smithi154 ceph-mon[34853]: Deploying daemon osd.10 on smithi154 2024-09-15T22:08:24.483 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:24 smithi154 ceph-mon[34853]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:24.610 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:24 smithi169 ceph-mon[35850]: Deploying daemon osd.10 on smithi154 2024-09-15T22:08:24.611 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:24 smithi169 ceph-mon[35850]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:24.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:24 smithi150 ceph-mon[30886]: Deploying daemon osd.10 on smithi154 2024-09-15T22:08:24.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:24 smithi150 ceph-mon[30886]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:26.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:26 smithi154 ceph-mon[34853]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:26.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:26 smithi150 ceph-mon[30886]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:26 smithi169 ceph-mon[35850]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:28.340 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:28 smithi154 ceph-mon[34853]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:28.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:28 smithi150 ceph-mon[30886]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:28 smithi169 ceph-mon[35850]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:29.297 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:29 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:29.297 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:29 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:29.297 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:29 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:29.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:29 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:29.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:29 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:29.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:29 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:29.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:29 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:29.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:29 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:29.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:29 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:30.463 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:30 smithi154 ceph-mon[34853]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:30.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:30 smithi150 ceph-mon[30886]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:30 smithi169 ceph-mon[35850]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:31.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.723+0000 7f41da7fc640 1 -- 172.21.15.154:0/3688575059 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f41e4062630 con 0x7f41d00a3270 2024-09-15T22:08:31.725 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 10 on host 'smithi154' 2024-09-15T22:08:31.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f41d00a3270 msgr2=0x7f41d00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f41d00a3270 0x7f41d00a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f41e0004af0 tx=0x7f41e0004a40 comp rx=0 tx=0).stop 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 msgr2=0x7f41e419f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 0x7f41e419f5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009fd0 tx=0x7f41dc00b8e0 comp rx=0 tx=0).stop 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 shutdown_connections 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e41078f0 0x7f41e419f5c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41e4104fc0 0x7f41e4198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f41d00a3270 0x7f41d00a5730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 --2- 172.21.15.154:0/3688575059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41e4102690 0x7f41e4198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 >> 172.21.15.154:0/3688575059 conn(0x7f41e40fc270 msgr2=0x7f41e4103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 shutdown_connections 2024-09-15T22:08:31.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-15T22:08:31.725+0000 7f41eb7d7640 1 -- 172.21.15.154:0/3688575059 wait complete. 2024-09-15T22:08:32.266 DEBUG:teuthology.orchestra.run.smithi154:osd.10> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T22:08:32.269 INFO:tasks.cephadm:Deploying osd.11 on smithi169 with /dev/vg_nvme/lv_1... 2024-09-15T22:08:32.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.289 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:32.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:32.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:32.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:32.528 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:08:34.425 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:34 smithi169 ceph-mon[35850]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:34 smithi150 ceph-mon[30886]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:34 smithi154 ceph-mon[34853]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:35.164 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T22:08:35.190 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_1 2024-09-15T22:08:35.272 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:08:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:08:34.910+0000 7f1877bca640 -1 osd.10 0 log_to_monitors true 2024-09-15T22:08:35.442 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:08:35.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.872+0000 7f24122d7640 1 -- 172.21.15.169:0/4007172182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c102e00 msgr2=0x7f240c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:35.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.872+0000 7f24122d7640 1 --2- 172.21.15.169:0/4007172182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c102e00 0x7f240c103280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2400009900 tx=0x7f240002a410 comp rx=0 tx=0).stop 2024-09-15T22:08:35.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- 172.21.15.169:0/4007172182 shutdown_connections 2024-09-15T22:08:35.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 --2- 172.21.15.169:0/4007172182 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c1037c0 0x7f240c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 --2- 172.21.15.169:0/4007172182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c102e00 0x7f240c103280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 --2- 172.21.15.169:0/4007172182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240c101c00 0x7f240c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- 172.21.15.169:0/4007172182 >> 172.21.15.169:0/4007172182 conn(0x7f240c0fd390 msgr2=0x7f240c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- 172.21.15.169:0/4007172182 shutdown_connections 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- 172.21.15.169:0/4007172182 wait complete. 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 Processor -- start 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- start start 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c101c00 0x7f240c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240c102e00 0x7f240c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 0x7f240c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:35.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10d900 con 0x7f240c101c00 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10d780 con 0x7f240c102e00 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.873+0000 7f24122d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10da80 con 0x7f240c1037c0 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 0x7f240c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 0x7f240c19f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:45024/0 (socket says 172.21.15.169:45024) 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 -- 172.21.15.169:0/868159694 learned_addr learned my addr 172.21.15.169:0/868159694 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f240b7fe640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240c102e00 0x7f240c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 -- 172.21.15.169:0/868159694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240c102e00 msgr2=0x7f240c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240c102e00 0x7f240c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 -- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c101c00 msgr2=0x7f240c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c101c00 0x7f240c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 -- 172.21.15.169:0/868159694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c19fbb0 con 0x7f240c1037c0 2024-09-15T22:08:35.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f2410874640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 0x7f240c19f540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f240400b970 tx=0x7f240400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404019070 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c19fea0 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f240400cb40 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404007650 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.874+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c1a03d0 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.875+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c109050 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.876+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f240401c070 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.877+0000 7f24097fa640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23f40a3270 0x7f23f40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.877+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6376+0+0 (secure 0 0 0) 0x7f24040ce6d0 con 0x7f240c1037c0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.877+0000 7f240bfff640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23f40a3270 0x7f23f40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:35.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.878+0000 7f240bfff640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23f40a3270 0x7f23f40a5730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f240c102c60 tx=0x7f23fc009630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:35.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:35.881+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f240409b530 con 0x7f240c1037c0 2024-09-15T22:08:36.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:36.058+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f240c062630 con 0x7f23f40a3270 2024-09-15T22:08:36.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi154 2024-09-15T22:08:36.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:08:36.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:08:36.178 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:35 smithi150 ceph-mon[30886]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:36.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi154 2024-09-15T22:08:36.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:08:36.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:35 smithi169 ceph-mon[35850]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi154 2024-09-15T22:08:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:08:36.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:35 smithi154 ceph-mon[34853]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:37.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:08:37.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:37.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:36 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:37.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:36 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:08:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:08:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:08:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-15T22:08:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:37.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:36 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:38.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:08:37.728+0000 7f187332a640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T22:08:38.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:08:37.747+0000 7f186b95c640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:08:38.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:08:38.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:38.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:37 smithi154 ceph-mon[34853]: from='osd.10 ' entity='osd.10' 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:08:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:38.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:37 smithi169 ceph-mon[35850]: from='osd.10 ' entity='osd.10' 2024-09-15T22:08:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:08:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:08:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-15T22:08:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:08:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:08:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:08:38.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:37 smithi150 ceph-mon[30886]: from='osd.10 ' entity='osd.10' 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] boot 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/1941075838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]: dispatch 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]: dispatch 2024-09-15T22:08:39.087 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]': finished 2024-09-15T22:08:39.088 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: osdmap e67: 12 total, 11 up, 12 in 2024-09-15T22:08:39.088 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:39.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:39.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] boot 2024-09-15T22:08:39.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:08:39.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:39.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/1941075838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]: dispatch 2024-09-15T22:08:39.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]: dispatch 2024-09-15T22:08:39.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]': finished 2024-09-15T22:08:39.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: osdmap e67: 12 total, 11 up, 12 in 2024-09-15T22:08:39.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: osd.10 [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] boot 2024-09-15T22:08:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:08:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:08:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/1941075838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]: dispatch 2024-09-15T22:08:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]: dispatch 2024-09-15T22:08:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8474de2f-ba9c-4888-adec-e408f8c16e95"}]': finished 2024-09-15T22:08:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: osdmap e67: 12 total, 11 up, 12 in 2024-09-15T22:08:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:39 smithi169 ceph-mon[35850]: from='client.? 172.21.15.169:0/2336068491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:39 smithi169 ceph-mon[35850]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:39 smithi169 ceph-mon[35850]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:08:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:40.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:39 smithi154 ceph-mon[34853]: from='client.? 172.21.15.169:0/2336068491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:40.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:39 smithi154 ceph-mon[34853]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:40.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:39 smithi154 ceph-mon[34853]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:08:40.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:39 smithi150 ceph-mon[30886]: from='client.? 172.21.15.169:0/2336068491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:39 smithi150 ceph-mon[30886]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:39 smithi150 ceph-mon[30886]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:08:40.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:41.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:41 smithi150 ceph-mon[30886]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:08:41.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:41 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:41.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:41 smithi150 ceph-mon[30886]: pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:41.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:41 smithi169 ceph-mon[35850]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:08:41.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:41 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:41.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:41 smithi169 ceph-mon[35850]: pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:42.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:41 smithi154 ceph-mon[34853]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:08:42.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:41 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:42.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:41 smithi154 ceph-mon[34853]: pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:42.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:42 smithi150 ceph-mon[30886]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:08:42.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:42.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:42 smithi169 ceph-mon[35850]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:08:42.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:43.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:42 smithi154 ceph-mon[34853]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:08:43.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:08:43.671 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:43 smithi169 ceph-mon[35850]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:43.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:43 smithi150 ceph-mon[30886]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:44.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:43 smithi154 ceph-mon[34853]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:46.411 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:46 smithi169 ceph-mon[35850]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:08:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:46 smithi154 ceph-mon[34853]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:08:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:46 smithi150 ceph-mon[30886]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:08:47.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:08:47.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:08:47.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:08:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:48 smithi169 ceph-mon[35850]: Deploying daemon osd.11 on smithi169 2024-09-15T22:08:48.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:48 smithi169 ceph-mon[35850]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:08:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:48 smithi154 ceph-mon[34853]: Deploying daemon osd.11 on smithi169 2024-09-15T22:08:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:48 smithi154 ceph-mon[34853]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:08:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:48 smithi150 ceph-mon[30886]: Deploying daemon osd.11 on smithi169 2024-09-15T22:08:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:48 smithi150 ceph-mon[30886]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T22:08:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:50 smithi169 ceph-mon[35850]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:08:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:50 smithi154 ceph-mon[34853]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:08:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:50 smithi150 ceph-mon[30886]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:08:52.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:52 smithi169 ceph-mon[35850]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:08:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:52 smithi154 ceph-mon[34853]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:08:52.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:52 smithi150 ceph-mon[30886]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:08:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:53 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:53 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:53 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:54.424 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:54 smithi169 ceph-mon[35850]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:08:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:54 smithi154 ceph-mon[34853]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:08:54.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:54 smithi150 ceph-mon[30886]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:08:55.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.702+0000 7f24097fa640 1 -- 172.21.15.169:0/868159694 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f240c062630 con 0x7f23f40a3270 2024-09-15T22:08:55.704 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 11 on host 'smithi169' 2024-09-15T22:08:55.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23f40a3270 msgr2=0x7f23f40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23f40a3270 0x7f23f40a5730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f240c102c60 tx=0x7f23fc009630 comp rx=0 tx=0).stop 2024-09-15T22:08:55.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 msgr2=0x7f240c19f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:55.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 0x7f240c19f540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f240400b970 tx=0x7f240400be30 comp rx=0 tx=0).stop 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 shutdown_connections 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f240c1037c0 0x7f240c19f540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240c102e00 0x7f240c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23f40a3270 0x7f23f40a5730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 --2- 172.21.15.169:0/868159694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c101c00 0x7f240c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 >> 172.21.15.169:0/868159694 conn(0x7f240c0fd390 msgr2=0x7f240c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 shutdown_connections 2024-09-15T22:08:55.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:08:55.705+0000 7f24122d7640 1 -- 172.21.15.169:0/868159694 wait complete. 2024-09-15T22:08:56.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:56 smithi169 ceph-mon[35850]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:08:56.366 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:56 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:56.366 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:56 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:56 smithi154 ceph-mon[34853]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:08:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:56 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:56 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:56 smithi150 ceph-mon[30886]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:08:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:56 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:56.686 DEBUG:teuthology.orchestra.run.smithi169:osd.11> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T22:08:56.689 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T22:08:56.689 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:08:57.073 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:08:57.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 -- 172.21.15.150:0/178851835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 msgr2=0x7f156c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 --2- 172.21.15.150:0/178851835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c102000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1560009860 tx=0x7f156002a340 comp rx=0 tx=0).stop 2024-09-15T22:08:57.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 -- 172.21.15.150:0/178851835 shutdown_connections 2024-09-15T22:08:57.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 --2- 172.21.15.150:0/178851835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c1037c0 0x7f156c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 --2- 172.21.15.150:0/178851835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c102e00 0x7f156c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 --2- 172.21.15.150:0/178851835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c102000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 -- 172.21.15.150:0/178851835 >> 172.21.15.150:0/178851835 conn(0x7f156c0fd390 msgr2=0x7f156c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:57.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 -- 172.21.15.150:0/178851835 shutdown_connections 2024-09-15T22:08:57.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.698+0000 7f1573e00640 1 -- 172.21.15.150:0/178851835 wait complete. 2024-09-15T22:08:57.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.699+0000 7f1573e00640 1 Processor -- start 2024-09-15T22:08:57.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.699+0000 7f1573e00640 1 -- start start 2024-09-15T22:08:57.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1573e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1573e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c102e00 0x7f156c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1573e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c1037c0 0x7f156c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1573e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f156c10d860 con 0x7f156c102e00 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1573e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f156c10d6e0 con 0x7f156c1037c0 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1573e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f156c10d9e0 con 0x7f156c101c00 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1570a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c102e00 0x7f156c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1570a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c102e00 0x7f156c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58488/0 (socket says 172.21.15.150:58488) 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c1037c0 0x7f156c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1570a00640 1 -- 172.21.15.150:0/242822496 learned_addr learned my addr 172.21.15.150:0/242822496 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571e00640 1 -- 172.21.15.150:0/242822496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 msgr2=0x7f156c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571e00640 1 -- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c102e00 msgr2=0x7f156c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c102e00 0x7f156c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571e00640 1 -- 172.21.15.150:0/242822496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c0753e0 con 0x7f156c1037c0 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.700+0000 7f1571400640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.701+0000 7f1571e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c1037c0 0x7f156c074b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f156400ef00 tx=0x7f156400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.701+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564004b20 con 0x7f156c1037c0 2024-09-15T22:08:57.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.701+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156c1a2070 con 0x7f156c1037c0 2024-09-15T22:08:57.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.701+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1564003e50 con 0x7f156c1037c0 2024-09-15T22:08:57.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.701+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156400b570 con 0x7f156c1037c0 2024-09-15T22:08:57.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.701+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156c1a2580 con 0x7f156c1037c0 2024-09-15T22:08:57.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.702+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156c109050 con 0x7f156c1037c0 2024-09-15T22:08:57.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.704+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f156401d020 con 0x7f156c1037c0 2024-09-15T22:08:57.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.705+0000 7f156a000640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f15540a3240 0x7f15540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:57.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.705+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7f15640cf250 con 0x7f156c1037c0 2024-09-15T22:08:57.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.705+0000 7f1571400640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f15540a3240 0x7f15540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:57.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.706+0000 7f1571400640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f15540a3240 0x7f15540a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1560030410 tx=0x7f1560030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:57.711 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.709+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f156409c4b0 con 0x7f156c1037c0 2024-09-15T22:08:57.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.887+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f156c062df0 con 0x7f156c1037c0 2024-09-15T22:08:57.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.888+0000 7f156a000640 1 -- 172.21.15.150:0/242822496 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f156409bdb0 con 0x7f156c1037c0 2024-09-15T22:08:57.890 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:08:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f15540a3240 msgr2=0x7f15540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f15540a3240 0x7f15540a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1560030410 tx=0x7f1560030550 comp rx=0 tx=0).stop 2024-09-15T22:08:57.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c1037c0 msgr2=0x7f156c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c1037c0 0x7f156c074b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f156400ef00 tx=0x7f156400c740 comp rx=0 tx=0).stop 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 shutdown_connections 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f156c1037c0 0x7f156c074b20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f15540a3240 0x7f15540a5700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f156c102e00 0x7f156c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 --2- 172.21.15.150:0/242822496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c101c00 0x7f156c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 >> 172.21.15.150:0/242822496 conn(0x7f156c0fd390 msgr2=0x7f156c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 shutdown_connections 2024-09-15T22:08:57.893 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:08:57.890+0000 7f1573e00640 1 -- 172.21.15.150:0/242822496 wait complete. 2024-09-15T22:08:58.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:58.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:57 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:58.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:57 smithi150 ceph-mon[30886]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:58.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:57 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/242822496' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:08:58.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:58.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:57 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:58.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:57 smithi169 ceph-mon[35850]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:58.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:57 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/242822496' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:08:58.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:58.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:57 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:08:58.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:57 smithi154 ceph-mon[34853]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:08:58.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:57 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/242822496' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:08:58.698 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726438118,"num_in_osds":12,"osd_in_since":1726438118,"num_remapped_pgs":0} 2024-09-15T22:08:59.342 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:59 smithi169 ceph-mon[35850]: from='osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:08:59.342 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:08:59 smithi169 ceph-mon[35850]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:08:59.342 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:08:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:08:59.076+0000 7f0c6085c640 -1 osd.11 0 log_to_monitors true 2024-09-15T22:08:59.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:59 smithi150 ceph-mon[30886]: from='osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:08:59.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:08:59 smithi150 ceph-mon[30886]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:08:59.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:59 smithi154 ceph-mon[34853]: from='osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:08:59.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:08:59 smithi154 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:08:59.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:09:00.071 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:00.408 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:09:00.408 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:09:00.408 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:09:00.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:09:00.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:00.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:09:00.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:00.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:09:00.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:00 smithi150 ceph-mon[30886]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:09:00.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:09:00.148+0000 7f0c5bfbc640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T22:09:00.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:09:00.162+0000 7f0c585f6640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:00.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:09:00.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:09:00.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:09:00.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:09:00.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:00.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:09:00.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.461 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:00.463 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:00.463 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.463 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:09:00.463 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:00 smithi169 ceph-mon[35850]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:09:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:09:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:09:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:00.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:00.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-15T22:09:00.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:00 smithi154 ceph-mon[34853]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 -- 172.21.15.150:0/2465813404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8104e50 msgr2=0x7fe3b81052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 --2- 172.21.15.150:0/2465813404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8104e50 0x7fe3b81052d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009900 tx=0x7fe3a002a410 comp rx=0 tx=0).stop 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 -- 172.21.15.150:0/2465813404 shutdown_connections 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 --2- 172.21.15.150:0/2465813404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 0x7fe3b810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 --2- 172.21.15.150:0/2465813404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8104e50 0x7fe3b81052d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 --2- 172.21.15.150:0/2465813404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8103c50 0x7fe3b8104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 -- 172.21.15.150:0/2465813404 >> 172.21.15.150:0/2465813404 conn(0x7fe3b80ff3e0 msgr2=0x7fe3b8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:00.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 -- 172.21.15.150:0/2465813404 shutdown_connections 2024-09-15T22:09:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.595+0000 7fe3be600640 1 -- 172.21.15.150:0/2465813404 wait complete. 2024-09-15T22:09:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 Processor -- start 2024-09-15T22:09:00.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 -- start start 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 0x7fe3b8199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8104e50 0x7fe3b819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 0x7fe3b81a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b810f900 con 0x7fe3b8103c50 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b810f780 con 0x7fe3b8104e50 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.596+0000 7fe3be600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b810fa80 con 0x7fe3b8105810 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 0x7fe3b8199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 0x7fe3b8199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44390/0 (socket says 172.21.15.150:44390) 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 -- 172.21.15.150:0/3344510492 learned_addr learned my addr 172.21.15.150:0/3344510492 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bdc00640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 0x7fe3b81a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:00.599 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3afe00640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8104e50 0x7fe3b819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 -- 172.21.15.150:0/3344510492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 msgr2=0x7fe3b81a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 0x7fe3b81a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.600 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 -- 172.21.15.150:0/3344510492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8104e50 msgr2=0x7fe3b819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8104e50 0x7fe3b819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 -- 172.21.15.150:0/3344510492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b81a1b40 con 0x7fe3b8103c50 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bdc00640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 0x7fe3b81a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.597+0000 7fe3bd200640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 0x7fe3b8199f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800d950 tx=0x7fe3a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.598+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8017020 con 0x7fe3b8103c50 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.598+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a8009c30 con 0x7fe3b8103c50 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.598+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800f740 con 0x7fe3b8103c50 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.598+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b81a1e30 con 0x7fe3b8103c50 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.598+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b81a2230 con 0x7fe3b8103c50 2024-09-15T22:09:00.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.599+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b810aff0 con 0x7fe3b8103c50 2024-09-15T22:09:00.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.601+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe3a801a020 con 0x7fe3b8103c50 2024-09-15T22:09:00.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.602+0000 7fe3b6000640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe39c0a3270 0x7fe39c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:00.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.602+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6847+0+0 (secure 0 0 0) 0x7fe3a80ced50 con 0x7fe3b8103c50 2024-09-15T22:09:00.604 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.602+0000 7fe3afe00640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe39c0a3270 0x7fe39c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:00.605 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.603+0000 7fe3afe00640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe39c0a3270 0x7fe39c0a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0031440 tx=0x7fe3a00315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.607+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3a8021070 con 0x7fe3b8103c50 2024-09-15T22:09:00.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.780+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe3b802d7c0 con 0x7fe3b8103c50 2024-09-15T22:09:00.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.780+0000 7fe3b6000640 1 -- 172.21.15.150:0/3344510492 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fe3a809bf90 con 0x7fe3b8103c50 2024-09-15T22:09:00.782 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:00.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe39c0a3270 msgr2=0x7fe39c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:00.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe39c0a3270 0x7fe39c0a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0031440 tx=0x7fe3a00315b0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 msgr2=0x7fe3b8199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:00.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 0x7fe3b8199f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800d950 tx=0x7fe3a800de10 comp rx=0 tx=0).stop 2024-09-15T22:09:00.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 shutdown_connections 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3b8105810 0x7fe3b81a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3b8104e50 0x7fe3b819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe39c0a3270 0x7fe39c0a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 --2- 172.21.15.150:0/3344510492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b8103c50 0x7fe3b8199f10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.783+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 >> 172.21.15.150:0/3344510492 conn(0x7fe3b80ff3e0 msgr2=0x7fe3b81081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.784+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 shutdown_connections 2024-09-15T22:09:00.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:00.784+0000 7fe3be600640 1 -- 172.21.15.150:0/3344510492 wait complete. 2024-09-15T22:09:01.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: Detected new or changed devices on smithi169 2024-09-15T22:09:01.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-15T22:09:01.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:01.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:01.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:01.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:01.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:01.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:01.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:01 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3344510492' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:09:01.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: Detected new or changed devices on smithi169 2024-09-15T22:09:01.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-15T22:09:01.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:01.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:01.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:01.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:01.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:01.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:01.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:01 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3344510492' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:09:01.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: Detected new or changed devices on smithi169 2024-09-15T22:09:01.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-15T22:09:01.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:01.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:01.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:01.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:01.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:01.550 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:01.550 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:01 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3344510492' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:09:01.564 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726438118,"num_in_osds":12,"osd_in_since":1726438118,"num_remapped_pgs":0} 2024-09-15T22:09:02.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: purged_snaps scrub starts 2024-09-15T22:09:02.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: purged_snaps scrub ok 2024-09-15T22:09:02.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:09:02.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:02.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] boot 2024-09-15T22:09:02.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:09:02.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:02.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: purged_snaps scrub starts 2024-09-15T22:09:02.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: purged_snaps scrub ok 2024-09-15T22:09:02.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:09:02.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:02.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] boot 2024-09-15T22:09:02.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:09:02.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: purged_snaps scrub starts 2024-09-15T22:09:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: purged_snaps scrub ok 2024-09-15T22:09:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:09:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: osd.11 [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] boot 2024-09-15T22:09:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:09:02.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:09:02.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:09:02.941 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:03.336 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:03 smithi150 ceph-mon[30886]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:09:03.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 -- 172.21.15.150:0/1737170656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 msgr2=0x7fa9200750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 --2- 172.21.15.150:0/1737170656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa9200750b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009900 tx=0x7fa90c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 -- 172.21.15.150:0/1737170656 shutdown_connections 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 --2- 172.21.15.150:0/1737170656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa920109a80 0x7fa92010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 --2- 172.21.15.150:0/1737170656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa9200750b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 --2- 172.21.15.150:0/1737170656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa920076220 0x7fa920074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 -- 172.21.15.150:0/1737170656 >> 172.21.15.150:0/1737170656 conn(0x7fa9200fd390 msgr2=0x7fa9200ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.439+0000 7fa928400640 1 -- 172.21.15.150:0/1737170656 shutdown_connections 2024-09-15T22:09:03.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.440+0000 7fa928400640 1 -- 172.21.15.150:0/1737170656 wait complete. 2024-09-15T22:09:03.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.440+0000 7fa928400640 1 Processor -- start 2024-09-15T22:09:03.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 -- start start 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa92019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa920076220 0x7fa92019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa920109a80 0x7fa9201a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010fa80 con 0x7fa920074c50 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010f900 con 0x7fa920109a80 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa928400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010fc00 con 0x7fa920076220 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa925a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa92019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa925a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa92019a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44396/0 (socket says 172.21.15.150:44396) 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa925a00640 1 -- 172.21.15.150:0/3604731714 learned_addr learned my addr 172.21.15.150:0/3604731714 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa925000640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa920076220 0x7fa92019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.444 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.441+0000 7fa926400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa920109a80 0x7fa9201a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa925a00640 1 -- 172.21.15.150:0/3604731714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa920076220 msgr2=0x7fa92019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa925a00640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa920076220 0x7fa92019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa925a00640 1 -- 172.21.15.150:0/3604731714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa920109a80 msgr2=0x7fa9201a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa925a00640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa920109a80 0x7fa9201a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa925a00640 1 -- 172.21.15.150:0/3604731714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9201a1d30 con 0x7fa920074c50 2024-09-15T22:09:03.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa925a00640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa92019a100 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa914005fd0 tx=0x7fa91400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914017070 con 0x7fa920074c50 2024-09-15T22:09:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa914009c30 con 0x7fa920074c50 2024-09-15T22:09:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914010460 con 0x7fa920074c50 2024-09-15T22:09:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9201a1fc0 con 0x7fa920074c50 2024-09-15T22:09:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.442+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9201a2470 con 0x7fa920074c50 2024-09-15T22:09:03.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.443+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa920108800 con 0x7fa920074c50 2024-09-15T22:09:03.449 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.447+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa914003e70 con 0x7fa920074c50 2024-09-15T22:09:03.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.448+0000 7fa91e000640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa9080a3270 0x7fa9080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:03.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.448+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa9140cf8f0 con 0x7fa920074c50 2024-09-15T22:09:03.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.449+0000 7fa925000640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa9080a3270 0x7fa9080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:03.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.449+0000 7fa925000640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa9080a3270 0x7fa9080a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0314e0 tx=0x7fa90c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:03.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.451+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa914020030 con 0x7fa920074c50 2024-09-15T22:09:03.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:03 smithi154 ceph-mon[34853]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:09:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.627+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa92002d7c0 con 0x7fa920074c50 2024-09-15T22:09:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.627+0000 7fa91e000640 1 -- 172.21.15.150:0/3604731714 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fa91409ca10 con 0x7fa920074c50 2024-09-15T22:09:03.629 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:03.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.629+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa9080a3270 msgr2=0x7fa9080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.629+0000 7fa928400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa9080a3270 0x7fa9080a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0314e0 tx=0x7fa90c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.629+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 msgr2=0x7fa92019a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.629+0000 7fa928400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa92019a100 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa914005fd0 tx=0x7fa91400dde0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 shutdown_connections 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa920109a80 0x7fa9201a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa920076220 0x7fa92019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa9080a3270 0x7fa9080a5730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 --2- 172.21.15.150:0/3604731714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa920074c50 0x7fa92019a100 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:03.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 >> 172.21.15.150:0/3604731714 conn(0x7fa9200fd390 msgr2=0x7fa9201059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:03.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 shutdown_connections 2024-09-15T22:09:03.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:03.630+0000 7fa928400640 1 -- 172.21.15.150:0/3604731714 wait complete. 2024-09-15T22:09:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:03 smithi169 ceph-mon[35850]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:09:04.425 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:04 smithi150 ceph-mon[30886]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:04.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:04 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3604731714' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:09:04.462 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726438141,"num_in_osds":12,"osd_in_since":1726438118,"num_remapped_pgs":0} 2024-09-15T22:09:04.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:09:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:04 smithi154 ceph-mon[34853]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:04 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3604731714' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:09:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:04 smithi169 ceph-mon[35850]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:04 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3604731714' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:09:04.824 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:05.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 -- 172.21.15.150:0/1749555162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c074ee0 msgr2=0x7f835c10dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:05.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 --2- 172.21.15.150:0/1749555162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c074ee0 0x7f835c10dd20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8348009900 tx=0x7f834802a480 comp rx=0 tx=0).stop 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 -- 172.21.15.150:0/1749555162 shutdown_connections 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 --2- 172.21.15.150:0/1749555162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 0x7f835c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 --2- 172.21.15.150:0/1749555162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c074ee0 0x7f835c10dd20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 --2- 172.21.15.150:0/1749555162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f835c0745c0 0x7f835c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 -- 172.21.15.150:0/1749555162 >> 172.21.15.150:0/1749555162 conn(0x7f835c0fd6e0 msgr2=0x7f835c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 -- 172.21.15.150:0/1749555162 shutdown_connections 2024-09-15T22:09:05.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.339+0000 7f835be00640 1 -- 172.21.15.150:0/1749555162 wait complete. 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.340+0000 7f835be00640 1 Processor -- start 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.340+0000 7f835be00640 1 -- start start 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 0x7f835c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f835c074ee0 0x7f835c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 0x7f835c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f835c114000 con 0x7f835c0745c0 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835be00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f835c113e80 con 0x7f835c10e260 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f835c114180 con 0x7f835c074ee0 2024-09-15T22:09:05.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 0x7f835c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 0x7f835c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44408/0 (socket says 172.21.15.150:44408) 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 -- 172.21.15.150:0/1351990263 learned_addr learned my addr 172.21.15.150:0/1351990263 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835a000640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f835c074ee0 0x7f835c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835b400640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 0x7f835c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 -- 172.21.15.150:0/1351990263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f835c074ee0 msgr2=0x7f835c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f835c074ee0 0x7f835c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 -- 172.21.15.150:0/1351990263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 msgr2=0x7f835c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 0x7f835c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835aa00640 1 -- 172.21.15.150:0/1351990263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c19f460 con 0x7f835c0745c0 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.341+0000 7f835b400640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 0x7f835c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.342+0000 7f835aa00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 0x7f835c19a4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f834c00eb90 tx=0x7f834c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:05.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.342+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c004d20 con 0x7f835c0745c0 2024-09-15T22:09:05.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.342+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f834c00ee90 con 0x7f835c0745c0 2024-09-15T22:09:05.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.342+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c010830 con 0x7f835c0745c0 2024-09-15T22:09:05.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.342+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c19f750 con 0x7f835c0745c0 2024-09-15T22:09:05.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.342+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c1a7030 con 0x7f835c0745c0 2024-09-15T22:09:05.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.343+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c0749a0 con 0x7f835c0745c0 2024-09-15T22:09:05.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.345+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f834c005020 con 0x7f835c0745c0 2024-09-15T22:09:05.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.346+0000 7f8353400640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83400a3240 0x7f83400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:05.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.346+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f834c0cfce0 con 0x7f835c0745c0 2024-09-15T22:09:05.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.347+0000 7f835a000640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83400a3240 0x7f83400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:05.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.347+0000 7f835a000640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83400a3240 0x7f83400a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8348000c00 tx=0x7f8348005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:05.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.350+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f834c09ce00 con 0x7f835c0745c0 2024-09-15T22:09:05.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.525+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f835c108e50 con 0x7f835c0745c0 2024-09-15T22:09:05.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.526+0000 7f8353400640 1 -- 172.21.15.150:0/1351990263 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18537 (secure 0 0 0) 0x7f834c09c700 con 0x7f835c0745c0 2024-09-15T22:09:05.528 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:05.528 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":74,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:09:02.232246+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:09:05.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83400a3240 msgr2=0x7f83400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:05.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83400a3240 0x7f83400a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8348000c00 tx=0x7f8348005a20 comp rx=0 tx=0).stop 2024-09-15T22:09:05.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 msgr2=0x7f835c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:05.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 0x7f835c19a4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f834c00eb90 tx=0x7f834c00c6a0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 shutdown_connections 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f835c10e260 0x7f835c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f835c074ee0 0x7f835c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83400a3240 0x7f83400a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 --2- 172.21.15.150:0/1351990263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f835c0745c0 0x7f835c19a4b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.529+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 >> 172.21.15.150:0/1351990263 conn(0x7f835c0fd6e0 msgr2=0x7f835c0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.530+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 shutdown_connections 2024-09-15T22:09:05.531 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:05.530+0000 7f835be00640 1 -- 172.21.15.150:0/1351990263 wait complete. 2024-09-15T22:09:06.287 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:05:05.654013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:09:06.288 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T22:09:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:06 smithi154 ceph-mon[34853]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:06 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1351990263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:09:06.649 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:06 smithi150 ceph-mon[30886]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:06 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1351990263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:09:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:06 smithi169 ceph-mon[35850]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:06 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1351990263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:09:07.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.193+0000 7f66e9400640 1 -- 172.21.15.150:0/672435801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4108f60 msgr2=0x7f66e4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.193+0000 7f66e9400640 1 --2- 172.21.15.150:0/672435801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4108f60 0x7f66e4110ae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009ca0 tx=0x7f66dc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 -- 172.21.15.150:0/672435801 shutdown_connections 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 --2- 172.21.15.150:0/672435801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4108f60 0x7f66e4110ae0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 --2- 172.21.15.150:0/672435801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e41047e0 0x7f66e4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 --2- 172.21.15.150:0/672435801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4103e30 0x7f66e4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 -- 172.21.15.150:0/672435801 >> 172.21.15.150:0/672435801 conn(0x7f66e40ff8d0 msgr2=0x7f66e4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 -- 172.21.15.150:0/672435801 shutdown_connections 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.194+0000 7f66e9400640 1 -- 172.21.15.150:0/672435801 wait complete. 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 Processor -- start 2024-09-15T22:09:07.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 -- start start 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4103e30 0x7f66e419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e41047e0 0x7f66e419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4108f60 0x7f66e419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4113fc0 con 0x7f66e4103e30 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4113e40 con 0x7f66e41047e0 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e9400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4114140 con 0x7f66e4108f60 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.195+0000 7f66e3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4103e30 0x7f66e419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4103e30 0x7f66e419a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44420/0 (socket says 172.21.15.150:44420) 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e3e00640 1 -- 172.21.15.150:0/3347646985 learned_addr learned my addr 172.21.15.150:0/3347646985 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4108f60 0x7f66e419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66db400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e41047e0 0x7f66e419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:07.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 -- 172.21.15.150:0/3347646985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e41047e0 msgr2=0x7f66e419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:07.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e41047e0 0x7f66e419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 -- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4103e30 msgr2=0x7f66e419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:07.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4103e30 0x7f66e419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 -- 172.21.15.150:0/3347646985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e419f3b0 con 0x7f66e4108f60 2024-09-15T22:09:07.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.196+0000 7f66e8a00640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4108f60 0x7f66e419ecd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66dc02ade0 tx=0x7f66dc0319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:07.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.197+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc003b70 con 0x7f66e4108f60 2024-09-15T22:09:07.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.197+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66dc003d10 con 0x7f66e4108f60 2024-09-15T22:09:07.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.197+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e419f640 con 0x7f66e4108f60 2024-09-15T22:09:07.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.197+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc02fc40 con 0x7f66e4108f60 2024-09-15T22:09:07.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.197+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e41a6f80 con 0x7f66e4108f60 2024-09-15T22:09:07.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.198+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e4104210 con 0x7f66e4108f60 2024-09-15T22:09:07.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.200+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f66dc004b40 con 0x7f66e4108f60 2024-09-15T22:09:07.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.201+0000 7f66e1600640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f66c80a32c0 0x7f66c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:07.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.201+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f66dc0f0520 con 0x7f66e4108f60 2024-09-15T22:09:07.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.201+0000 7f66e3e00640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f66c80a32c0 0x7f66c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:07.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.202+0000 7f66e3e00640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f66c80a32c0 0x7f66c80a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009cd0 tx=0x7f66d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:07.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.203+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66dc0bd640 con 0x7f66e4108f60 2024-09-15T22:09:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.378+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66e410bbb0 con 0x7f66e4108f60 2024-09-15T22:09:07.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.379+0000 7f66e1600640 1 -- 172.21.15.150:0/3347646985 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f66dc0bcf40 con 0x7f66e4108f60 2024-09-15T22:09:07.380 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-15T22:09:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f66c80a32c0 msgr2=0x7f66c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f66c80a32c0 0x7f66c80a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009cd0 tx=0x7f66d4005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:07.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4108f60 msgr2=0x7f66e419ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4108f60 0x7f66e419ecd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66dc02ade0 tx=0x7f66dc0319f0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 shutdown_connections 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66e4108f60 0x7f66e419ecd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e41047e0 0x7f66e419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f66c80a32c0 0x7f66c80a5780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 --2- 172.21.15.150:0/3347646985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4103e30 0x7f66e419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 >> 172.21.15.150:0/3347646985 conn(0x7f66e40ff8d0 msgr2=0x7f66e4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.381+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 shutdown_connections 2024-09-15T22:09:07.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:07.382+0000 7f66e9400640 1 -- 172.21.15.150:0/3347646985 wait complete. 2024-09-15T22:09:08.019 INFO:tasks.cephadm:Adding mds.a on smithi150 2024-09-15T22:09:08.019 INFO:tasks.cephadm:Adding mds.d on smithi150 2024-09-15T22:09:08.019 INFO:tasks.cephadm:Adding mds.g on smithi150 2024-09-15T22:09:08.019 INFO:tasks.cephadm:Adding mds.j on smithi150 2024-09-15T22:09:08.019 INFO:tasks.cephadm:Adding mds.b on smithi154 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.e on smithi154 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.h on smithi154 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.k on smithi154 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.c on smithi169 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.f on smithi169 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.i on smithi169 2024-09-15T22:09:08.020 INFO:tasks.cephadm:Adding mds.l on smithi169 2024-09-15T22:09:08.020 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l' 2024-09-15T22:09:08.285 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:09:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:08 smithi169 ceph-mon[35850]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:08 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3347646985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:09:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:08 smithi154 ceph-mon[34853]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:08 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3347646985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:09:08.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:08 smithi150 ceph-mon[30886]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:08.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:08 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3347646985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 -- 172.21.15.169:0/1631350340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c81037c0 msgr2=0x7f63c810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/1631350340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c81037c0 0x7f63c810a050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009ca0 tx=0x7f63c002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 -- 172.21.15.169:0/1631350340 shutdown_connections 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/1631350340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c81037c0 0x7f63c810a050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/1631350340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8102e00 0x7f63c8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/1631350340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c8101c00 0x7f63c8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.769+0000 7f63ce8e4640 1 -- 172.21.15.169:0/1631350340 >> 172.21.15.169:0/1631350340 conn(0x7f63c80fd390 msgr2=0x7f63c80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.770+0000 7f63ce8e4640 1 -- 172.21.15.169:0/1631350340 shutdown_connections 2024-09-15T22:09:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.770+0000 7f63ce8e4640 1 -- 172.21.15.169:0/1631350340 wait complete. 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.770+0000 7f63ce8e4640 1 Processor -- start 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.770+0000 7f63ce8e4640 1 -- start start 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.770+0000 7f63ce8e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 0x7f63c8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63ce8e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8102e00 0x7f63c80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63ce8e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c81037c0 0x7f63c8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63ce8e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63c810d880 con 0x7f63c81037c0 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63ce8e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63c810d700 con 0x7f63c8102e00 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63ce8e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63c810da00 con 0x7f63c8101c00 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 0x7f63c8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 0x7f63c8075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:44834/0 (socket says 172.21.15.169:44834) 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 -- 172.21.15.169:0/3677831568 learned_addr learned my addr 172.21.15.169:0/3677831568 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c77fe640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8102e00 0x7f63c80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63cce81640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c81037c0 0x7f63c8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 -- 172.21.15.169:0/3677831568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8102e00 msgr2=0x7f63c80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8102e00 0x7f63c80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 -- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c81037c0 msgr2=0x7f63c8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c81037c0 0x7f63c8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 -- 172.21.15.169:0/3677831568 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c80753e0 con 0x7f63c8101c00 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c7fff640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 0x7f63c8075f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d950 tx=0x7f63b800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8017020 con 0x7f63c8101c00 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.771+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63b8009c30 con 0x7f63c8101c00 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.772+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c81a1fe0 con 0x7f63c8101c00 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.772+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b800f740 con 0x7f63c8101c00 2024-09-15T22:09:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.772+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c81a2440 con 0x7f63c8101c00 2024-09-15T22:09:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.773+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c8108fb0 con 0x7f63c8101c00 2024-09-15T22:09:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.774+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f63b801a020 con 0x7f63c8101c00 2024-09-15T22:09:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.775+0000 7f63c57fa640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f63b00a3240 0x7f63b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.775+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f63b80cf1d0 con 0x7f63c8101c00 2024-09-15T22:09:08.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.775+0000 7f63c77fe640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f63b00a3240 0x7f63b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:08.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.776+0000 7f63c77fe640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f63b00a3240 0x7f63b00a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63c8075d10 tx=0x7f63bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:08.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.778+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63b8021070 con 0x7f63c8101c00 2024-09-15T22:09:08.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.960+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}) -- 0x7f63c8062730 con 0x7f63b00a3240 2024-09-15T22:09:08.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.968+0000 7f63c57fa640 1 -- 172.21.15.169:0/3677831568 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f63c8062730 con 0x7f63b00a3240 2024-09-15T22:09:08.969 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mds.all update... 2024-09-15T22:09:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f63b00a3240 msgr2=0x7f63b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f63b00a3240 0x7f63b00a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63c8075d10 tx=0x7f63bc00b390 comp rx=0 tx=0).stop 2024-09-15T22:09:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 msgr2=0x7f63c8075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 0x7f63c8075f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d950 tx=0x7f63b800de10 comp rx=0 tx=0).stop 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 shutdown_connections 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f63b00a3240 0x7f63b00a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63c81037c0 0x7f63c8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8102e00 0x7f63c80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 --2- 172.21.15.169:0/3677831568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63c8101c00 0x7f63c8075f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 >> 172.21.15.169:0/3677831568 conn(0x7f63c80fd390 msgr2=0x7f63c8106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 shutdown_connections 2024-09-15T22:09:08.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T22:09:08.970+0000 7f63ce8e4640 1 -- 172.21.15.169:0/3677831568 wait complete. 2024-09-15T22:09:09.590 DEBUG:teuthology.orchestra.run.smithi150:mds.a> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T22:09:09.595 DEBUG:teuthology.orchestra.run.smithi150:mds.d> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T22:09:09.639 DEBUG:teuthology.orchestra.run.smithi150:mds.g> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T22:09:09.685 DEBUG:teuthology.orchestra.run.smithi150:mds.j> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T22:09:09.732 DEBUG:teuthology.orchestra.run.smithi154:mds.b> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T22:09:09.735 DEBUG:teuthology.orchestra.run.smithi154:mds.e> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T22:09:09.778 DEBUG:teuthology.orchestra.run.smithi154:mds.h> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T22:09:09.821 DEBUG:teuthology.orchestra.run.smithi154:mds.k> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T22:09:09.864 DEBUG:teuthology.orchestra.run.smithi169:mds.c> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T22:09:09.867 DEBUG:teuthology.orchestra.run.smithi169:mds.f> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T22:09:09.910 DEBUG:teuthology.orchestra.run.smithi169:mds.i> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T22:09:09.953 DEBUG:teuthology.orchestra.run.smithi169:mds.l> sudo journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T22:09:09.996 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T22:09:09.996 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: Saving service mds.all spec with placement smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:10.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:10.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:10.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:10.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: Saving service mds.all spec with placement smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:10.206 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:10.207 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:10.207 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:10.360 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: Saving service mds.all spec with placement smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:10.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:10.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 -- 172.21.15.150:0/2674117767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44581047e0 msgr2=0x7f4458108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:10.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 --2- 172.21.15.150:0/2674117767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44581047e0 0x7f4458108830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4440009900 tx=0x7f444002a410 comp rx=0 tx=0).stop 2024-09-15T22:09:10.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 -- 172.21.15.150:0/2674117767 shutdown_connections 2024-09-15T22:09:10.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 --2- 172.21.15.150:0/2674117767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4458108f60 0x7f4458110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 --2- 172.21.15.150:0/2674117767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44581047e0 0x7f4458108830 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 --2- 172.21.15.150:0/2674117767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4458103e30 0x7f4458104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.878+0000 7f445de00640 1 -- 172.21.15.150:0/2674117767 >> 172.21.15.150:0/2674117767 conn(0x7f44580ff8d0 msgr2=0x7f4458101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.879+0000 7f445de00640 1 -- 172.21.15.150:0/2674117767 shutdown_connections 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.879+0000 7f445de00640 1 -- 172.21.15.150:0/2674117767 wait complete. 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.879+0000 7f445de00640 1 Processor -- start 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 -- start start 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4458103e30 0x7f445819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 0x7f445819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458108f60 0x7f445819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4458113fc0 con 0x7f4458108f60 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4458113e40 con 0x7f4458103e30 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445de00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4458114140 con 0x7f44581047e0 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f444fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 0x7f445819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f444fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 0x7f445819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60686/0 (socket says 172.21.15.150:60686) 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f444fe00640 1 -- 172.21.15.150:0/2932269887 learned_addr learned my addr 172.21.15.150:0/2932269887 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445d400640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458108f60 0x7f445819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:10.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.880+0000 7f445ca00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4458103e30 0x7f445819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f444fe00640 1 -- 172.21.15.150:0/2932269887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4458103e30 msgr2=0x7f445819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f444fe00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4458103e30 0x7f445819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f444fe00640 1 -- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458108f60 msgr2=0x7f445819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f444fe00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458108f60 0x7f445819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f444fe00640 1 -- 172.21.15.150:0/2932269887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445819f430 con 0x7f44581047e0 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f444fe00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 0x7f445819a9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4440006010 tx=0x7f44400042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444003f030 con 0x7f44581047e0 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4440003ce0 con 0x7f44581047e0 2024-09-15T22:09:10.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445819f6c0 con 0x7f44581047e0 2024-09-15T22:09:10.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.881+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440035070 con 0x7f44581047e0 2024-09-15T22:09:10.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.882+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44581a7000 con 0x7f44581047e0 2024-09-15T22:09:10.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.883+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4458105310 con 0x7f44581047e0 2024-09-15T22:09:10.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.884+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f4440042030 con 0x7f44581047e0 2024-09-15T22:09:10.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.886+0000 7f4456000640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f443c0a3240 0x7f443c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:10.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.886+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f44400efb20 con 0x7f44581047e0 2024-09-15T22:09:10.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.886+0000 7f445ca00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f443c0a3240 0x7f443c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:10.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.886+0000 7f445ca00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f443c0a3240 0x7f443c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4448005fd0 tx=0x7f444800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:10.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:10.890+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44400bc6b0 con 0x7f44581047e0 2024-09-15T22:09:11.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.101+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f445810c1a0 con 0x7f44581047e0 2024-09-15T22:09:11.103 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:10 smithi150 ceph-mon[30886]: Deploying daemon mds.l on smithi169 2024-09-15T22:09:11.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.101+0000 7f4456000640 1 -- 172.21.15.150:0/2932269887 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f44400c09b0 con 0x7f44581047e0 2024-09-15T22:09:11.104 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:11.104 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"btime":"2024-09-15T22:01:51:172800+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T22:09:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 1 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f443c0a3240 msgr2=0x7f443c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f443c0a3240 0x7f443c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4448005fd0 tx=0x7f444800b390 comp rx=0 tx=0).stop 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 msgr2=0x7f445819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 0x7f445819a9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4440006010 tx=0x7f44400042f0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 shutdown_connections 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f443c0a3240 0x7f443c0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4458108f60 0x7f445819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44581047e0 0x7f445819a9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 --2- 172.21.15.150:0/2932269887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4458103e30 0x7f445819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:11.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 >> 172.21.15.150:0/2932269887 conn(0x7f44580ff8d0 msgr2=0x7f4458100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:11.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 shutdown_connections 2024-09-15T22:09:11.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:11.104+0000 7f445de00640 1 -- 172.21.15.150:0/2932269887 wait complete. 2024-09-15T22:09:11.233 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:10 smithi169 ceph-mon[35850]: Deploying daemon mds.l on smithi169 2024-09-15T22:09:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:10 smithi154 ceph-mon[34853]: Deploying daemon mds.l on smithi169 2024-09-15T22:09:11.949 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:11 smithi169 systemd[1]: Starting Ceph mds.l for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:12.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:11 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2932269887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:12.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:11 smithi150 ceph-mon[30886]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:12.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:11 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2932269887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:12.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:11 smithi169 ceph-mon[35850]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:12.210 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:11 smithi169 podman[65589]: 2024-09-15 22:09:11.850556025 +0000 UTC m=+0.015689110 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:12.210 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:11 smithi169 podman[65589]: 2024-09-15 22:09:11.954134032 +0000 UTC m=+0.119267103 container create 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T22:09:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:11 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2932269887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:11 smithi154 ceph-mon[34853]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:12.709 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:12 smithi169 podman[65589]: 2024-09-15 22:09:12.215235292 +0000 UTC m=+0.380368364 container init 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:09:12.710 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:12 smithi169 podman[65589]: 2024-09-15 22:09:12.218284585 +0000 UTC m=+0.383417657 container start 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:09:12.710 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:12 smithi169 ceph-mds[65608]: -- 172.21.15.169:0/3852290004 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8a4567860 con 0x55a8a4545400 2024-09-15T22:09:12.710 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l[65604]: starting mds.l at 2024-09-15T22:09:12.710 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:12 smithi169 bash[65589]: 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 2024-09-15T22:09:12.710 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:09:12 smithi169 systemd[1]: Started Ceph mds.l for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6832/2170086704,v1:172.21.15.169:6833/2170086704] up:boot 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: fsmap 1 up:standby 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:13.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6832/2170086704,v1:172.21.15.169:6833/2170086704] up:boot 2024-09-15T22:09:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: fsmap 1 up:standby 2024-09-15T22:09:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:09:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:13.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6832/2170086704,v1:172.21.15.169:6833/2170086704] up:boot 2024-09-15T22:09:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: fsmap 1 up:standby 2024-09-15T22:09:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:09:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:13.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:13.922 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:14.252 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 systemd[1]: Starting Ceph mds.k for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:14.295 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:14.506 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:14 smithi154 ceph-mon[34853]: Deploying daemon mds.k on smithi154 2024-09-15T22:09:14.506 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:14 smithi154 ceph-mon[34853]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:14.507 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 podman[63890]: 2024-09-15 22:09:14.171965258 +0000 UTC m=+0.015849668 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:14.507 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 podman[63890]: 2024-09-15 22:09:14.285757469 +0000 UTC m=+0.129641914 container create d4d313e0dadb8e367cbcf60530693a7fe4ae13fc5b306dc9068bf76c8030f896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T22:09:14.507 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 podman[63890]: 2024-09-15 22:09:14.479985574 +0000 UTC m=+0.323869980 container init d4d313e0dadb8e367cbcf60530693a7fe4ae13fc5b306dc9068bf76c8030f896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:09:14.507 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 podman[63890]: 2024-09-15 22:09:14.482662593 +0000 UTC m=+0.326546997 container start d4d313e0dadb8e367cbcf60530693a7fe4ae13fc5b306dc9068bf76c8030f896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:09:14.526 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:14 smithi150 ceph-mon[30886]: Deploying daemon mds.k on smithi154 2024-09-15T22:09:14.526 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:14 smithi150 ceph-mon[30886]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:14 smithi169 ceph-mon[35850]: Deploying daemon mds.k on smithi154 2024-09-15T22:09:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:14 smithi169 ceph-mon[35850]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:14.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.763+0000 7f0c87e00640 1 -- 172.21.15.150:0/220880752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88077040 msgr2=0x7f0c88112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.763+0000 7f0c87e00640 1 --2- 172.21.15.150:0/220880752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88077040 0x7f0c88112330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009900 tx=0x7f0c7002a410 comp rx=0 tx=0).stop 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 -- 172.21.15.150:0/220880752 shutdown_connections 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 --2- 172.21.15.150:0/220880752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c88112870 0x7f0c88114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 --2- 172.21.15.150:0/220880752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88077040 0x7f0c88112330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 --2- 172.21.15.150:0/220880752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88076720 0x7f0c88076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 -- 172.21.15.150:0/220880752 >> 172.21.15.150:0/220880752 conn(0x7f0c880ff8d0 msgr2=0x7f0c88101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 -- 172.21.15.150:0/220880752 shutdown_connections 2024-09-15T22:09:14.766 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.764+0000 7f0c87e00640 1 -- 172.21.15.150:0/220880752 wait complete. 2024-09-15T22:09:14.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 Processor -- start 2024-09-15T22:09:14.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 -- start start 2024-09-15T22:09:14.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c88076720 0x7f0c881a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 0x7f0c881a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.767 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88112870 0x7f0c8819e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88118440 con 0x7f0c88112870 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881182c0 con 0x7f0c88077040 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c87e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881185c0 con 0x7f0c88076720 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c7e000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 0x7f0c881a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.765+0000 7f0c7e000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 0x7f0c881a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:56252/0 (socket says 172.21.15.150:56252) 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 -- 172.21.15.150:0/1256294881 learned_addr learned my addr 172.21.15.150:0/1256294881 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c86a00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c88076720 0x7f0c881a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.768 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c87400640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88112870 0x7f0c8819e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 -- 172.21.15.150:0/1256294881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c88076720 msgr2=0x7f0c881a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c88076720 0x7f0c881a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 -- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88112870 msgr2=0x7f0c8819e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:14.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88112870 0x7f0c8819e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:14.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 -- 172.21.15.150:0/1256294881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8819efa0 con 0x7f0c88077040 2024-09-15T22:09:14.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.766+0000 7f0c7e000640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 0x7f0c881a4ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c70004770 tx=0x7f0c70003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.767+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7003f070 con 0x7f0c88077040 2024-09-15T22:09:14.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.767+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c70031ca0 con 0x7f0c88077040 2024-09-15T22:09:14.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.767+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70035030 con 0x7f0c88077040 2024-09-15T22:09:14.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.767+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8819f230 con 0x7f0c88077040 2024-09-15T22:09:14.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.767+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c881ab410 con 0x7f0c88077040 2024-09-15T22:09:14.770 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.768+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c88077e60 con 0x7f0c88077040 2024-09-15T22:09:14.771 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 ceph-mds[63910]: -- 172.21.15.154:0/1065284523 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d639b9860 con 0x556d63997400 2024-09-15T22:09:14.771 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k[63906]: starting mds.k at 2024-09-15T22:09:14.771 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 bash[63890]: d4d313e0dadb8e367cbcf60530693a7fe4ae13fc5b306dc9068bf76c8030f896 2024-09-15T22:09:14.771 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:09:14 smithi154 systemd[1]: Started Ceph mds.k for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:14.771 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.770+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0c70042070 con 0x7f0c88077040 2024-09-15T22:09:14.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.771+0000 7f0c7fe00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0c6c0a32c0 0x7f0c6c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:14.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.771+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0c700efdd0 con 0x7f0c88077040 2024-09-15T22:09:14.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.771+0000 7f0c86a00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0c6c0a32c0 0x7f0c6c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:14.773 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.772+0000 7f0c86a00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0c6c0a32c0 0x7f0c6c0a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c780099a0 tx=0x7f0c78009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:14.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.773+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c70049030 con 0x7f0c88077040 2024-09-15T22:09:14.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.994+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c8810da00 con 0x7f0c88077040 2024-09-15T22:09:14.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.995+0000 7f0c7fe00640 1 -- 172.21.15.150:0/1256294881 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f0c700bcfb0 con 0x7f0c88077040 2024-09-15T22:09:14.997 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:14.997 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":2,"btime":"2024-09-15T22:09:12:246390+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:09:14.997 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 2 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0c6c0a32c0 msgr2=0x7f0c6c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0c6c0a32c0 0x7f0c6c0a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c780099a0 tx=0x7f0c78009500 comp rx=0 tx=0).stop 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 msgr2=0x7f0c881a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 0x7f0c881a4ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c70004770 tx=0x7f0c70003c10 comp rx=0 tx=0).stop 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 shutdown_connections 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0c6c0a32c0 0x7f0c6c0a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88112870 0x7f0c8819e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c88077040 0x7f0c881a4ba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 --2- 172.21.15.150:0/1256294881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c88076720 0x7f0c881a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 >> 172.21.15.150:0/1256294881 conn(0x7f0c880ff8d0 msgr2=0x7f0c88113470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:15.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 shutdown_connections 2024-09-15T22:09:15.001 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:14.998+0000 7f0c87e00640 1 -- 172.21.15.150:0/1256294881 wait complete. 2024-09-15T22:09:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:15.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: Deploying daemon mds.j on smithi150 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1256294881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6832/1449001850,v1:172.21.15.154:6833/1449001850] up:boot 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: fsmap 2 up:standby 2024-09-15T22:09:15.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:15 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: Deploying daemon mds.j on smithi150 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1256294881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6832/1449001850,v1:172.21.15.154:6833/1449001850] up:boot 2024-09-15T22:09:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: fsmap 2 up:standby 2024-09-15T22:09:15.961 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:15 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:09:16.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:16.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:16.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:16.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:16.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: Deploying daemon mds.j on smithi150 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1256294881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6832/1449001850,v1:172.21.15.154:6833/1449001850] up:boot 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: fsmap 2 up:standby 2024-09-15T22:09:16.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:15 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:09:17.837 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:17 smithi150 systemd[1]: Starting Ceph mds.j for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:17.860 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:18.093 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:17 smithi150 podman[70604]: 2024-09-15 22:09:17.739734284 +0000 UTC m=+0.027200307 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:18.093 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:17 smithi150 podman[70604]: 2024-09-15 22:09:17.872723008 +0000 UTC m=+0.160189009 container create e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:09:18.093 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:18 smithi150 podman[70604]: 2024-09-15 22:09:18.091897466 +0000 UTC m=+0.379363476 container init e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T22:09:18.302 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:18.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:18 smithi150 ceph-mon[30886]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:18.426 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:18 smithi150 podman[70604]: 2024-09-15 22:09:18.100395551 +0000 UTC m=+0.387861555 container start e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-15T22:09:18.426 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:18 smithi150 ceph-mds[70643]: -- 172.21.15.150:0/3751708562 <== mon.0 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a5cf75860 con 0x559a5cf52800 2024-09-15T22:09:18.426 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j[70637]: starting mds.j at 2024-09-15T22:09:18.426 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:18 smithi150 bash[70604]: e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 2024-09-15T22:09:18.427 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:09:18 smithi150 systemd[1]: Started Ceph mds.j for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:18.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:18 smithi169 ceph-mon[35850]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:18 smithi154 ceph-mon[34853]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:18.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 -- 172.21.15.150:0/3887810519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 msgr2=0x7fa1041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 --2- 172.21.15.150:0/3887810519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa1041021c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009900 tx=0x7fa0f402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 -- 172.21.15.150:0/3887810519 shutdown_connections 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 --2- 172.21.15.150:0/3887810519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 0x7fa10410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 --2- 172.21.15.150:0/3887810519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 0x7fa1041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 --2- 172.21.15.150:0/3887810519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa1041021c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 -- 172.21.15.150:0/3887810519 >> 172.21.15.150:0/3887810519 conn(0x7fa1040fd8c0 msgr2=0x7fa1040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 -- 172.21.15.150:0/3887810519 shutdown_connections 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.823+0000 7fa10a800640 1 -- 172.21.15.150:0/3887810519 wait complete. 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.824+0000 7fa10a800640 1 Processor -- start 2024-09-15T22:09:18.827 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 -- start start 2024-09-15T22:09:18.828 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa104075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 0x7fa104070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 0x7fa1040713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa104111f70 con 0x7fa104101de0 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa104111df0 con 0x7fa104102790 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa10a800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041120f0 con 0x7fa104106f10 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa103400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa104075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa103400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa104075dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:52294/0 (socket says 172.21.15.150:52294) 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa103400640 1 -- 172.21.15.150:0/3811720100 learned_addr learned my addr 172.21.15.150:0/3811720100 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa0faa00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 0x7fa104070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.825+0000 7fa103e00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 0x7fa1040713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.829 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103400640 1 -- 172.21.15.150:0/3811720100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 msgr2=0x7fa1040713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103400640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 0x7fa1040713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103400640 1 -- 172.21.15.150:0/3811720100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 msgr2=0x7fa104070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103400640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 0x7fa104070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103400640 1 -- 172.21.15.150:0/3811720100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa104071ad0 con 0x7fa104101de0 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103e00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 0x7fa1040713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa0faa00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 0x7fa104070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa103400640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa104075dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4006010 tx=0x7fa0f4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f403f030 con 0x7fa104101de0 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0f4004440 con 0x7fa104101de0 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4035070 con 0x7fa104101de0 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.826+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041af450 con 0x7fa104101de0 2024-09-15T22:09:18.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.827+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041af7f0 con 0x7fa104101de0 2024-09-15T22:09:18.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.828+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1041032c0 con 0x7fa104101de0 2024-09-15T22:09:18.831 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.830+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa0f4042030 con 0x7fa104101de0 2024-09-15T22:09:18.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.832+0000 7fa100c00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0e80a32c0 0x7fa0e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:18.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.832+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa0f40ef4e0 con 0x7fa104101de0 2024-09-15T22:09:18.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.832+0000 7fa0faa00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0e80a32c0 0x7fa0e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:18.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.833+0000 7fa0faa00640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0e80a32c0 0x7fa0e80a5780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa104072620 tx=0x7fa0ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:18.837 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:18.836+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0f40bc600 con 0x7fa104101de0 2024-09-15T22:09:19.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.056+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa10410a150 con 0x7fa104101de0 2024-09-15T22:09:19.058 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.057+0000 7fa100c00640 1 -- 172.21.15.150:0/3811720100 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3094 (secure 0 0 0) 0x7fa0f40bbf00 con 0x7fa104101de0 2024-09-15T22:09:19.059 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:19.059 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":4,"btime":"2024-09-15T22:09:18:180993+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-15T22:09:19.059 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 4 2024-09-15T22:09:19.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0e80a32c0 msgr2=0x7fa0e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:19.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0e80a32c0 0x7fa0e80a5780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa104072620 tx=0x7fa0ec005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 msgr2=0x7fa104075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa104075dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4006010 tx=0x7fa0f4004040 comp rx=0 tx=0).stop 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 shutdown_connections 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa104106f10 0x7fa1040713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa104102790 0x7fa104070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0e80a32c0 0x7fa0e80a5780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.059+0000 7fa10a800640 1 --2- 172.21.15.150:0/3811720100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa104101de0 0x7fa104075dd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.060+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 >> 172.21.15.150:0/3811720100 conn(0x7fa1040fd8c0 msgr2=0x7fa1040fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.060+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 shutdown_connections 2024-09-15T22:09:19.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:19.060+0000 7fa10a800640 1 -- 172.21.15.150:0/3811720100 wait complete. 2024-09-15T22:09:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.150:6834/3135790520,v1:172.21.15.150:6835/3135790520] up:boot 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: fsmap 3 up:standby 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:19.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:19 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3811720100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.150:6834/3135790520,v1:172.21.15.150:6835/3135790520] up:boot 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: fsmap 3 up:standby 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:19.449 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:19.450 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:19 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3811720100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.150:6834/3135790520,v1:172.21.15.150:6835/3135790520] up:boot 2024-09-15T22:09:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: fsmap 3 up:standby 2024-09-15T22:09:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:09:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:19.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:19.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:19.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:19.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:19 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3811720100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:20.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:20 smithi169 ceph-mon[35850]: Deploying daemon mds.d on smithi150 2024-09-15T22:09:20.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:20 smithi169 ceph-mon[35850]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:20 smithi154 ceph-mon[34853]: Deploying daemon mds.d on smithi150 2024-09-15T22:09:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:20 smithi154 ceph-mon[34853]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:20 smithi150 ceph-mon[30886]: Deploying daemon mds.d on smithi150 2024-09-15T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:20 smithi150 ceph-mon[30886]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:21.176 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:20 smithi150 systemd[1]: Starting Ceph mds.d for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:21.508 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 podman[71012]: 2024-09-15 22:09:21.127631896 +0000 UTC m=+0.027661546 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:21.508 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 podman[71012]: 2024-09-15 22:09:21.233719629 +0000 UTC m=+0.133749271 container create 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True) 2024-09-15T22:09:21.508 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 podman[71012]: 2024-09-15 22:09:21.461801578 +0000 UTC m=+0.361831221 container init 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:09:21.508 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 podman[71012]: 2024-09-15 22:09:21.468328298 +0000 UTC m=+0.368357949 container start 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-15T22:09:21.926 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 ceph-mds[71031]: -- 172.21.15.150:0/2752295714 <== mon.0 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba14c89860 con 0x55ba14c67400 2024-09-15T22:09:21.926 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d[71027]: starting mds.d at 2024-09-15T22:09:21.927 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 bash[71012]: 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c 2024-09-15T22:09:21.927 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:09:21 smithi150 systemd[1]: Started Ceph mds.d for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:22.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:22.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.392 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:22.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:22.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:22 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:22.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:22.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:22.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:22.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:22 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:22.616 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:22.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:22.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:22.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:22.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:22.671 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:22 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:22.991 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:23 smithi150 ceph-mon[30886]: Deploying daemon mds.e on smithi154 2024-09-15T22:09:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:23 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.150:6836/2570378588,v1:172.21.15.150:6837/2570378588] up:boot 2024-09-15T22:09:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:23 smithi150 ceph-mon[30886]: fsmap 4 up:standby 2024-09-15T22:09:23.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:23 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:09:23.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:23 smithi154 ceph-mon[34853]: Deploying daemon mds.e on smithi154 2024-09-15T22:09:23.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:23 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.150:6836/2570378588,v1:172.21.15.150:6837/2570378588] up:boot 2024-09-15T22:09:23.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:23 smithi154 ceph-mon[34853]: fsmap 4 up:standby 2024-09-15T22:09:23.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:23 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:09:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:23 smithi169 ceph-mon[35850]: Deploying daemon mds.e on smithi154 2024-09-15T22:09:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:23 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.150:6836/2570378588,v1:172.21.15.150:6837/2570378588] up:boot 2024-09-15T22:09:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:23 smithi169 ceph-mon[35850]: fsmap 4 up:standby 2024-09-15T22:09:23.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:23 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:09:23.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 -- 172.21.15.150:0/1102099609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c101de0 msgr2=0x7f2f1c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1102099609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c101de0 0x7f2f1c1021c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009900 tx=0x7f2f0c02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 -- 172.21.15.150:0/1102099609 shutdown_connections 2024-09-15T22:09:23.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1102099609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f1c106f10 0x7f2f1c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1102099609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f1c102790 0x7f2f1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1102099609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c101de0 0x7f2f1c1021c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 -- 172.21.15.150:0/1102099609 >> 172.21.15.150:0/1102099609 conn(0x7f2f1c0fd8c0 msgr2=0x7f2f1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 -- 172.21.15.150:0/1102099609 shutdown_connections 2024-09-15T22:09:23.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.460+0000 7f2f23c00640 1 -- 172.21.15.150:0/1102099609 wait complete. 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.461+0000 7f2f23c00640 1 Processor -- start 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.461+0000 7f2f23c00640 1 -- start start 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.461+0000 7f2f23c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f1c101de0 0x7f2f1c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.461+0000 7f2f23c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 0x7f2f1c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f23c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f1c106f10 0x7f2f1c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f23c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c111f70 con 0x7f2f1c106f10 2024-09-15T22:09:23.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f23c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c111df0 con 0x7f2f1c102790 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f23c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c1120f0 con 0x7f2f1c101de0 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 0x7f2f1c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 0x7f2f1c1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:34820/0 (socket says 172.21.15.150:34820) 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 -- 172.21.15.150:0/1322491745 learned_addr learned my addr 172.21.15.150:0/1322491745 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f21c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f1c106f10 0x7f2f1c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f21200640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f1c101de0 0x7f2f1c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 -- 172.21.15.150:0/1322491745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f1c101de0 msgr2=0x7f2f1c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f1c101de0 0x7f2f1c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 -- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f1c106f10 msgr2=0x7f2f1c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f1c106f10 0x7f2f1c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.462+0000 7f2f13e00640 1 -- 172.21.15.150:0/1322491745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c19d460 con 0x7f2f1c102790 2024-09-15T22:09:23.466 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.463+0000 7f2f13e00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 0x7f2f1c1989f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400d950 tx=0x7f2f0400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.463+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04017030 con 0x7f2f1c102790 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.463+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f04004020 con 0x7f2f1c102790 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.463+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040047a0 con 0x7f2f1c102790 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.463+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c19d750 con 0x7f2f1c102790 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.463+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c1a5030 con 0x7f2f1c102790 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.464+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c1021c0 con 0x7f2f1c102790 2024-09-15T22:09:23.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.466+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f2f040041d0 con 0x7f2f1c102790 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.467+0000 7f2f1a000640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2f000a3240 0x7f2f000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.467+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f2f040cee50 con 0x7f2f1c102790 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.467+0000 7f2f21200640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2f000a3240 0x7f2f000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:23.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.468+0000 7f2f21200640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2f000a3240 0x7f2f000a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009230 tx=0x7f2f0c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:23.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.471+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f0409bf70 con 0x7f2f1c102790 2024-09-15T22:09:23.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.679+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f1c02d7c0 con 0x7f2f1c102790 2024-09-15T22:09:23.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.680+0000 7f2f1a000640 1 -- 172.21.15.150:0/1322491745 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3922 (secure 0 0 0) 0x7f2f0409b870 con 0x7f2f1c102790 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":5,"btime":"2024-09-15T22:09:22:192244+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-15T22:09:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 5 2024-09-15T22:09:23.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2f000a3240 msgr2=0x7f2f000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2f000a3240 0x7f2f000a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009230 tx=0x7f2f0c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 msgr2=0x7f2f1c1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:23.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 0x7f2f1c1989f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400d950 tx=0x7f2f0400de10 comp rx=0 tx=0).stop 2024-09-15T22:09:23.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 shutdown_connections 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2f000a3240 0x7f2f000a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f1c106f10 0x7f2f1c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1c102790 0x7f2f1c1989f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 --2- 172.21.15.150:0/1322491745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f1c101de0 0x7f2f1c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 >> 172.21.15.150:0/1322491745 conn(0x7f2f1c0fd8c0 msgr2=0x7f2f1c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 shutdown_connections 2024-09-15T22:09:23.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:23.682+0000 7f2f23c00640 1 -- 172.21.15.150:0/1322491745 wait complete. 2024-09-15T22:09:23.771 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:23 smithi154 systemd[1]: Starting Ceph mds.e for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:24.095 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:23 smithi154 podman[64206]: 2024-09-15 22:09:23.739819988 +0000 UTC m=+0.016063298 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:24.095 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:23 smithi154 podman[64206]: 2024-09-15 22:09:23.864810466 +0000 UTC m=+0.141053765 container create f237e2dabed1f49bb5f76e7ef14f2ebbdf955ae68806ae8ad2b595b3077145e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T22:09:24.095 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:24 smithi154 podman[64206]: 2024-09-15 22:09:24.067262184 +0000 UTC m=+0.343505484 container init f237e2dabed1f49bb5f76e7ef14f2ebbdf955ae68806ae8ad2b595b3077145e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:09:24.095 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:24 smithi154 podman[64206]: 2024-09-15 22:09:24.070148413 +0000 UTC m=+0.346391727 container start f237e2dabed1f49bb5f76e7ef14f2ebbdf955ae68806ae8ad2b595b3077145e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:09:24.095 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mds[64225]: -- 172.21.15.154:0/87118918 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5603ee099860 con 0x5603ee076800 2024-09-15T22:09:24.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:24.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1322491745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:24.370 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:24.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:24.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:24 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:24.521 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e[64221]: starting mds.e at 2024-09-15T22:09:24.521 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:24 smithi154 bash[64206]: f237e2dabed1f49bb5f76e7ef14f2ebbdf955ae68806ae8ad2b595b3077145e2 2024-09-15T22:09:24.521 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:09:24 smithi154 systemd[1]: Started Ceph mds.e for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1322491745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:24.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:24 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:24.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:24.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1322491745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:24.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.620 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.620 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:24.620 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:24.620 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:24.620 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:24 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:25 smithi154 ceph-mon[34853]: Deploying daemon mds.f on smithi169 2024-09-15T22:09:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:25 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] up:boot 2024-09-15T22:09:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:25 smithi154 ceph-mon[34853]: fsmap 5 up:standby 2024-09-15T22:09:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:09:25.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:25 smithi169 ceph-mon[35850]: Deploying daemon mds.f on smithi169 2024-09-15T22:09:25.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:25 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] up:boot 2024-09-15T22:09:25.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:25 smithi169 ceph-mon[35850]: fsmap 5 up:standby 2024-09-15T22:09:25.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:09:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:25 smithi150 ceph-mon[30886]: Deploying daemon mds.f on smithi169 2024-09-15T22:09:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:25 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] up:boot 2024-09-15T22:09:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:25 smithi150 ceph-mon[30886]: fsmap 5 up:standby 2024-09-15T22:09:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:09:26.209 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 systemd[1]: Starting Ceph mds.f for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:26.410 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:26.469 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:26 smithi150 ceph-mon[30886]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:26.510 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:26 smithi169 ceph-mon[35850]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:26.510 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 podman[65904]: 2024-09-15 22:09:26.145053962 +0000 UTC m=+0.016390616 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:26.510 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 podman[65904]: 2024-09-15 22:09:26.265286185 +0000 UTC m=+0.136622829 container create 75a7e58eea1c513282855d02a1261aabc51a30daf65b034bfe4e1963749d8131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-15T22:09:26.510 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 podman[65904]: 2024-09-15 22:09:26.509565125 +0000 UTC m=+0.380901770 container init 75a7e58eea1c513282855d02a1261aabc51a30daf65b034bfe4e1963749d8131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-15T22:09:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:26 smithi154 ceph-mon[34853]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:26.796 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:26.959 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 podman[65904]: 2024-09-15 22:09:26.51247426 +0000 UTC m=+0.383810906 container start 75a7e58eea1c513282855d02a1261aabc51a30daf65b034bfe4e1963749d8131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:09:26.960 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 ceph-mds[65923]: -- 172.21.15.169:0/2255771787 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558118db1c20 con 0x558118d8f400 2024-09-15T22:09:26.960 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f[65919]: starting mds.f at 2024-09-15T22:09:26.960 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 bash[65904]: 75a7e58eea1c513282855d02a1261aabc51a30daf65b034bfe4e1963749d8131 2024-09-15T22:09:26.960 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:09:26 smithi169 systemd[1]: Started Ceph mds.f for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:27.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 -- 172.21.15.150:0/1021882558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 msgr2=0x7f01fc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 --2- 172.21.15.150:0/1021882558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc1043d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009900 tx=0x7f01ec02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 -- 172.21.15.150:0/1021882558 shutdown_connections 2024-09-15T22:09:27.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 --2- 172.21.15.150:0/1021882558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01fc109120 0x7f01fc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 --2- 172.21.15.150:0/1021882558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc1049a0 0x7f01fc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 --2- 172.21.15.150:0/1021882558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc1043d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 -- 172.21.15.150:0/1021882558 >> 172.21.15.150:0/1021882558 conn(0x7f01fc0ffa90 msgr2=0x7f01fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 -- 172.21.15.150:0/1021882558 shutdown_connections 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.274+0000 7f0202600640 1 -- 172.21.15.150:0/1021882558 wait complete. 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.275+0000 7f0202600640 1 Processor -- start 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.275+0000 7f0202600640 1 -- start start 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f0202600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f0202600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc1049a0 0x7f01fc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f0202600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01fc109120 0x7f01fc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f0202600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc114150 con 0x7f01fc103ff0 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f0202600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc113fd0 con 0x7f01fc1049a0 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f0202600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc1142d0 con 0x7f01fc109120 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:51672/0 (socket says 172.21.15.150:51672) 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 -- 172.21.15.150:0/1465929963 learned_addr learned my addr 172.21.15.150:0/1465929963 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01faa00640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc1049a0 0x7f01fc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fbe00640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01fc109120 0x7f01fc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 -- 172.21.15.150:0/1465929963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01fc109120 msgr2=0x7f01fc19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01fc109120 0x7f01fc19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 -- 172.21.15.150:0/1465929963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc1049a0 msgr2=0x7f01fc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.283 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc1049a0 0x7f01fc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.276+0000 7f01fb400640 1 -- 172.21.15.150:0/1465929963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc19f5a0 con 0x7f01fc103ff0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.277+0000 7f01fb400640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc19a5f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f01ec006010 tx=0x7f01ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.277+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec03f030 con 0x7f01fc103ff0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.277+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc19f830 con 0x7f01fc103ff0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.277+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec003ce0 con 0x7f01fc103ff0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.277+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec035070 con 0x7f01fc103ff0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.277+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1a7170 con 0x7f01fc103ff0 2024-09-15T22:09:27.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.278+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc1054d0 con 0x7f01fc103ff0 2024-09-15T22:09:27.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.280+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f01ec042030 con 0x7f01fc103ff0 2024-09-15T22:09:27.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.281+0000 7f01f3e00640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01e00a3240 0x7f01e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:27.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.281+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f01ec0efcc0 con 0x7f01fc103ff0 2024-09-15T22:09:27.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.282+0000 7f01faa00640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01e00a3240 0x7f01e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:27.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.282+0000 7f01faa00640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01e00a3240 0x7f01e00a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ffeb0 tx=0x7f01e800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:27.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.284+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01ec0bcea0 con 0x7f01fc103ff0 2024-09-15T22:09:27.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.491+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01fc1043d0 con 0x7f01fc103ff0 2024-09-15T22:09:27.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.491+0000 7f01f3e00640 1 -- 172.21.15.150:0/1465929963 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5575 (secure 0 0 0) 0x7f01ec0bc7a0 con 0x7f01fc103ff0 2024-09-15T22:09:27.493 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:27.494 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":7,"btime":"2024-09-15T22:09:27:215948+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-15T22:09:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 7 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01e00a3240 msgr2=0x7f01e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01e00a3240 0x7f01e00a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ffeb0 tx=0x7f01e800b410 comp rx=0 tx=0).stop 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 msgr2=0x7f01fc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc19a5f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f01ec006010 tx=0x7f01ec0042f0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 shutdown_connections 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01fc109120 0x7f01fc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc1049a0 0x7f01fc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f01e00a3240 0x7f01e00a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 --2- 172.21.15.150:0/1465929963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01fc103ff0 0x7f01fc19a5f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 >> 172.21.15.150:0/1465929963 conn(0x7f01fc0ffa90 msgr2=0x7f01fc100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 shutdown_connections 2024-09-15T22:09:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:27.494+0000 7f0202600640 1 -- 172.21.15.150:0/1465929963 wait complete. 2024-09-15T22:09:27.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:27.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: Deploying daemon mds.c on smithi169 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6834/721825855,v1:172.21.15.169:6835/721825855] up:boot 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: fsmap 6 up:standby 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:09:27.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:27 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1465929963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: Deploying daemon mds.c on smithi169 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6834/721825855,v1:172.21.15.169:6835/721825855] up:boot 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: fsmap 6 up:standby 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:09:27.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:27 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1465929963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:28.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:28.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:28.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:28.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: Deploying daemon mds.c on smithi169 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6834/721825855,v1:172.21.15.169:6835/721825855] up:boot 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: fsmap 6 up:standby 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:09:28.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:27 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1465929963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:28.709 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:28 smithi169 systemd[1]: Starting Ceph mds.c for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:29.081 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:28 smithi169 podman[66203]: 2024-09-15 22:09:28.76843824 +0000 UTC m=+0.111903358 container create bd2a963b669bdd12f30f4f0a552590351455785ab9bc28f865035b091118a298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-15T22:09:29.081 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:28 smithi169 podman[66203]: 2024-09-15 22:09:28.672775324 +0000 UTC m=+0.016240450 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:29.081 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:28 smithi169 podman[66203]: 2024-09-15 22:09:28.987754921 +0000 UTC m=+0.331220048 container init bd2a963b669bdd12f30f4f0a552590351455785ab9bc28f865035b091118a298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:09:29.081 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:28 smithi169 podman[66203]: 2024-09-15 22:09:28.990593251 +0000 UTC m=+0.334058371 container start bd2a963b669bdd12f30f4f0a552590351455785ab9bc28f865035b091118a298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-15T22:09:29.081 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:29 smithi169 ceph-mds[66222]: -- 172.21.15.169:0/1349725318 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee5c9ff860 con 0x55ee5c9dd400 2024-09-15T22:09:29.082 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:29 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c[66218]: starting mds.c at 2024-09-15T22:09:29.082 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:29 smithi169 bash[66203]: bd2a963b669bdd12f30f4f0a552590351455785ab9bc28f865035b091118a298 2024-09-15T22:09:29.459 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:09:29 smithi169 systemd[1]: Started Ceph mds.c for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:30.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] up:boot 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: fsmap 7 up:standby 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:30.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:30 smithi150 ceph-mon[30886]: Deploying daemon mds.h on smithi154 2024-09-15T22:09:30.224 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:30.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] up:boot 2024-09-15T22:09:30.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: fsmap 7 up:standby 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:30.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:30 smithi154 ceph-mon[34853]: Deploying daemon mds.h on smithi154 2024-09-15T22:09:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] up:boot 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: fsmap 7 up:standby 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:30.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:30 smithi169 ceph-mon[35850]: Deploying daemon mds.h on smithi154 2024-09-15T22:09:30.608 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:31.021 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:30 smithi154 systemd[1]: Starting Ceph mds.h for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 -- 172.21.15.150:0/2788081629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 msgr2=0x7fc7501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 --2- 172.21.15.150:0/2788081629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc7501021c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc740009ca0 tx=0x7fc74002a8b0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 -- 172.21.15.150:0/2788081629 shutdown_connections 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 --2- 172.21.15.150:0/2788081629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc750106f10 0x7fc75010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 --2- 172.21.15.150:0/2788081629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750102790 0x7fc7501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 --2- 172.21.15.150:0/2788081629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc7501021c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.166+0000 7fc756e00640 1 -- 172.21.15.150:0/2788081629 >> 172.21.15.150:0/2788081629 conn(0x7fc7500fd8c0 msgr2=0x7fc7500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.167+0000 7fc756e00640 1 -- 172.21.15.150:0/2788081629 shutdown_connections 2024-09-15T22:09:31.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.167+0000 7fc756e00640 1 -- 172.21.15.150:0/2788081629 wait complete. 2024-09-15T22:09:31.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.167+0000 7fc756e00640 1 Processor -- start 2024-09-15T22:09:31.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 -- start start 2024-09-15T22:09:31.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc75019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:31.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc750102790 0x7fc75019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:31.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750106f10 0x7fc75019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:31.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc750111f70 con 0x7fc750101de0 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc750111df0 con 0x7fc750106f10 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc756e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7501120f0 con 0x7fc750102790 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc74fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc75019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc74fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc75019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39204/0 (socket says 172.21.15.150:39204) 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc74fe00640 1 -- 172.21.15.150:0/65594619 learned_addr learned my addr 172.21.15.150:0/65594619 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc747400640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc750102790 0x7fc75019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.168+0000 7fc754e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750106f10 0x7fc75019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74fe00640 1 -- 172.21.15.150:0/65594619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc750102790 msgr2=0x7fc75019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74fe00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc750102790 0x7fc75019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74fe00640 1 -- 172.21.15.150:0/65594619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750106f10 msgr2=0x7fc75019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74fe00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750106f10 0x7fc75019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74fe00640 1 -- 172.21.15.150:0/65594619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75019f610 con 0x7fc750101de0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74fe00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc75019a660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc74002add0 tx=0x7fc740030ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740004040 con 0x7fc750101de0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc740040070 con 0x7fc750101de0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740045c20 con 0x7fc750101de0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75019f8a0 con 0x7fc750101de0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.169+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7501a71e0 con 0x7fc750101de0 2024-09-15T22:09:31.173 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.170+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7501021c0 con 0x7fc750101de0 2024-09-15T22:09:31.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.172+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc7400041e0 con 0x7fc750101de0 2024-09-15T22:09:31.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.174+0000 7fc74d600640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc7340a32c0 0x7fc7340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:31.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.174+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fc7400f07a0 con 0x7fc750101de0 2024-09-15T22:09:31.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.174+0000 7fc747400640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc7340a32c0 0x7fc7340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:31.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.175+0000 7fc747400640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc7340a32c0 0x7fc7340a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc75010ee50 tx=0x7fc738005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:31.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.176+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7400bd9e0 con 0x7fc750101de0 2024-09-15T22:09:31.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.386+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc75019b9c0 con 0x7fc750101de0 2024-09-15T22:09:31.389 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.387+0000 7fc74d600640 1 -- 172.21.15.150:0/65594619 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6403 (secure 0 0 0) 0x7fc7400bd2e0 con 0x7fc750101de0 2024-09-15T22:09:31.389 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:31.389 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":8,"btime":"2024-09-15T22:09:29:069279+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-15T22:09:31.390 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 8 2024-09-15T22:09:31.391 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc7340a32c0 msgr2=0x7fc7340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:31.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc7340a32c0 0x7fc7340a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc75010ee50 tx=0x7fc738005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:31.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 msgr2=0x7fc75019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:31.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc75019a660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc74002add0 tx=0x7fc740030ed0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 shutdown_connections 2024-09-15T22:09:31.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750106f10 0x7fc75019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.392 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc750102790 0x7fc75019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc7340a32c0 0x7fc7340a5780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 --2- 172.21.15.150:0/65594619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc750101de0 0x7fc75019a660 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:31.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.389+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 >> 172.21.15.150:0/65594619 conn(0x7fc7500fd8c0 msgr2=0x7fc7500fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:31.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.390+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 shutdown_connections 2024-09-15T22:09:31.393 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:31.390+0000 7fc756e00640 1 -- 172.21.15.150:0/65594619 wait complete. 2024-09-15T22:09:31.455 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 podman[64508]: 2024-09-15 22:09:31.070193659 +0000 UTC m=+0.015512398 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:31.455 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 podman[64508]: 2024-09-15 22:09:31.185051146 +0000 UTC m=+0.130369875 container create 708640c9fd1eb27e84a67efc48037053c9f31a805eab30e11449e183e8aea80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T22:09:31.455 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 podman[64508]: 2024-09-15 22:09:31.387552793 +0000 UTC m=+0.332871522 container init 708640c9fd1eb27e84a67efc48037053c9f31a805eab30e11449e183e8aea80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:09:31.455 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 podman[64508]: 2024-09-15 22:09:31.390336729 +0000 UTC m=+0.335655477 container start 708640c9fd1eb27e84a67efc48037053c9f31a805eab30e11449e183e8aea80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-15T22:09:31.456 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 ceph-mds[64527]: -- 172.21.15.154:0/4193838047 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5586a1f55860 con 0x5586a1f33000 2024-09-15T22:09:31.456 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h[64523]: starting mds.h at 2024-09-15T22:09:31.456 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 bash[64508]: 708640c9fd1eb27e84a67efc48037053c9f31a805eab30e11449e183e8aea80e 2024-09-15T22:09:31.771 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:09:31 smithi154 systemd[1]: Started Ceph mds.h for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:32.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/65594619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:32.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:32 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/65594619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:32.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:32 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/65594619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:32.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:32.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:32 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:33.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:33 smithi150 ceph-mon[30886]: Deploying daemon mds.i on smithi169 2024-09-15T22:09:33.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:33 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] up:boot 2024-09-15T22:09:33.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:33 smithi150 ceph-mon[30886]: fsmap 8 up:standby 2024-09-15T22:09:33.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:33 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:09:33.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:33 smithi169 ceph-mon[35850]: Deploying daemon mds.i on smithi169 2024-09-15T22:09:33.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:33 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] up:boot 2024-09-15T22:09:33.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:33 smithi169 ceph-mon[35850]: fsmap 8 up:standby 2024-09-15T22:09:33.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:33 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:09:33.460 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 systemd[1]: Starting Ceph mds.i for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:33.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:33 smithi154 ceph-mon[34853]: Deploying daemon mds.i on smithi169 2024-09-15T22:09:33.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:33 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] up:boot 2024-09-15T22:09:33.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:33 smithi154 ceph-mon[34853]: fsmap 8 up:standby 2024-09-15T22:09:33.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:33 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:09:33.810 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 podman[66504]: 2024-09-15 22:09:33.461547568 +0000 UTC m=+0.016031159 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:33.810 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 podman[66504]: 2024-09-15 22:09:33.570894265 +0000 UTC m=+0.125377847 container create 244e3035a0116bcdb408edb359d54b7482d9a28de9983730f0a05714548f82ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:09:33.810 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 podman[66504]: 2024-09-15 22:09:33.781817276 +0000 UTC m=+0.336300858 container init 244e3035a0116bcdb408edb359d54b7482d9a28de9983730f0a05714548f82ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T22:09:33.810 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 podman[66504]: 2024-09-15 22:09:33.78463534 +0000 UTC m=+0.339118930 container start 244e3035a0116bcdb408edb359d54b7482d9a28de9983730f0a05714548f82ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T22:09:33.811 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 ceph-mds[66523]: -- 172.21.15.169:0/86985618 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1f0667860 con 0x55b1f0645000 2024-09-15T22:09:34.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:34.199 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i[66519]: starting mds.i at 2024-09-15T22:09:34.200 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 bash[66504]: 244e3035a0116bcdb408edb359d54b7482d9a28de9983730f0a05714548f82ae 2024-09-15T22:09:34.200 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:09:33 smithi169 systemd[1]: Started Ceph mds.i for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:34.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:34.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:34 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:34.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:34 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:34.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:34 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:35.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:35 smithi169 ceph-mon[35850]: Deploying daemon mds.g on smithi150 2024-09-15T22:09:35.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:35 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] up:boot 2024-09-15T22:09:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:35 smithi169 ceph-mon[35850]: fsmap 9 up:standby 2024-09-15T22:09:35.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:35 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:09:35.510 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:35 smithi150 ceph-mon[30886]: Deploying daemon mds.g on smithi150 2024-09-15T22:09:35.511 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:35 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] up:boot 2024-09-15T22:09:35.511 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:35 smithi150 ceph-mon[30886]: fsmap 9 up:standby 2024-09-15T22:09:35.511 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:35 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:09:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:35 smithi154 ceph-mon[34853]: Deploying daemon mds.g on smithi150 2024-09-15T22:09:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:35 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] up:boot 2024-09-15T22:09:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:35 smithi154 ceph-mon[34853]: fsmap 9 up:standby 2024-09-15T22:09:35.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:35 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:09:35.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 -- 172.21.15.150:0/3197089476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4103ff0 msgr2=0x7fb2f41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 --2- 172.21.15.150:0/3197089476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4103ff0 0x7fb2f41043d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009900 tx=0x7fb2e402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 -- 172.21.15.150:0/3197089476 shutdown_connections 2024-09-15T22:09:35.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 --2- 172.21.15.150:0/3197089476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f4109120 0x7fb2f4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 --2- 172.21.15.150:0/3197089476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 --2- 172.21.15.150:0/3197089476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4103ff0 0x7fb2f41043d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 -- 172.21.15.150:0/3197089476 >> 172.21.15.150:0/3197089476 conn(0x7fb2f40ffa90 msgr2=0x7fb2f4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 -- 172.21.15.150:0/3197089476 shutdown_connections 2024-09-15T22:09:35.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.618+0000 7fb2fb200640 1 -- 172.21.15.150:0/3197089476 wait complete. 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 Processor -- start 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 -- start start 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f4103ff0 0x7fb2f419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4109120 0x7fb2f419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f4114120 con 0x7fb2f4109120 2024-09-15T22:09:35.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f4113fa0 con 0x7fb2f4103ff0 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.619+0000 7fb2fb200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41142a0 con 0x7fb2f41049a0 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f9200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4109120 0x7fb2f419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:48934/0 (socket says 172.21.15.150:48934) 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 -- 172.21.15.150:0/2769691226 learned_addr learned my addr 172.21.15.150:0/2769691226 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f4103ff0 0x7fb2f419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 -- 172.21.15.150:0/2769691226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f4103ff0 msgr2=0x7fb2f419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f4103ff0 0x7fb2f419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 -- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4109120 msgr2=0x7fb2f419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4109120 0x7fb2f419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 -- 172.21.15.150:0/2769691226 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f419f590 con 0x7fb2f41049a0 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f9200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4109120 0x7fb2f419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:35.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.620+0000 7fb2f3400640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f419ab20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000ea60 tx=0x7fb2e000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.621+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000cde0 con 0x7fb2f41049a0 2024-09-15T22:09:35.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.621+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f419f880 con 0x7fb2f41049a0 2024-09-15T22:09:35.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.621+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e00035f0 con 0x7fb2f41049a0 2024-09-15T22:09:35.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.621+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0010670 con 0x7fb2f41049a0 2024-09-15T22:09:35.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.621+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f41a7160 con 0x7fb2f41049a0 2024-09-15T22:09:35.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.622+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f41043d0 con 0x7fb2f41049a0 2024-09-15T22:09:35.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.625+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb2e00037a0 con 0x7fb2f41049a0 2024-09-15T22:09:35.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.626+0000 7fb2f0c00640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb2d80a3240 0x7fb2d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:35.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.626+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fb2e00cf880 con 0x7fb2f41049a0 2024-09-15T22:09:35.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.626+0000 7fb2f3e00640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb2d80a3240 0x7fb2d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:35.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.627+0000 7fb2f3e00640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb2d80a3240 0x7fb2d80a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009230 tx=0x7fb2e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:35.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.627+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2e009ca30 con 0x7fb2f41049a0 2024-09-15T22:09:35.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.847+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2f419b940 con 0x7fb2f41049a0 2024-09-15T22:09:35.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.848+0000 7fb2f0c00640 1 -- 172.21.15.150:0/2769691226 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8061 (secure 0 0 0) 0x7fb2f419b940 con 0x7fb2f41049a0 2024-09-15T22:09:35.850 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:35.850 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":10,"btime":"2024-09-15T22:09:34:197322+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-15T22:09:35.851 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 10 2024-09-15T22:09:35.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb2d80a3240 msgr2=0x7fb2d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb2d80a3240 0x7fb2d80a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009230 tx=0x7fb2e40058d0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 msgr2=0x7fb2f419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f419ab20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000ea60 tx=0x7fb2e000ef20 comp rx=0 tx=0).stop 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 shutdown_connections 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb2d80a3240 0x7fb2d80a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb2f4109120 0x7fb2f419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2f41049a0 0x7fb2f419ab20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 --2- 172.21.15.150:0/2769691226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f4103ff0 0x7fb2f419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.850+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 >> 172.21.15.150:0/2769691226 conn(0x7fb2f40ffa90 msgr2=0x7fb2f4100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.851+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 shutdown_connections 2024-09-15T22:09:35.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:35.851+0000 7fb2fb200640 1 -- 172.21.15.150:0/2769691226 wait complete. 2024-09-15T22:09:36.479 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:36 smithi154 ceph-mon[34853]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:36.479 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:36 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2769691226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:36.635 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:36 smithi150 ceph-mon[30886]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:36.635 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:36 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2769691226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:36 smithi169 ceph-mon[35850]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:36 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2769691226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:37.631 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 podman[71773]: 2024-09-15 22:09:37.385500503 +0000 UTC m=+0.165399433 container create ee9ee4ad915d61b02b140978cc892f35ddee1e418beea103a0fcfeb1ad98ced2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-15T22:09:37.631 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 podman[71773]: 2024-09-15 22:09:37.629773028 +0000 UTC m=+0.409671919 container init ee9ee4ad915d61b02b140978cc892f35ddee1e418beea103a0fcfeb1ad98ced2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:09:37.926 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 podman[71773]: 2024-09-15 22:09:37.636303507 +0000 UTC m=+0.416202400 container start ee9ee4ad915d61b02b140978cc892f35ddee1e418beea103a0fcfeb1ad98ced2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-15T22:09:37.926 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 ceph-mds[71792]: -- 172.21.15.150:0/1659648605 <== mon.0 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558da7fe9c20 con 0x558da7fc7000 2024-09-15T22:09:37.926 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g[71788]: starting mds.g at 2024-09-15T22:09:37.926 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 bash[71773]: ee9ee4ad915d61b02b140978cc892f35ddee1e418beea103a0fcfeb1ad98ced2 2024-09-15T22:09:37.926 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:09:37 smithi150 systemd[1]: Started Ceph mds.g for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:38.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:38.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:38.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:38.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:38 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:38.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:38 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:38.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:38 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:39.121 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:39 smithi150 ceph-mon[30886]: Deploying daemon mds.a on smithi150 2024-09-15T22:09:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:39 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.150:6838/715300877,v1:172.21.15.150:6839/715300877] up:boot 2024-09-15T22:09:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:39 smithi150 ceph-mon[30886]: fsmap 10 up:standby 2024-09-15T22:09:39.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:39 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:09:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:39 smithi154 ceph-mon[34853]: Deploying daemon mds.a on smithi150 2024-09-15T22:09:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:39 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.150:6838/715300877,v1:172.21.15.150:6839/715300877] up:boot 2024-09-15T22:09:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:39 smithi154 ceph-mon[34853]: fsmap 10 up:standby 2024-09-15T22:09:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:39 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:09:39.598 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:39 smithi169 ceph-mon[35850]: Deploying daemon mds.a on smithi150 2024-09-15T22:09:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:39 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.150:6838/715300877,v1:172.21.15.150:6839/715300877] up:boot 2024-09-15T22:09:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:39 smithi169 ceph-mon[35850]: fsmap 10 up:standby 2024-09-15T22:09:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:39 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:09:40.141 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 -- 172.21.15.150:0/73258630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 msgr2=0x7fd7ac107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 --2- 172.21.15.150:0/73258630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 0x7fd7ac107db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009890 tx=0x7fd79c02a360 comp rx=0 tx=0).stop 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 -- 172.21.15.150:0/73258630 shutdown_connections 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 --2- 172.21.15.150:0/73258630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7ac102370 0x7fd7ac10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 --2- 172.21.15.150:0/73258630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac1019d0 0x7fd7ac101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 --2- 172.21.15.150:0/73258630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 0x7fd7ac107db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 -- 172.21.15.150:0/73258630 >> 172.21.15.150:0/73258630 conn(0x7fd7ac0fd710 msgr2=0x7fd7ac0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 -- 172.21.15.150:0/73258630 shutdown_connections 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.130+0000 7fd7ab200640 1 -- 172.21.15.150:0/73258630 wait complete. 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 Processor -- start 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 -- start start 2024-09-15T22:09:40.142 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7ac1019d0 0x7fd7ac19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 0x7fd7ac19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 0x7fd7ac19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac111dd0 con 0x7fd7ac1019d0 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac111c50 con 0x7fd7ac102370 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7ab200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac111f50 con 0x7fd7ac1079d0 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.131+0000 7fd7a9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7ac1019d0 0x7fd7ac19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 0x7fd7ac19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 0x7fd7ac19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36056/0 (socket says 172.21.15.150:36056) 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 -- 172.21.15.150:0/4180485197 learned_addr learned my addr 172.21.15.150:0/4180485197 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7aa800640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 0x7fd7ac19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 -- 172.21.15.150:0/4180485197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 msgr2=0x7fd7ac19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 0x7fd7ac19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 -- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7ac1019d0 msgr2=0x7fd7ac19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7ac1019d0 0x7fd7ac19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 -- 172.21.15.150:0/4180485197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac19f470 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.132+0000 7fd7a9400640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 0x7fd7ac19aa00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e9f0 tx=0x7fd79800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.133+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800cd80 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.133+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd798005500 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.133+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac19f760 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.133+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798010690 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.133+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac1a7040 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.134+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac101e30 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.136+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fd7980046c0 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.137+0000 7fd7a2a00640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7900a3240 0x7fd7900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.137+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd7980cfbe0 con 0x7fd7ac102370 2024-09-15T22:09:40.144 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.137+0000 7fd7a9e00640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7900a3240 0x7fd7900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:40.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.138+0000 7fd7a9e00640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7900a3240 0x7fd7900a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd79c02a950 tx=0x7fd79c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:40.145 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.139+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd79809cd00 con 0x7fd7ac102370 2024-09-15T22:09:40.372 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:40 smithi150 ceph-mon[30886]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:40.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.369+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7ac19b820 con 0x7fd7ac102370 2024-09-15T22:09:40.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.370+0000 7fd7a2a00640 1 -- 172.21.15.150:0/4180485197 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8887 (secure 0 0 0) 0x7fd7ac19b820 con 0x7fd7ac102370 2024-09-15T22:09:40.373 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:40.373 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 11 2024-09-15T22:09:40.373 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":11,"btime":"2024-09-15T22:09:38:212054+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7900a3240 msgr2=0x7fd7900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7900a3240 0x7fd7900a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd79c02a950 tx=0x7fd79c0056d0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 msgr2=0x7fd7ac19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 0x7fd7ac19aa00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd79800e9f0 tx=0x7fd79800edf0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 shutdown_connections 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7ac1079d0 0x7fd7ac19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7ac102370 0x7fd7ac19aa00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7900a3240 0x7fd7900a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 --2- 172.21.15.150:0/4180485197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7ac1019d0 0x7fd7ac19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:40.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.373+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 >> 172.21.15.150:0/4180485197 conn(0x7fd7ac0fd710 msgr2=0x7fd7ac0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:40.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.374+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 shutdown_connections 2024-09-15T22:09:40.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:40.374+0000 7fd7ab200640 1 -- 172.21.15.150:0/4180485197 wait complete. 2024-09-15T22:09:40.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:40 smithi154 ceph-mon[34853]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:40 smithi169 ceph-mon[35850]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:41.331 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:41 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/4180485197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:41 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/4180485197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:41.676 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:09:41 smithi150 systemd[1]: Started Ceph mds.a for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:41.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:41 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/4180485197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:42.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:42.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:42.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:42.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:42 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:42.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:42.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:42 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:09:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:09:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:42 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:43.075 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:43.380 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:43 smithi154 ceph-mon[34853]: Deploying daemon mds.b on smithi154 2024-09-15T22:09:43.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:43 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.150:6840/1726301246,v1:172.21.15.150:6841/1726301246] up:boot 2024-09-15T22:09:43.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:43 smithi154 ceph-mon[34853]: fsmap 11 up:standby 2024-09-15T22:09:43.381 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:09:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:43 smithi150 ceph-mon[30886]: Deploying daemon mds.b on smithi154 2024-09-15T22:09:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:43 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.150:6840/1726301246,v1:172.21.15.150:6841/1726301246] up:boot 2024-09-15T22:09:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:43 smithi150 ceph-mon[30886]: fsmap 11 up:standby 2024-09-15T22:09:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:09:43.471 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:43 smithi169 ceph-mon[35850]: Deploying daemon mds.b on smithi154 2024-09-15T22:09:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:43 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.150:6840/1726301246,v1:172.21.15.150:6841/1726301246] up:boot 2024-09-15T22:09:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:43 smithi169 ceph-mon[35850]: fsmap 11 up:standby 2024-09-15T22:09:43.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:09:43.771 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:43 smithi154 systemd[1]: Starting Ceph mds.b for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:09:43.975 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.972+0000 7fbf18800640 1 -- 172.21.15.150:0/2448132330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 msgr2=0x7fbf10110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.972+0000 7fbf18800640 1 --2- 172.21.15.150:0/2448132330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 0x7fbf10110ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009ca0 tx=0x7fbf0c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.972+0000 7fbf18800640 1 -- 172.21.15.150:0/2448132330 shutdown_connections 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.972+0000 7fbf18800640 1 --2- 172.21.15.150:0/2448132330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 0x7fbf10110ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.973+0000 7fbf18800640 1 --2- 172.21.15.150:0/2448132330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf101049a0 0x7fbf101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.973+0000 7fbf18800640 1 --2- 172.21.15.150:0/2448132330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf10103ff0 0x7fbf101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.973+0000 7fbf18800640 1 -- 172.21.15.150:0/2448132330 >> 172.21.15.150:0/2448132330 conn(0x7fbf100ffa90 msgr2=0x7fbf10101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.973+0000 7fbf18800640 1 -- 172.21.15.150:0/2448132330 shutdown_connections 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.973+0000 7fbf18800640 1 -- 172.21.15.150:0/2448132330 wait complete. 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 Processor -- start 2024-09-15T22:09:43.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 -- start start 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 0x7fbf1019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf101049a0 0x7fbf1019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 0x7fbf1019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10114130 con 0x7fbf10109120 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10113fb0 con 0x7fbf101049a0 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf18800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101142b0 con 0x7fbf10103ff0 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf15e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 0x7fbf1019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf15e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 0x7fbf1019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:45380/0 (socket says 172.21.15.150:45380) 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf15400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf101049a0 0x7fbf1019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.974+0000 7fbf15e00640 1 -- 172.21.15.150:0/4168018440 learned_addr learned my addr 172.21.15.150:0/4168018440 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf16800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 0x7fbf1019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15e00640 1 -- 172.21.15.150:0/4168018440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf101049a0 msgr2=0x7fbf1019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15e00640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf101049a0 0x7fbf1019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15e00640 1 -- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 msgr2=0x7fbf1019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15e00640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 0x7fbf1019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15e00640 1 -- 172.21.15.150:0/4168018440 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1019f540 con 0x7fbf10103ff0 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15400640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf101049a0 0x7fbf1019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.975+0000 7fbf15e00640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 0x7fbf1019a590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400e9f0 tx=0x7fbf0400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.976+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400cd80 con 0x7fbf10103ff0 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.976+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf04010910 con 0x7fbf10103ff0 2024-09-15T22:09:43.979 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.976+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04018990 con 0x7fbf10103ff0 2024-09-15T22:09:43.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.976+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1019f830 con 0x7fbf10103ff0 2024-09-15T22:09:43.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.976+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf101a7110 con 0x7fbf10103ff0 2024-09-15T22:09:43.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.977+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf101043d0 con 0x7fbf10103ff0 2024-09-15T22:09:43.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.979+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fbf04010ac0 con 0x7fbf10103ff0 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.980+0000 7fbf0aa00640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbef80a3240 0x7fbef80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.980+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fbf040cfbb0 con 0x7fbf10103ff0 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.980+0000 7fbf15400640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbef80a3240 0x7fbef80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:43.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.981+0000 7fbf15400640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbef80a3240 0x7fbef80a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbf1010aa90 tx=0x7fbf0000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:43.983 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:43.982+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf0409c680 con 0x7fbf10103ff0 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:43 smithi154 podman[64808]: 2024-09-15 22:09:43.779270378 +0000 UTC m=+0.108663820 container create 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:43 smithi154 podman[64808]: 2024-09-15 22:09:43.68650071 +0000 UTC m=+0.015894152 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:43 smithi154 podman[64808]: 2024-09-15 22:09:43.99014265 +0000 UTC m=+0.319536092 container init 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:43 smithi154 podman[64808]: 2024-09-15 22:09:43.992989557 +0000 UTC m=+0.322383000 container start 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mds[64827]: -- 172.21.15.154:0/927427563 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559889425860 con 0x559889402800 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: starting mds.b at 2024-09-15T22:09:44.091 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:44 smithi154 bash[64808]: 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf 2024-09-15T22:09:44.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.200+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf101a7310 con 0x7fbf10103ff0 2024-09-15T22:09:44.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.201+0000 7fbf0aa00640 1 -- 172.21.15.150:0/4168018440 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9716 (secure 0 0 0) 0x7fbf040a0980 con 0x7fbf10103ff0 2024-09-15T22:09:44.203 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:44.203 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":12,"btime":"2024-09-15T22:09:42:232128+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-15T22:09:44.204 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 12 2024-09-15T22:09:44.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.203+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbef80a3240 msgr2=0x7fbef80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.203+0000 7fbf18800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbef80a3240 0x7fbef80a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbf1010aa90 tx=0x7fbf0000b410 comp rx=0 tx=0).stop 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.203+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 msgr2=0x7fbf1019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.203+0000 7fbf18800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 0x7fbf1019a590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400e9f0 tx=0x7fbf0400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 shutdown_connections 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbef80a3240 0x7fbef80a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf10109120 0x7fbf1019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf101049a0 0x7fbf1019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 --2- 172.21.15.150:0/4168018440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10103ff0 0x7fbf1019a590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 >> 172.21.15.150:0/4168018440 conn(0x7fbf100ffa90 msgr2=0x7fbf10101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 shutdown_connections 2024-09-15T22:09:44.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:44.204+0000 7fbf18800640 1 -- 172.21.15.150:0/4168018440 wait complete. 2024-09-15T22:09:44.521 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:09:44 smithi154 systemd[1]: Started Ceph mds.b for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:09:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:44 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/4168018440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:44.528 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:44.528 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.528 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.529 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.529 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.529 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.529 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:44 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/4168018440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:44 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/4168018440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:45 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] up:boot 2024-09-15T22:09:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:45 smithi154 ceph-mon[34853]: fsmap 12 up:standby 2024-09-15T22:09:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:09:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:45 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:45.543 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:45 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] up:boot 2024-09-15T22:09:45.543 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:45 smithi150 ceph-mon[30886]: fsmap 12 up:standby 2024-09-15T22:09:45.543 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:09:45.543 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:45 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:45 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] up:boot 2024-09-15T22:09:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:45 smithi169 ceph-mon[35850]: fsmap 12 up:standby 2024-09-15T22:09:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:09:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:45 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:46 smithi154 ceph-mon[34853]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:46 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:46 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:46 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:46 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:46 smithi150 ceph-mon[30886]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:46 smithi169 ceph-mon[35850]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:46 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:46 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:46 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:46 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:46.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:09:47.310 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:47.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:47 smithi169 ceph-mon[35850]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:47 smithi154 ceph-mon[34853]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:47.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:47.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:47 smithi150 ceph-mon[30886]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:48.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 -- 172.21.15.150:0/4036944689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 msgr2=0x7f8e68108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:48.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/4036944689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e68108a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009900 tx=0x7f8e5402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 -- 172.21.15.150:0/4036944689 shutdown_connections 2024-09-15T22:09:48.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/4036944689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e68109140 0x7f8e68110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/4036944689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e68108a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/4036944689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 0x7f8e681043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 -- 172.21.15.150:0/4036944689 >> 172.21.15.150:0/4036944689 conn(0x7f8e680ffa50 msgr2=0x7f8e68101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:48.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 -- 172.21.15.150:0/4036944689 shutdown_connections 2024-09-15T22:09:48.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.534+0000 7f8e6ee00640 1 -- 172.21.15.150:0/4036944689 wait complete. 2024-09-15T22:09:48.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 Processor -- start 2024-09-15T22:09:48.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 -- start start 2024-09-15T22:09:48.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 0x7f8e6819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e6819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e68109140 0x7f8e6819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68114140 con 0x7f8e68109140 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68113fc0 con 0x7f8e681049c0 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.535+0000 7f8e6ee00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e681142c0 con 0x7f8e68104010 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e6819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 0x7f8e6819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e6819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36116/0 (socket says 172.21.15.150:36116) 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67400640 1 -- 172.21.15.150:0/2322059852 learned_addr learned my addr 172.21.15.150:0/2322059852 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e6ce00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e68109140 0x7f8e6819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 -- 172.21.15.150:0/2322059852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 msgr2=0x7f8e6819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:48.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e6819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 -- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e68109140 msgr2=0x7f8e6819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:48.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e68109140 0x7f8e6819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 -- 172.21.15.150:0/2322059852 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6819f600 con 0x7f8e68104010 2024-09-15T22:09:48.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67400640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e6819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:48.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.536+0000 7f8e67e00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 0x7f8e6819a650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e9f0 tx=0x7f8e5800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:48.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.537+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800ccc0 con 0x7f8e68104010 2024-09-15T22:09:48.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.537+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6819f8f0 con 0x7f8e68104010 2024-09-15T22:09:48.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.537+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e58010910 con 0x7f8e68104010 2024-09-15T22:09:48.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.537+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58018790 con 0x7f8e68104010 2024-09-15T22:09:48.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.537+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e681a71d0 con 0x7f8e68104010 2024-09-15T22:09:48.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.538+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e681043f0 con 0x7f8e68104010 2024-09-15T22:09:48.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.540+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8e58010ac0 con 0x7f8e68104010 2024-09-15T22:09:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.541+0000 7f8e64c00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e4c0a3240 0x7f8e4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.541+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f8e580cf8a0 con 0x7f8e68104010 2024-09-15T22:09:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.541+0000 7f8e67400640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e4c0a3240 0x7f8e4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:48.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.542+0000 7f8e67400640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e4c0a3240 0x7f8e4c0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8e54031550 tx=0x7f8e54005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:48.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.545+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e5809c9c0 con 0x7f8e68104010 2024-09-15T22:09:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.776+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e6810c380 con 0x7f8e68104010 2024-09-15T22:09:48.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.776+0000 7f8e64c00640 1 -- 172.21.15.150:0/2322059852 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10545 (secure 0 0 0) 0x7f8e5809c2c0 con 0x7f8e68104010 2024-09-15T22:09:48.779 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:48.779 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":13,"btime":"2024-09-15T22:09:44:247514+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24488,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-15T22:09:48.779 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 13 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e4c0a3240 msgr2=0x7f8e4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e4c0a3240 0x7f8e4c0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8e54031550 tx=0x7f8e54005a20 comp rx=0 tx=0).stop 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 msgr2=0x7f8e6819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 0x7f8e6819a650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e9f0 tx=0x7f8e5800edf0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 shutdown_connections 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e4c0a3240 0x7f8e4c0a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e68109140 0x7f8e6819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e681049c0 0x7f8e6819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 --2- 172.21.15.150:0/2322059852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e68104010 0x7f8e6819a650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:48.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 >> 172.21.15.150:0/2322059852 conn(0x7f8e680ffa50 msgr2=0x7f8e68100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:48.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 shutdown_connections 2024-09-15T22:09:48.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:48.779+0000 7f8e6ee00640 1 -- 172.21.15.150:0/2322059852 wait complete. 2024-09-15T22:09:49.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:49 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:49 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2322059852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:49.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.462 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.463 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:49 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.463 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:49 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2322059852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:49.508 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T22:09:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:49 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:49.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:49 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2322059852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:09:49.877 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:50.315 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:50 smithi150 ceph-mon[30886]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:50.315 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.316 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.316 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:50.316 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:50.316 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 -- 172.21.15.150:0/3273314850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784102380 msgr2=0x7f078410e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 --2- 172.21.15.150:0/3273314850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784102380 0x7f078410e9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f077c009cd0 tx=0x7f077c02a8e0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 -- 172.21.15.150:0/3273314850 shutdown_connections 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 --2- 172.21.15.150:0/3273314850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784102380 0x7f078410e9c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 --2- 172.21.15.150:0/3273314850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07841019e0 0x7f0784101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 --2- 172.21.15.150:0/3273314850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0784107af0 0x7f0784107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 -- 172.21.15.150:0/3273314850 >> 172.21.15.150:0/3273314850 conn(0x7f07840fd700 msgr2=0x7f07840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:50.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 -- 172.21.15.150:0/3273314850 shutdown_connections 2024-09-15T22:09:50.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.424+0000 7f078ac00640 1 -- 172.21.15.150:0/3273314850 wait complete. 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.425+0000 7f078ac00640 1 Processor -- start 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.425+0000 7f078ac00640 1 -- start start 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078ac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07841019e0 0x7f078419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078ac00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0784102380 0x7f078419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078ac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784107af0 0x7f078419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078ac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0784111f40 con 0x7f0784107af0 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078ac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0784111dc0 con 0x7f07841019e0 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078ac00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07841120c0 con 0x7f0784102380 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0789800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07841019e0 0x7f078419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:50.428 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784107af0 0x7f078419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:50.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0789800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07841019e0 0x7f078419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53794/0 (socket says 172.21.15.150:53794) 2024-09-15T22:09:50.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0789800640 1 -- 172.21.15.150:0/3892900372 learned_addr learned my addr 172.21.15.150:0/3892900372 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:50.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0788e00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0784102380 0x7f078419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0788e00640 1 -- 172.21.15.150:0/3892900372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07841019e0 msgr2=0x7f078419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0788e00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07841019e0 0x7f078419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0788e00640 1 -- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784107af0 msgr2=0x7f078419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0788e00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784107af0 0x7f078419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f0788e00640 1 -- 172.21.15.150:0/3892900372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078419f4f0 con 0x7f0784102380 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.426+0000 7f078a200640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784107af0 0x7f078419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:50.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.427+0000 7f0788e00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0784102380 0x7f078419aa80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f077000e9f0 tx=0x7f077000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:50.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.427+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077000ccc0 con 0x7f0784102380 2024-09-15T22:09:50.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.427+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078419f7e0 con 0x7f0784102380 2024-09-15T22:09:50.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.427+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770005020 con 0x7f0784102380 2024-09-15T22:09:50.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.427+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700049e0 con 0x7f0784102380 2024-09-15T22:09:50.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.427+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07841a70c0 con 0x7f0784102380 2024-09-15T22:09:50.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.428+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0784101e40 con 0x7f0784102380 2024-09-15T22:09:50.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.430+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0770005560 con 0x7f0784102380 2024-09-15T22:09:50.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.431+0000 7f0782000640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f076c0a3240 0x7f076c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:50.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.432+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f07700cf480 con 0x7f0784102380 2024-09-15T22:09:50.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.432+0000 7f0789800640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f076c0a3240 0x7f076c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:50.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.432+0000 7f0789800640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f076c0a3240 0x7f076c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07780095f0 tx=0x7f0778005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:50.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.436+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07700051d0 con 0x7f0784102380 2024-09-15T22:09:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:50 smithi169 ceph-mon[35850]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:50.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:50 smithi154 ceph-mon[34853]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:09:50.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.614+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f07841a7290 con 0x7f0784102380 2024-09-15T22:09:50.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.615+0000 7f0782000640 1 -- 172.21.15.150:0/3892900372 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f077009c5a0 con 0x7f0784102380 2024-09-15T22:09:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:09:50.617 INFO:teuthology.orchestra.run.smithi150.stdout:[ 2024-09-15T22:09:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:09:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "poolnum": 1, 2024-09-15T22:09:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "poolname": ".mgr" 2024-09-15T22:09:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:09:50.618 INFO:teuthology.orchestra.run.smithi150.stdout:] 2024-09-15T22:09:50.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f076c0a3240 msgr2=0x7f076c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f076c0a3240 0x7f076c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07780095f0 tx=0x7f0778005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0784102380 msgr2=0x7f078419aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0784102380 0x7f078419aa80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f077000e9f0 tx=0x7f077000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 shutdown_connections 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f076c0a3240 0x7f076c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0784107af0 0x7f078419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0784102380 0x7f078419aa80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 --2- 172.21.15.150:0/3892900372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07841019e0 0x7f078419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 >> 172.21.15.150:0/3892900372 conn(0x7f07840fd700 msgr2=0x7f078410d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 shutdown_connections 2024-09-15T22:09:50.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:50.618+0000 7f078ac00640 1 -- 172.21.15.150:0/3892900372 wait complete. 2024-09-15T22:09:51.283 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:09:51.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:09:51.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:51 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3892900372' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:09:51.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:51 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3892900372' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:09:51.652 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:51.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:51 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3892900372' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:09:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 -- 172.21.15.150:0/4082759747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf4104010 msgr2=0x7fdcf41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 --2- 172.21.15.150:0/4082759747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf4104010 0x7fdcf41043f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009ca0 tx=0x7fdce802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:09:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 -- 172.21.15.150:0/4082759747 shutdown_connections 2024-09-15T22:09:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 --2- 172.21.15.150:0/4082759747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4109140 0x7fdcf4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 --2- 172.21.15.150:0/4082759747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcf41049c0 0x7fdcf4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:52.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 --2- 172.21.15.150:0/4082759747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf4104010 0x7fdcf41043f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:52.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 -- 172.21.15.150:0/4082759747 >> 172.21.15.150:0/4082759747 conn(0x7fdcf40ffa50 msgr2=0x7fdcf4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:52.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 -- 172.21.15.150:0/4082759747 shutdown_connections 2024-09-15T22:09:52.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.160+0000 7fdcfb600640 1 -- 172.21.15.150:0/4082759747 wait complete. 2024-09-15T22:09:52.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 Processor -- start 2024-09-15T22:09:52.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 -- start start 2024-09-15T22:09:52.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 0x7fdcf419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf41049c0 0x7fdcf419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcf4109140 0x7fdcf419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41141c0 con 0x7fdcf41049c0 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4114040 con 0x7fdcf4109140 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.161+0000 7fdcfb600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4114340 con 0x7fdcf4104010 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf41049c0 0x7fdcf419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 0x7fdcf419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 0x7fdcf419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:55276/0 (socket says 172.21.15.150:55276) 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 -- 172.21.15.150:0/1070247511 learned_addr learned my addr 172.21.15.150:0/1070247511 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf9600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcf4109140 0x7fdcf419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:52.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 -- 172.21.15.150:0/1070247511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcf4109140 msgr2=0x7fdcf419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcf4109140 0x7fdcf419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 -- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf41049c0 msgr2=0x7fdcf419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf41049c0 0x7fdcf419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 -- 172.21.15.150:0/1070247511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf419f5f0 con 0x7fdcf4104010 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf3e00640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf41049c0 0x7fdcf419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.162+0000 7fdcf8c00640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 0x7fdcf419a640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdce8005e30 tx=0x7fdce8003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.163+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8031650 con 0x7fdcf4104010 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.163+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf419f880 con 0x7fdcf4104010 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.163+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf41a71c0 con 0x7fdcf4104010 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.163+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdce80317f0 con 0x7fdcf4104010 2024-09-15T22:09:52.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.163+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce802fa30 con 0x7fdcf4104010 2024-09-15T22:09:52.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.164+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf41043f0 con 0x7fdcf4104010 2024-09-15T22:09:52.167 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.166+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fdce802fc10 con 0x7fdcf4104010 2024-09-15T22:09:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.167+0000 7fdcf1600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdcdc0a32c0 0x7fdcdc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.167+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fdce80f08d0 con 0x7fdcf4104010 2024-09-15T22:09:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.167+0000 7fdcf3e00640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdcdc0a32c0 0x7fdcdc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:52.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.168+0000 7fdcf3e00640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdcdc0a32c0 0x7fdcdc0a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ffe70 tx=0x7fdce0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:52.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.169+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdce80bd9f0 con 0x7fdcf4104010 2024-09-15T22:09:52.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:52.345+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdcf419b9a0 con 0x7fdcf4104010 2024-09-15T22:09:52.348 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:52 smithi150 ceph-mon[30886]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:52.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:52 smithi169 ceph-mon[35850]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:52 smithi154 ceph-mon[34853]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:53.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.206+0000 7fdcf1600640 1 -- 172.21.15.150:0/1070247511 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7fdce80319a0 con 0x7fdcf4104010 2024-09-15T22:09:53.209 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' created 2024-09-15T22:09:53.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdcdc0a32c0 msgr2=0x7fdcdc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:53.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdcdc0a32c0 0x7fdcdc0a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ffe70 tx=0x7fdce0005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:53.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 msgr2=0x7fdcf419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:53.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 0x7fdcf419a640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdce8005e30 tx=0x7fdce8003f90 comp rx=0 tx=0).stop 2024-09-15T22:09:53.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 shutdown_connections 2024-09-15T22:09:53.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcf4109140 0x7fdcf419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:53.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdcdc0a32c0 0x7fdcdc0a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:53.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf41049c0 0x7fdcf419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:53.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 --2- 172.21.15.150:0/1070247511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcf4104010 0x7fdcf419a640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:53.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.211+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 >> 172.21.15.150:0/1070247511 conn(0x7fdcf40ffa50 msgr2=0x7fdcf4100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:53.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.212+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 shutdown_connections 2024-09-15T22:09:53.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:53.212+0000 7fdcfb600640 1 -- 172.21.15.150:0/1070247511 wait complete. 2024-09-15T22:09:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:53 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1070247511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:09:53.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:53 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:09:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:53 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1070247511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:09:53.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:53 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:09:53.625 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:53 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1070247511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:09:53.626 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:53 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:09:54.014 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:09:54.391 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:54 smithi150 ceph-mon[30886]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:54 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:09:54.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:54 smithi150 ceph-mon[30886]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:09:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:54 smithi154 ceph-mon[34853]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:54 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:09:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:54 smithi154 ceph-mon[34853]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:09:54.632 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:54 smithi169 ceph-mon[35850]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:54.632 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:54 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:09:54.632 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:54 smithi169 ceph-mon[35850]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:09:54.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 -- 172.21.15.150:0/1982707739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0103e30 msgr2=0x7feba0104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:54.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 --2- 172.21.15.150:0/1982707739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0103e30 0x7feba0104210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb90009900 tx=0x7feb9002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.985 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 -- 172.21.15.150:0/1982707739 shutdown_connections 2024-09-15T22:09:54.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 --2- 172.21.15.150:0/1982707739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0108f60 0x7feba0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 --2- 172.21.15.150:0/1982707739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 0x7feba0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.986 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 --2- 172.21.15.150:0/1982707739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0103e30 0x7feba0104210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 -- 172.21.15.150:0/1982707739 >> 172.21.15.150:0/1982707739 conn(0x7feba00ff910 msgr2=0x7feba0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 -- 172.21.15.150:0/1982707739 shutdown_connections 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.977+0000 7feba4e00640 1 -- 172.21.15.150:0/1982707739 wait complete. 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.978+0000 7feba4e00640 1 Processor -- start 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.978+0000 7feba4e00640 1 -- start start 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feba4e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 0x7feba019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feba4e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 0x7feba019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feba4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0108f60 0x7feba019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feba4e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7feba0113f80 con 0x7feba0108f60 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feba4e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feba0113e00 con 0x7feba01047e0 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feba4e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feba0114100 con 0x7feba0103e30 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 0x7feba019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 0x7feba019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:55296/0 (socket says 172.21.15.150:55296) 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 -- 172.21.15.150:0/2984202615 learned_addr learned my addr 172.21.15.150:0/2984202615 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9fe00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0108f60 0x7feba019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9ea00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 0x7feba019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 -- 172.21.15.150:0/2984202615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 msgr2=0x7feba019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 0x7feba019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 -- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0108f60 msgr2=0x7feba019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0108f60 0x7feba019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9f400640 1 -- 172.21.15.150:0/2984202615 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba019f440 con 0x7feba0103e30 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.979+0000 7feb9ea00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 0x7feba019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.980+0000 7feb9f400640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 0x7feba019a490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb90006010 tx=0x7feb90004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.980+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9003f030 con 0x7feba0103e30 2024-09-15T22:09:54.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.980+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb90004440 con 0x7feba0103e30 2024-09-15T22:09:54.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.980+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90035070 con 0x7feba0103e30 2024-09-15T22:09:54.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.980+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba019f6d0 con 0x7feba0103e30 2024-09-15T22:09:54.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.980+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba019fb60 con 0x7feba0103e30 2024-09-15T22:09:54.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.981+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba0105310 con 0x7feba0103e30 2024-09-15T22:09:54.989 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.983+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7feb90042030 con 0x7feba0103e30 2024-09-15T22:09:54.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.984+0000 7feb97e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7feb840a32c0 0x7feb840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.984+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7feb900ef9f0 con 0x7feba0103e30 2024-09-15T22:09:54.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.984+0000 7feb9ea00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7feb840a32c0 0x7feb840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.985+0000 7feb9ea00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7feb840a32c0 0x7feb840a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feba00ffd30 tx=0x7feb8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:54.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:54.988+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb900bc9a0 con 0x7feba0103e30 2024-09-15T22:09:55.166 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.164+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7feba002d7c0 con 0x7feba0103e30 2024-09-15T22:09:55.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.674+0000 7feb97e00640 1 -- 172.21.15.150:0/2984202615 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7feb900bc2a0 con 0x7feba0103e30 2024-09-15T22:09:55.676 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' created 2024-09-15T22:09:55.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.678+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7feb840a32c0 msgr2=0x7feb840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.678+0000 7feba4e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7feb840a32c0 0x7feb840a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feba00ffd30 tx=0x7feb8c005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 msgr2=0x7feba019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 0x7feba019a490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb90006010 tx=0x7feb90004040 comp rx=0 tx=0).stop 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 shutdown_connections 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7feb840a32c0 0x7feb840a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feba0108f60 0x7feba019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:55.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba01047e0 0x7feba019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:55.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 --2- 172.21.15.150:0/2984202615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba0103e30 0x7feba019a490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:55.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.679+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 >> 172.21.15.150:0/2984202615 conn(0x7feba00ff910 msgr2=0x7feba0100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:55.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.680+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 shutdown_connections 2024-09-15T22:09:55.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:55.680+0000 7feba4e00640 1 -- 172.21.15.150:0/2984202615 wait complete. 2024-09-15T22:09:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:55 smithi150 ceph-mon[30886]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:09:55.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:55 smithi169 ceph-mon[35850]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:09:56.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:55 smithi154 ceph-mon[34853]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:09:56.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:09:56.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:56 smithi150 ceph-mon[30886]: pgmap v282: 33 pgs: 4 creating+activating, 14 creating+peering, 6 active+clean, 9 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:56.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:56 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2984202615' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:09:56.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:56 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:09:56.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:56 smithi150 ceph-mon[30886]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:09:56.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:56 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:09:56.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:56 smithi150 ceph-mon[30886]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:09:56.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:56 smithi169 ceph-mon[35850]: pgmap v282: 33 pgs: 4 creating+activating, 14 creating+peering, 6 active+clean, 9 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:56.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:56 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2984202615' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:09:56.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:56 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:09:56.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:56 smithi169 ceph-mon[35850]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:09:56.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:56 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:09:56.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:56 smithi169 ceph-mon[35850]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:09:56.977 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:57.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:56 smithi154 ceph-mon[34853]: pgmap v282: 33 pgs: 4 creating+activating, 14 creating+peering, 6 active+clean, 9 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:57.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:56 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2984202615' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:09:57.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:56 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:09:57.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:56 smithi154 ceph-mon[34853]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:09:57.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:56 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:09:57.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:56 smithi154 ceph-mon[34853]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:09:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.466+0000 7f8c4e200640 1 -- 172.21.15.150:0/2760382607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48102b90 msgr2=0x7f8c48102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.466+0000 7f8c4e200640 1 --2- 172.21.15.150:0/2760382607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48102b90 0x7f8c48102f70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009900 tx=0x7f8c3802a480 comp rx=0 tx=0).stop 2024-09-15T22:09:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 -- 172.21.15.150:0/2760382607 shutdown_connections 2024-09-15T22:09:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 --2- 172.21.15.150:0/2760382607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c4810bfc0 0x7f8c4810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 --2- 172.21.15.150:0/2760382607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c481034b0 0x7f8c4810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:57.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 --2- 172.21.15.150:0/2760382607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c48102b90 0x7f8c48102f70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:57.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 -- 172.21.15.150:0/2760382607 >> 172.21.15.150:0/2760382607 conn(0x7f8c480fc630 msgr2=0x7f8c480fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:57.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 -- 172.21.15.150:0/2760382607 shutdown_connections 2024-09-15T22:09:57.469 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.467+0000 7f8c4e200640 1 -- 172.21.15.150:0/2760382607 wait complete. 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 Processor -- start 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 -- start start 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 0x7f8c4819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c481034b0 0x7f8c4819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4810bfc0 0x7f8c4819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48111e10 con 0x7f8c481034b0 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48111c90 con 0x7f8c4810bfc0 2024-09-15T22:09:57.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.468+0000 7f8c4e200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48111f90 con 0x7f8c48102b90 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 0x7f8c4819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4d800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4810bfc0 0x7f8c4819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 0x7f8c4819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:55316/0 (socket says 172.21.15.150:55316) 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 -- 172.21.15.150:0/212511131 learned_addr learned my addr 172.21.15.150:0/212511131 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c3fe00640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c481034b0 0x7f8c4819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 -- 172.21.15.150:0/212511131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4810bfc0 msgr2=0x7f8c4819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4810bfc0 0x7f8c4819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 -- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c481034b0 msgr2=0x7f8c4819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c481034b0 0x7f8c4819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 -- 172.21.15.150:0/212511131 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4819f4a0 con 0x7f8c48102b90 2024-09-15T22:09:57.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.469+0000 7f8c4ce00640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 0x7f8c4819a4f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004770 tx=0x7f8c38003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:57.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.470+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3803f070 con 0x7f8c48102b90 2024-09-15T22:09:57.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.470+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4819f730 con 0x7f8c48102b90 2024-09-15T22:09:57.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.470+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c38031ca0 con 0x7f8c48102b90 2024-09-15T22:09:57.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.470+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38035030 con 0x7f8c48102b90 2024-09-15T22:09:57.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.470+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481a7070 con 0x7f8c48102b90 2024-09-15T22:09:57.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.471+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c48102f70 con 0x7f8c48102b90 2024-09-15T22:09:57.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.473+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8c38042070 con 0x7f8c48102b90 2024-09-15T22:09:57.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.474+0000 7f8c46000640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8c2c0a3240 0x7f8c2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:57.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.475+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f8c380f0430 con 0x7f8c48102b90 2024-09-15T22:09:57.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.475+0000 7f8c3fe00640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8c2c0a3240 0x7f8c2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:57.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.475+0000 7f8c3fe00640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8c2c0a3240 0x7f8c2c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c4810e8d0 tx=0x7f8c30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:57.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.476+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c380bd320 con 0x7f8c48102b90 2024-09-15T22:09:57.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:57.692+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8c481a7240 con 0x7f8c48102b90 2024-09-15T22:09:57.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:57 smithi169 ceph-mon[35850]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:09:57.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:57 smithi169 ceph-mon[35850]: pgmap v285: 97 pgs: 4 creating+activating, 20 creating+peering, 12 active+clean, 61 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:58.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:57 smithi154 ceph-mon[34853]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:09:58.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:57 smithi154 ceph-mon[34853]: pgmap v285: 97 pgs: 4 creating+activating, 20 creating+peering, 12 active+clean, 61 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:58.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:57 smithi150 ceph-mon[30886]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:09:58.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:57 smithi150 ceph-mon[30886]: pgmap v285: 97 pgs: 4 creating+activating, 20 creating+peering, 12 active+clean, 61 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:09:58.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.686+0000 7f8c46000640 1 -- 172.21.15.150:0/212511131 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8c380bcc20 con 0x7f8c48102b90 2024-09-15T22:09:58.687 INFO:teuthology.orchestra.run.smithi150.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:09:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8c2c0a3240 msgr2=0x7f8c2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8c2c0a3240 0x7f8c2c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c4810e8d0 tx=0x7f8c30005f90 comp rx=0 tx=0).stop 2024-09-15T22:09:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 msgr2=0x7f8c4819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:58.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 0x7f8c4819a4f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004770 tx=0x7f8c38003c10 comp rx=0 tx=0).stop 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 shutdown_connections 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4810bfc0 0x7f8c4819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8c2c0a3240 0x7f8c2c0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c481034b0 0x7f8c4819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 --2- 172.21.15.150:0/212511131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c48102b90 0x7f8c4819a4f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 >> 172.21.15.150:0/212511131 conn(0x7f8c480fc630 msgr2=0x7f8c4810d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.690+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 shutdown_connections 2024-09-15T22:09:58.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:09:58.691+0000 7f8c4e200640 1 -- 172.21.15.150:0/212511131 wait complete. 2024-09-15T22:09:58.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:58 smithi169 ceph-mon[35850]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:09:58.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:58 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/212511131' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:09:58.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:58 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:09:58.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:58 smithi169 ceph-mon[35850]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:09:59.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:58 smithi154 ceph-mon[34853]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:09:59.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:58 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/212511131' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:09:59.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:58 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:09:59.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:58 smithi154 ceph-mon[34853]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:09:59.032 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:58 smithi150 ceph-mon[30886]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:09:59.032 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:58 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/212511131' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:09:59.032 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:58 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:09:59.032 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:58 smithi150 ceph-mon[30886]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:09:59.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:09:59.821 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:59.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:59 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:09:59.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:59 smithi169 ceph-mon[35850]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:09:59.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:59 smithi169 ceph-mon[35850]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:09:59.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:59 smithi169 ceph-mon[35850]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:09:59.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:09:59 smithi169 ceph-mon[35850]: pgmap v288: 97 pgs: 4 creating+activating, 8 creating+peering, 52 active+clean, 33 unknown; 578 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-15T22:09:59.961 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:59 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:09:59.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:59 smithi150 ceph-mon[30886]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:09:59.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:59 smithi150 ceph-mon[30886]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:09:59.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:59 smithi150 ceph-mon[30886]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:09:59.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:09:59 smithi150 ceph-mon[30886]: pgmap v288: 97 pgs: 4 creating+activating, 8 creating+peering, 52 active+clean, 33 unknown; 578 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-15T22:10:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:59 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:10:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:59 smithi154 ceph-mon[34853]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:10:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:59 smithi154 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:10:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:59 smithi154 ceph-mon[34853]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:10:00.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:09:59 smithi154 ceph-mon[34853]: pgmap v288: 97 pgs: 4 creating+activating, 8 creating+peering, 52 active+clean, 33 unknown; 578 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-15T22:10:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 -- 172.21.15.150:0/1930614970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10102790 msgr2=0x7f0f101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 --2- 172.21.15.150:0/1930614970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10102790 0x7f0f101067e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009900 tx=0x7f0efc02a410 comp rx=0 tx=0).stop 2024-09-15T22:10:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 -- 172.21.15.150:0/1930614970 shutdown_connections 2024-09-15T22:10:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 --2- 172.21.15.150:0/1930614970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10106f10 0x7f0f1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 --2- 172.21.15.150:0/1930614970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10102790 0x7f0f101067e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 --2- 172.21.15.150:0/1930614970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f10101de0 0x7f0f101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 -- 172.21.15.150:0/1930614970 >> 172.21.15.150:0/1930614970 conn(0x7f0f100fd8c0 msgr2=0x7f0f100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 -- 172.21.15.150:0/1930614970 shutdown_connections 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.353+0000 7f0f17600640 1 -- 172.21.15.150:0/1930614970 wait complete. 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.354+0000 7f0f17600640 1 Processor -- start 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.354+0000 7f0f17600640 1 -- start start 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f17600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f10101de0 0x7f0f1019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f17600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10102790 0x7f0f1019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f17600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 0x7f0f1019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f17600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10111fc0 con 0x7f0f10106f10 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f17600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10111e40 con 0x7f0f10102790 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f17600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10112140 con 0x7f0f10101de0 2024-09-15T22:10:00.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 0x7f0f1019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 0x7f0f1019f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60192/0 (socket says 172.21.15.150:60192) 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f14c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f10101de0 0x7f0f1019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 -- 172.21.15.150:0/4030557369 learned_addr learned my addr 172.21.15.150:0/4030557369 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f0fe00640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10102790 0x7f0f1019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 -- 172.21.15.150:0/4030557369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f10101de0 msgr2=0x7f0f1019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f10101de0 0x7f0f1019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 -- 172.21.15.150:0/4030557369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10102790 msgr2=0x7f0f1019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10102790 0x7f0f1019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f15600640 1 -- 172.21.15.150:0/4030557369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1019f6f0 con 0x7f0f10106f10 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.355+0000 7f0f0fe00640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10102790 0x7f0f1019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.356+0000 7f0f15600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 0x7f0f1019f010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800eb10 tx=0x7f0f0800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:00.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.356+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08004b20 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.356+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f08004cc0 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.356+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1019f9e0 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.356+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08010760 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.356+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f101a72c0 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.357+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f101021c0 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.359+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0f08005000 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.360+0000 7f0f0d600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0ef80a3240 0x7f0ef80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.360+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0f080cffe0 con 0x7f0f10106f10 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.361+0000 7f0f14c00640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0ef80a3240 0x7f0ef80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.361+0000 7f0f14c00640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0ef80a3240 0x7f0ef80a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009bd0 tx=0x7f0f04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:00.388 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.363+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f080541b0 con 0x7f0f10106f10 2024-09-15T22:10:00.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.538+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f101a7490 con 0x7f0f10106f10 2024-09-15T22:10:00.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.540+0000 7f0f0d600640 1 -- 172.21.15.150:0/4030557369 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22348 (secure 0 0 0) 0x7f0f0809cdf0 con 0x7f0f10106f10 2024-09-15T22:10:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:00.543 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:09:57.693703+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:10:00.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0ef80a3240 msgr2=0x7f0ef80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:00.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0ef80a3240 0x7f0ef80a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009bd0 tx=0x7f0f04005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:00.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 msgr2=0x7f0f1019f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:00.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 0x7f0f1019f010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800eb10 tx=0x7f0f0800c2d0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 shutdown_connections 2024-09-15T22:10:00.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0ef80a3240 0x7f0ef80a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f10106f10 0x7f0f1019f010 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f10102790 0x7f0f1019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 --2- 172.21.15.150:0/4030557369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f10101de0 0x7f0f1019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:00.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.543+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 >> 172.21.15.150:0/4030557369 conn(0x7f0f100fd8c0 msgr2=0x7f0f100ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:00.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.544+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 shutdown_connections 2024-09-15T22:10:00.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:00.544+0000 7f0f17600640 1 -- 172.21.15.150:0/4030557369 wait complete. 2024-09-15T22:10:00.894 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:10:00.895 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: Cluster is now healthy 2024-09-15T22:10:00.895 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] up:active 2024-09-15T22:10:00.895 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:00.895 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:00.895 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: overall HEALTH_OK 2024-09-15T22:10:00.896 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:00 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/4030557369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:00.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:10:00.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: Cluster is now healthy 2024-09-15T22:10:00.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] up:active 2024-09-15T22:10:00.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:00.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:00.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: overall HEALTH_OK 2024-09-15T22:10:00.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:00 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/4030557369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:01.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:10:01.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: Cluster is now healthy 2024-09-15T22:10:01.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] up:active 2024-09-15T22:10:01.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:01.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:01.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: overall HEALTH_OK 2024-09-15T22:10:01.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:00 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/4030557369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:01.343 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:10:01.714 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:01.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:01 smithi169 ceph-mon[35850]: pgmap v289: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-15T22:10:02.000 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:01 smithi150 ceph-mon[30886]: pgmap v289: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-15T22:10:02.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:01 smithi154 ceph-mon[34853]: pgmap v289: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-15T22:10:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 -- 172.21.15.150:0/696896911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c1019c0 msgr2=0x7f7e4c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 --2- 172.21.15.150:0/696896911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c101e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009930 tx=0x7f7e3802a420 comp rx=0 tx=0).stop 2024-09-15T22:10:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 -- 172.21.15.150:0/696896911 shutdown_connections 2024-09-15T22:10:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 --2- 172.21.15.150:0/696896911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102360 0x7f7e4c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 --2- 172.21.15.150:0/696896911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c101e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 --2- 172.21.15.150:0/696896911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 0x7f7e4c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 -- 172.21.15.150:0/696896911 >> 172.21.15.150:0/696896911 conn(0x7f7e4c0fd6e0 msgr2=0x7f7e4c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:02.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 -- 172.21.15.150:0/696896911 shutdown_connections 2024-09-15T22:10:02.232 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.229+0000 7f7e4b200640 1 -- 172.21.15.150:0/696896911 wait complete. 2024-09-15T22:10:02.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.230+0000 7f7e4b200640 1 Processor -- start 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.230+0000 7f7e4b200640 1 -- start start 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.230+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.230+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c102360 0x7f7e4c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.230+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 0x7f7e4c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e4b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c111dd0 con 0x7f7e4c102360 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e4b200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c111c50 con 0x7f7e4c1079c0 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e4b200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c111f50 con 0x7f7e4c1019c0 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37750/0 (socket says 172.21.15.150:37750) 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 -- 172.21.15.150:0/895125246 learned_addr learned my addr 172.21.15.150:0/895125246 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:02.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49400640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c102360 0x7f7e4c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e4a800640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 0x7f7e4c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 -- 172.21.15.150:0/895125246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 msgr2=0x7f7e4c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 0x7f7e4c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 -- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c102360 msgr2=0x7f7e4c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c102360 0x7f7e4c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e49e00640 1 -- 172.21.15.150:0/895125246 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c19f480 con 0x7f7e4c1019c0 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.231+0000 7f7e4a800640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 0x7f7e4c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.232+0000 7f7e49e00640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c19a4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00d950 tx=0x7f7e3c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.232+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c017070 con 0x7f7e4c1019c0 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.232+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c19f770 con 0x7f7e4c1019c0 2024-09-15T22:10:02.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.232+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3c009c30 con 0x7f7e4c1019c0 2024-09-15T22:10:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.232+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00f6b0 con 0x7f7e4c1019c0 2024-09-15T22:10:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.232+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c1a7050 con 0x7f7e4c1019c0 2024-09-15T22:10:02.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.233+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4c101e20 con 0x7f7e4c1019c0 2024-09-15T22:10:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.235+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7e3c0109d0 con 0x7f7e4c1019c0 2024-09-15T22:10:02.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.236+0000 7f7e42a00640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7e300a3240 0x7f7e300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:02.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.236+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7e3c0cf420 con 0x7f7e4c1019c0 2024-09-15T22:10:02.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.237+0000 7f7e49400640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7e300a3240 0x7f7e300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:02.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.237+0000 7f7e49400640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7e300a3240 0x7f7e300a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006010 tx=0x7f7e38000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:02.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.238+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e3c009de0 con 0x7f7e4c1019c0 2024-09-15T22:10:02.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.415+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e4c1a7220 con 0x7f7e4c1019c0 2024-09-15T22:10:02.419 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.417+0000 7f7e42a00640 1 -- 172.21.15.150:0/895125246 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22348 (secure 0 0 0) 0x7f7e3c09c1f0 con 0x7f7e4c1019c0 2024-09-15T22:10:02.420 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:02.420 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:09:57.693703+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7e300a3240 msgr2=0x7f7e300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7e300a3240 0x7f7e300a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7e38006010 tx=0x7f7e38000bc0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 msgr2=0x7f7e4c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c19a4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00d950 tx=0x7f7e3c00de10 comp rx=0 tx=0).stop 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 shutdown_connections 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c1079c0 0x7f7e4c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7e300a3240 0x7f7e300a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e4c102360 0x7f7e4c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 --2- 172.21.15.150:0/895125246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c1019c0 0x7f7e4c19a4d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:02.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 >> 172.21.15.150:0/895125246 conn(0x7f7e4c0fd6e0 msgr2=0x7f7e4c10cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:02.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 shutdown_connections 2024-09-15T22:10:02.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:02.420+0000 7f7e4b200640 1 -- 172.21.15.150:0/895125246 wait complete. 2024-09-15T22:10:02.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:02 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/895125246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:03.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:02 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/895125246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:03.114 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:02 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/895125246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:03.152 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:10:03.526 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:03.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:03 smithi150 ceph-mon[30886]: pgmap v290: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 3 op/s 2024-09-15T22:10:04.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:03 smithi154 ceph-mon[34853]: pgmap v290: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 3 op/s 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.102+0000 7f8ce3e00640 1 -- 172.21.15.150:0/415456536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41047e0 msgr2=0x7f8ce4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.102+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/415456536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41047e0 0x7f8ce4108830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009900 tx=0x7f8cd002a410 comp rx=0 tx=0).stop 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 -- 172.21.15.150:0/415456536 shutdown_connections 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/415456536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce4108f60 0x7f8ce4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/415456536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41047e0 0x7f8ce4108830 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/415456536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 0x7f8ce4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 -- 172.21.15.150:0/415456536 >> 172.21.15.150:0/415456536 conn(0x7f8ce40ff8d0 msgr2=0x7f8ce4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:04.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 -- 172.21.15.150:0/415456536 shutdown_connections 2024-09-15T22:10:04.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.103+0000 7f8ce3e00640 1 -- 172.21.15.150:0/415456536 wait complete. 2024-09-15T22:10:04.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 Processor -- start 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 -- start start 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 0x7f8ce419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 0x7f8ce419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 0x7f8ce419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4114010 con 0x7f8ce4108f60 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4113e90 con 0x7f8ce4103e30 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4114190 con 0x7f8ce41047e0 2024-09-15T22:10:04.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 0x7f8ce419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.104+0000 7f8ce2a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 0x7f8ce419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 0x7f8ce419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 0x7f8ce419ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60234/0 (socket says 172.21.15.150:60234) 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 0x7f8ce419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37776/0 (socket says 172.21.15.150:37776) 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce3400640 1 -- 172.21.15.150:0/2118937373 learned_addr learned my addr 172.21.15.150:0/2118937373 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 0x7f8ce419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:40116/0 (socket says 172.21.15.150:40116) 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 -- 172.21.15.150:0/2118937373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 msgr2=0x7f8ce419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 0x7f8ce419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 -- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 msgr2=0x7f8ce419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 0x7f8ce419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 -- 172.21.15.150:0/2118937373 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce419f420 con 0x7f8ce41047e0 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce3400640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 0x7f8ce419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:04.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.105+0000 7f8ce2000640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 0x7f8ce419a9b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cd002a930 tx=0x7f8cd0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:04.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.106+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd003f070 con 0x7f8ce41047e0 2024-09-15T22:10:04.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.106+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce419f6b0 con 0x7f8ce41047e0 2024-09-15T22:10:04.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.106+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cd0031c90 con 0x7f8ce41047e0 2024-09-15T22:10:04.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.106+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0035030 con 0x7f8ce41047e0 2024-09-15T22:10:04.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.106+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce41a6ff0 con 0x7f8ce41047e0 2024-09-15T22:10:04.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.107+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce4104210 con 0x7f8ce41047e0 2024-09-15T22:10:04.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.110+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8cd0042070 con 0x7f8ce41047e0 2024-09-15T22:10:04.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.111+0000 7f8ce8a00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8cc80a32c0 0x7f8cc80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:04.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.111+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8cd00f0390 con 0x7f8ce41047e0 2024-09-15T22:10:04.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.111+0000 7f8ce2a00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8cc80a32c0 0x7f8cc80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:04.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.112+0000 7f8ce2a00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8cc80a32c0 0x7f8cc80a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009bd0 tx=0x7f8cd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:04.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.112+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cd00bcb10 con 0x7f8ce41047e0 2024-09-15T22:10:04.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:03 smithi169 ceph-mon[35850]: pgmap v290: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 3 op/s 2024-09-15T22:10:04.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.325+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8ce419b7d0 con 0x7f8ce41047e0 2024-09-15T22:10:04.521 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:10:04 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:10:04.262+0000 7fc0fe501640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:10:04.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.721+0000 7f8ce8a00640 1 -- 172.21.15.150:0/2118937373 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f8ce419b7d0 con 0x7f8ce41047e0 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8cc80a32c0 msgr2=0x7f8cc80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8cc80a32c0 0x7f8cc80a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009bd0 tx=0x7f8cd4005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 msgr2=0x7f8ce419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 0x7f8ce419a9b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cd002a930 tx=0x7f8cd0003b90 comp rx=0 tx=0).stop 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 shutdown_connections 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8cc80a32c0 0x7f8cc80a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce4108f60 0x7f8ce419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ce41047e0 0x7f8ce419a9b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 --2- 172.21.15.150:0/2118937373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ce4103e30 0x7f8ce419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.723+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 >> 172.21.15.150:0/2118937373 conn(0x7f8ce40ff8d0 msgr2=0x7f8ce4100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.724+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 shutdown_connections 2024-09-15T22:10:04.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:04.724+0000 7f8ce3e00640 1 -- 172.21.15.150:0/2118937373 wait complete. 2024-09-15T22:10:05.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:04 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2118937373' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:10:05.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:04 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:10:05.063 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:04 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2118937373' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:10:05.063 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:04 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:10:05.104 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:04 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2118937373' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:10:05.105 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:04 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:10:05.609 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-15T22:10:05.610 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-15T22:10:05.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:05 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:10:05.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:05 smithi150 ceph-mon[30886]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:05.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:05 smithi150 ceph-mon[30886]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:10:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:05 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:10:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:05 smithi169 ceph-mon[35850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:05 smithi169 ceph-mon[35850]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:10:05.984 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:05 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:10:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:05 smithi154 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:06.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:05 smithi154 ceph-mon[34853]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T22:10:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 -- 172.21.15.150:0/2465236908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074620 msgr2=0x7fb608074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 --2- 172.21.15.150:0/2465236908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074620 0x7fb608074a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009900 tx=0x7fb5f802a480 comp rx=0 tx=0).stop 2024-09-15T22:10:06.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 -- 172.21.15.150:0/2465236908 shutdown_connections 2024-09-15T22:10:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 --2- 172.21.15.150:0/2465236908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60810e3c0 0x7fb608110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 --2- 172.21.15.150:0/2465236908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb608074f40 0x7fb60810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 --2- 172.21.15.150:0/2465236908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074620 0x7fb608074a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 -- 172.21.15.150:0/2465236908 >> 172.21.15.150:0/2465236908 conn(0x7fb6080fd8c0 msgr2=0x7fb6080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 -- 172.21.15.150:0/2465236908 shutdown_connections 2024-09-15T22:10:06.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.478+0000 7fb60cc00640 1 -- 172.21.15.150:0/2465236908 wait complete. 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 Processor -- start 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 -- start start 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb608074620 0x7fb60819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 0x7fb60819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60810e3c0 0x7fb60819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb608114170 con 0x7fb608074f40 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb608113ff0 con 0x7fb60810e3c0 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.479+0000 7fb60cc00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081142f0 con 0x7fb608074620 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 0x7fb60819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 0x7fb60819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60252/0 (socket says 172.21.15.150:60252) 2024-09-15T22:10:06.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb605e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb608074620 0x7fb60819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 -- 172.21.15.150:0/3961611137 learned_addr learned my addr 172.21.15.150:0/3961611137 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb606800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60810e3c0 0x7fb60819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 -- 172.21.15.150:0/3961611137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb608074620 msgr2=0x7fb60819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb608074620 0x7fb60819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 -- 172.21.15.150:0/3961611137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60810e3c0 msgr2=0x7fb60819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60810e3c0 0x7fb60819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.480+0000 7fb5fd400640 1 -- 172.21.15.150:0/3961611137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60819f6e0 con 0x7fb608074f40 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.481+0000 7fb5fd400640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 0x7fb60819ac70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000d770 tx=0x7fb5f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.481+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0017070 con 0x7fb608074f40 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.481+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f0005500 con 0x7fb608074f40 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.481+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0004e00 con 0x7fb608074f40 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.481+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60819f9d0 con 0x7fb608074f40 2024-09-15T22:10:06.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.481+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a72b0 con 0x7fb608074f40 2024-09-15T22:10:06.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.482+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb608074a00 con 0x7fb608074f40 2024-09-15T22:10:06.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.484+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb5f0004fa0 con 0x7fb608074f40 2024-09-15T22:10:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.486+0000 7fb5ff400640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb5ec0a32c0 0x7fb5ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.486+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb5f00cf180 con 0x7fb608074f40 2024-09-15T22:10:06.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.486+0000 7fb605e00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb5ec0a32c0 0x7fb5ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:06.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.487+0000 7fb605e00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb5ec0a32c0 0x7fb5ec0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009230 tx=0x7fb5f80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:06.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.491+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5f009b900 con 0x7fb608074f40 2024-09-15T22:10:06.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.699+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fb608109570 con 0x7fb608074f40 2024-09-15T22:10:06.731 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.729+0000 7fb5ff400640 1 -- 172.21.15.150:0/3961611137 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fb5f009fc00 con 0x7fb608074f40 2024-09-15T22:10:06.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb5ec0a32c0 msgr2=0x7fb5ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:06.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb5ec0a32c0 0x7fb5ec0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009230 tx=0x7fb5f80058d0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 msgr2=0x7fb60819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:06.734 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 0x7fb60819ac70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000d770 tx=0x7fb5f000dc30 comp rx=0 tx=0).stop 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 shutdown_connections 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60810e3c0 0x7fb60819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb5ec0a32c0 0x7fb5ec0a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb608074f40 0x7fb60819ac70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 --2- 172.21.15.150:0/3961611137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb608074620 0x7fb60819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 >> 172.21.15.150:0/3961611137 conn(0x7fb6080fd8c0 msgr2=0x7fb6080fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 shutdown_connections 2024-09-15T22:10:06.735 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:06.732+0000 7fb60cc00640 1 -- 172.21.15.150:0/3961611137 wait complete. 2024-09-15T22:10:07.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:06 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3961611137' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-15T22:10:07.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:06 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3961611137' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-15T22:10:07.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:06 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3961611137' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-15T22:10:07.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T22:10:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:10:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3961611137' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-15T22:10:07.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:10:07.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:07.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-15T22:10:07.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-15T22:10:07.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:07 smithi150 ceph-mon[30886]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-15T22:10:07.950 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:08.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:10:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3961611137' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-15T22:10:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:10:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-15T22:10:08.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-15T22:10:08.023 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:07 smithi154 ceph-mon[34853]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-15T22:10:08.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:10:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3961611137' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-15T22:10:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:10:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:10:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-15T22:10:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-15T22:10:08.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:07 smithi169 ceph-mon[35850]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-15T22:10:08.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 -- 172.21.15.150:0/156433280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 msgr2=0x7fd9181043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:08.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 --2- 172.21.15.150:0/156433280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd9181043d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd908009ca0 tx=0x7fd90802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 -- 172.21.15.150:0/156433280 shutdown_connections 2024-09-15T22:10:08.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 --2- 172.21.15.150:0/156433280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd918109120 0x7fd918110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 --2- 172.21.15.150:0/156433280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9181049a0 0x7fd9181089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 --2- 172.21.15.150:0/156433280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd9181043d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 -- 172.21.15.150:0/156433280 >> 172.21.15.150:0/156433280 conn(0x7fd9180ffa90 msgr2=0x7fd918101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:08.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 -- 172.21.15.150:0/156433280 shutdown_connections 2024-09-15T22:10:08.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.476+0000 7fd91ce00640 1 -- 172.21.15.150:0/156433280 wait complete. 2024-09-15T22:10:08.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.477+0000 7fd91ce00640 1 Processor -- start 2024-09-15T22:10:08.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.477+0000 7fd91ce00640 1 -- start start 2024-09-15T22:10:08.481 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.477+0000 7fd91ce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd91819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd91ce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9181049a0 0x7fd91819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd91ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd918109120 0x7fd91819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd91ce00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd918114140 con 0x7fd918103ff0 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd91ce00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd918113fc0 con 0x7fd9181049a0 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd91ce00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181142c0 con 0x7fd918109120 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd91819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd91819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60278/0 (socket says 172.21.15.150:60278) 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 -- 172.21.15.150:0/2391344726 learned_addr learned my addr 172.21.15.150:0/2391344726 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915400640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9181049a0 0x7fd91819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd916800640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd918109120 0x7fd91819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 -- 172.21.15.150:0/2391344726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd918109120 msgr2=0x7fd91819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:08.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd918109120 0x7fd91819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 -- 172.21.15.150:0/2391344726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9181049a0 msgr2=0x7fd91819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9181049a0 0x7fd91819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd915e00640 1 -- 172.21.15.150:0/2391344726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91819f5b0 con 0x7fd918103ff0 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.478+0000 7fd916800640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd918109120 0x7fd91819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.479+0000 7fd915e00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd91819a600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd90802ade0 tx=0x7fd9080319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.479+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90802fa20 con 0x7fd918103ff0 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.479+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91819f840 con 0x7fd918103ff0 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.479+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd90802fbc0 con 0x7fd918103ff0 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.479+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080466e0 con 0x7fd918103ff0 2024-09-15T22:10:08.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.479+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9181a7180 con 0x7fd918103ff0 2024-09-15T22:10:08.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.480+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9181043d0 con 0x7fd918103ff0 2024-09-15T22:10:08.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.482+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fd908046940 con 0x7fd918103ff0 2024-09-15T22:10:08.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.483+0000 7fd90ea00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd8fc0a32c0 0x7fd8fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:08.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.483+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd9080f0c70 con 0x7fd918103ff0 2024-09-15T22:10:08.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.484+0000 7fd915400640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd8fc0a32c0 0x7fd8fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:08.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.484+0000 7fd915400640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd8fc0a32c0 0x7fd8fc0a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9180fff90 tx=0x7fd904005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:08.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.487+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9080bda40 con 0x7fd918103ff0 2024-09-15T22:10:08.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.700+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd91810c360 con 0x7fd918103ff0 2024-09-15T22:10:08.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.755+0000 7fd90ea00640 1 -- 172.21.15.150:0/2391344726 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fd9080bd340 con 0x7fd918103ff0 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd8fc0a32c0 msgr2=0x7fd8fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd8fc0a32c0 0x7fd8fc0a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9180fff90 tx=0x7fd904005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 msgr2=0x7fd91819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd91819a600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd90802ade0 tx=0x7fd9080319f0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 shutdown_connections 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd918109120 0x7fd91819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9181049a0 0x7fd91819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd8fc0a32c0 0x7fd8fc0a5780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 --2- 172.21.15.150:0/2391344726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd918103ff0 0x7fd91819a600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:08.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 >> 172.21.15.150:0/2391344726 conn(0x7fd9180ffa90 msgr2=0x7fd918100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:08.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 shutdown_connections 2024-09-15T22:10:08.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:08.758+0000 7fd91ce00640 1 -- 172.21.15.150:0/2391344726 wait complete. 2024-09-15T22:10:09.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:08 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] up:active 2024-09-15T22:10:09.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:08 smithi154 ceph-mon[34853]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:10:09.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:08 smithi154 ceph-mon[34853]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-15T22:10:09.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:08 smithi154 ceph-mon[34853]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-15T22:10:09.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:08 smithi154 ceph-mon[34853]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-15T22:10:09.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:08 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2391344726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:10:09.127 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:08 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] up:active 2024-09-15T22:10:09.127 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:08 smithi150 ceph-mon[30886]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:10:09.127 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:08 smithi150 ceph-mon[30886]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-15T22:10:09.127 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:08 smithi150 ceph-mon[30886]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-15T22:10:09.127 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:08 smithi150 ceph-mon[30886]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-15T22:10:09.127 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:08 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2391344726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:10:09.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:08 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] up:active 2024-09-15T22:10:09.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:08 smithi169 ceph-mon[35850]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:10:09.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:08 smithi169 ceph-mon[35850]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-15T22:10:09.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:08 smithi169 ceph-mon[35850]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-15T22:10:09.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:08 smithi169 ceph-mon[35850]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-15T22:10:09.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:08 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2391344726' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:10:09.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T22:10:09.521 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:10:09.262+0000 7fc0fe501640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-15T22:10:09.521 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:10:09.262+0000 7fc0fe501640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-15T22:10:09.815 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2391344726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:10:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] up:active 2024-09-15T22:10:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-15T22:10:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-15T22:10:10.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-15T22:10:10.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-15T22:10:10.022 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:09 smithi154 ceph-mon[34853]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-15T22:10:10.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2391344726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:10:10.117 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] up:active 2024-09-15T22:10:10.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-15T22:10:10.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-15T22:10:10.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-15T22:10:10.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-15T22:10:10.118 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:09 smithi150 ceph-mon[30886]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-15T22:10:10.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2391344726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:10:10.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] up:active 2024-09-15T22:10:10.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-15T22:10:10.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-15T22:10:10.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-15T22:10:10.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-15T22:10:10.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:09 smithi169 ceph-mon[35850]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-15T22:10:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 -- 172.21.15.150:0/4030212149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff73410e450 msgr2=0x7ff734110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 --2- 172.21.15.150:0/4030212149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff73410e450 0x7ff734110840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009900 tx=0x7ff72c02a480 comp rx=0 tx=0).stop 2024-09-15T22:10:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 -- 172.21.15.150:0/4030212149 shutdown_connections 2024-09-15T22:10:10.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 --2- 172.21.15.150:0/4030212149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff73410e450 0x7ff734110840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 --2- 172.21.15.150:0/4030212149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff734074e30 0x7ff73410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 --2- 172.21.15.150:0/4030212149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734074510 0x7ff7340748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 -- 172.21.15.150:0/4030212149 >> 172.21.15.150:0/4030212149 conn(0x7ff7340fd8b0 msgr2=0x7ff7340ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 -- 172.21.15.150:0/4030212149 shutdown_connections 2024-09-15T22:10:10.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.366+0000 7ff738e00640 1 -- 172.21.15.150:0/4030212149 wait complete. 2024-09-15T22:10:10.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 Processor -- start 2024-09-15T22:10:10.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 -- start start 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 0x7ff73419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff734074e30 0x7ff73419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73410e450 0x7ff73419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff734114160 con 0x7ff734074510 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff734113fe0 con 0x7ff73410e450 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff738e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341142e0 con 0x7ff734074e30 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff731e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 0x7ff73419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff731e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 0x7ff73419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44986/0 (socket says 172.21.15.150:44986) 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff731e00640 1 -- 172.21.15.150:0/2871316578 learned_addr learned my addr 172.21.15.150:0/2871316578 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.368+0000 7ff729400640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff734074e30 0x7ff73419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:10.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff732800640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73410e450 0x7ff73419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:10.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff731e00640 1 -- 172.21.15.150:0/2871316578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff734074e30 msgr2=0x7ff73419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:10.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff731e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff734074e30 0x7ff73419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff731e00640 1 -- 172.21.15.150:0/2871316578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73410e450 msgr2=0x7ff73419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:10.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff731e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73410e450 0x7ff73419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff731e00640 1 -- 172.21.15.150:0/2871316578 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73419f5b0 con 0x7ff734074510 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff731e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 0x7ff73419a600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff72400db80 tx=0x7ff72400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724017070 con 0x7ff734074510 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff724003b70 con 0x7ff734074510 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73419f8a0 con 0x7ff734074510 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.369+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7240106c0 con 0x7ff734074510 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.370+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7341a7180 con 0x7ff734074510 2024-09-15T22:10:10.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.371+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7340748f0 con 0x7ff734074510 2024-09-15T22:10:10.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.372+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ff724004020 con 0x7ff734074510 2024-09-15T22:10:10.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.374+0000 7ff72b400640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7180a3240 0x7ff7180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:10.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.374+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff7240cf5d0 con 0x7ff734074510 2024-09-15T22:10:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.374+0000 7ff729400640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7180a3240 0x7ff7180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:10.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.375+0000 7ff729400640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7180a3240 0x7ff7180a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff73410f770 tx=0x7ff71c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:10.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.378+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff724020070 con 0x7ff734074510 2024-09-15T22:10:10.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.585+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff7341a7380 con 0x7ff734074510 2024-09-15T22:10:10.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.783+0000 7ff72b400640 1 -- 172.21.15.150:0/2871316578 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7ff72409c3a0 con 0x7ff734074510 2024-09-15T22:10:10.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7180a3240 msgr2=0x7ff7180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7180a3240 0x7ff7180a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff73410f770 tx=0x7ff71c00b410 comp rx=0 tx=0).stop 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 msgr2=0x7ff73419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 0x7ff73419a600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff72400db80 tx=0x7ff72400b630 comp rx=0 tx=0).stop 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 shutdown_connections 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73410e450 0x7ff73419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff734074e30 0x7ff73419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7180a3240 0x7ff7180a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 --2- 172.21.15.150:0/2871316578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff734074510 0x7ff73419a600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.785+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 >> 172.21.15.150:0/2871316578 conn(0x7ff7340fd8b0 msgr2=0x7ff7340fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.786+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 shutdown_connections 2024-09-15T22:10:10.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:10.786+0000 7ff738e00640 1 -- 172.21.15.150:0/2871316578 wait complete. 2024-09-15T22:10:11.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] up:active 2024-09-15T22:10:11.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-15T22:10:11.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:10:11.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: Cluster is now healthy 2024-09-15T22:10:11.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-15T22:10:11.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-15T22:10:11.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-15T22:10:11.177 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:10 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2871316578' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:10:11.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] up:active 2024-09-15T22:10:11.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-15T22:10:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:10:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: Cluster is now healthy 2024-09-15T22:10:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-15T22:10:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-15T22:10:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-15T22:10:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:10 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2871316578' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:10:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] up:active 2024-09-15T22:10:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-15T22:10:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:10:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: Cluster is now healthy 2024-09-15T22:10:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-15T22:10:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-15T22:10:11.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-15T22:10:11.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:10 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2871316578' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:10:11.512 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-15T22:10:11.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T22:10:11.883 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:12.075 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:11 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2871316578' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:10:12.075 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:11 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] up:active 2024-09-15T22:10:12.076 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:11 smithi150 ceph-mon[30886]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-15T22:10:12.076 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:11 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:10:12.076 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:11 smithi150 ceph-mon[30886]: pgmap v294: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 12 op/s 2024-09-15T22:10:12.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:11 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2871316578' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:10:12.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:11 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] up:active 2024-09-15T22:10:12.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:11 smithi169 ceph-mon[35850]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-15T22:10:12.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:11 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:10:12.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:11 smithi169 ceph-mon[35850]: pgmap v294: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 12 op/s 2024-09-15T22:10:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:11 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2871316578' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:10:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:11 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] up:active 2024-09-15T22:10:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:11 smithi154 ceph-mon[34853]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-15T22:10:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:11 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:10:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:11 smithi154 ceph-mon[34853]: pgmap v294: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 12 op/s 2024-09-15T22:10:12.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 -- 172.21.15.150:0/595084687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680077040 msgr2=0x7fd680112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:12.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 --2- 172.21.15.150:0/595084687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680077040 0x7fd680112330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009900 tx=0x7fd66c02a410 comp rx=0 tx=0).stop 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 -- 172.21.15.150:0/595084687 shutdown_connections 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 --2- 172.21.15.150:0/595084687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680112870 0x7fd680114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 --2- 172.21.15.150:0/595084687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680077040 0x7fd680112330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 --2- 172.21.15.150:0/595084687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680076720 0x7fd680076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 -- 172.21.15.150:0/595084687 >> 172.21.15.150:0/595084687 conn(0x7fd6800ff910 msgr2=0x7fd680101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 -- 172.21.15.150:0/595084687 shutdown_connections 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.472+0000 7fd686600640 1 -- 172.21.15.150:0/595084687 wait complete. 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.473+0000 7fd686600640 1 Processor -- start 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 -- start start 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 0x7fd6801a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:12.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680077040 0x7fd6801a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680112870 0x7fd68019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd680118400 con 0x7fd680076720 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd680118280 con 0x7fd680077040 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd686600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd680118580 con 0x7fd680112870 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd685200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 0x7fd6801a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd685c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680112870 0x7fd68019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd685200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 0x7fd6801a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45008/0 (socket says 172.21.15.150:45008) 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.474+0000 7fd685200640 1 -- 172.21.15.150:0/1929213800 learned_addr learned my addr 172.21.15.150:0/1929213800 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd67fe00640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680077040 0x7fd6801a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685200640 1 -- 172.21.15.150:0/1929213800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680112870 msgr2=0x7fd68019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685200640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680112870 0x7fd68019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685200640 1 -- 172.21.15.150:0/1929213800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680077040 msgr2=0x7fd6801a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685200640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680077040 0x7fd6801a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685200640 1 -- 172.21.15.150:0/1929213800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68019ef90 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd67fe00640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680077040 0x7fd6801a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685c00640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680112870 0x7fd68019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd685200640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 0x7fd6801a4670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e9f0 tx=0x7fd67000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000cd80 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd670005500 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68019f280 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.475+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670010690 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.476+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6801ab4d0 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.477+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd680077e60 con 0x7fd680076720 2024-09-15T22:10:12.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.478+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fd6700046c0 con 0x7fd680076720 2024-09-15T22:10:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.480+0000 7fd67d600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6640a32c0 0x7fd6640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.480+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd6700cfc90 con 0x7fd680076720 2024-09-15T22:10:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.480+0000 7fd67fe00640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6640a32c0 0x7fd6640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.481+0000 7fd67fe00640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6640a32c0 0x7fd6640a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd68019fb40 tx=0x7fd66c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:12.490 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.484+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd67009ca60 con 0x7fd680076720 2024-09-15T22:10:12.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.689+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd68010da70 con 0x7fd6640a32c0 2024-09-15T22:10:12.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.718+0000 7fd67d600640 1 -- 172.21.15.150:0/1929213800 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd66c0315b0 con 0x7fd6640a32c0 2024-09-15T22:10:12.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6640a32c0 msgr2=0x7fd6640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:12.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6640a32c0 0x7fd6640a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd68019fb40 tx=0x7fd66c005a20 comp rx=0 tx=0).stop 2024-09-15T22:10:12.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 msgr2=0x7fd6801a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:12.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 0x7fd6801a4670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e9f0 tx=0x7fd67000edf0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 shutdown_connections 2024-09-15T22:10:12.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd680112870 0x7fd68019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd680077040 0x7fd6801a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6640a32c0 0x7fd6640a5780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 --2- 172.21.15.150:0/1929213800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd680076720 0x7fd6801a4670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:12.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 >> 172.21.15.150:0/1929213800 conn(0x7fd6800ff910 msgr2=0x7fd680101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:12.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 shutdown_connections 2024-09-15T22:10:12.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:12.720+0000 7fd686600640 1 -- 172.21.15.150:0/1929213800 wait complete. 2024-09-15T22:10:13.082 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:10:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:10:12.696+0000 7ff546400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:10:13.082 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:10:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:10:12.696+0000 7ff546400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:10:13.082 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:10:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:10:12.696+0000 7ff546400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:10:13.082 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:10:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:10:12.696+0000 7ff546400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:10:13.082 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:10:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:10:12.696+0000 7ff546400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:10:13.530 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T22:10:13.899 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:14.352 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:14 smithi150 ceph-mon[30886]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:14.352 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:14 smithi150 ceph-mon[30886]: pgmap v295: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-09-15T22:10:14.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:14 smithi169 ceph-mon[35850]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:14.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:14 smithi169 ceph-mon[35850]: pgmap v295: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-09-15T22:10:14.467 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 -- 172.21.15.150:0/1004355986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c108f60 msgr2=0x7f713c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 --2- 172.21.15.150:0/1004355986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c108f60 0x7f713c110ae0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7134009900 tx=0x7f713402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 -- 172.21.15.150:0/1004355986 shutdown_connections 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 --2- 172.21.15.150:0/1004355986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c108f60 0x7f713c110ae0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 --2- 172.21.15.150:0/1004355986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c1047e0 0x7f713c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 --2- 172.21.15.150:0/1004355986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 0x7f713c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 -- 172.21.15.150:0/1004355986 >> 172.21.15.150:0/1004355986 conn(0x7f713c0ff8d0 msgr2=0x7f713c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 -- 172.21.15.150:0/1004355986 shutdown_connections 2024-09-15T22:10:14.468 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.465+0000 7f713be00640 1 -- 172.21.15.150:0/1004355986 wait complete. 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.466+0000 7f713be00640 1 Processor -- start 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.466+0000 7f713be00640 1 -- start start 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 0x7f713c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 0x7f713c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c108f60 0x7f713c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f713c113fc0 con 0x7f713c1047e0 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713be00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f713c113e40 con 0x7f713c108f60 2024-09-15T22:10:14.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f713c114140 con 0x7f713c103e30 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 0x7f713c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 0x7f713c19a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45046/0 (socket says 172.21.15.150:45046) 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 -- 172.21.15.150:0/3959932067 learned_addr learned my addr 172.21.15.150:0/3959932067 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713aa00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 0x7f713c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713b400640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c108f60 0x7f713c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 -- 172.21.15.150:0/3959932067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 msgr2=0x7f713c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 0x7f713c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 -- 172.21.15.150:0/3959932067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c108f60 msgr2=0x7f713c19ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.467+0000 7f713a000640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c108f60 0x7f713c19ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f713a000640 1 -- 172.21.15.150:0/3959932067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c19f390 con 0x7f713c1047e0 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f713aa00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 0x7f713c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f713a000640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 0x7f713c19a920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f712800e9f0 tx=0x7f712800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:14.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712800cd80 con 0x7f713c1047e0 2024-09-15T22:10:14.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7128010910 con 0x7f713c1047e0 2024-09-15T22:10:14.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713c19f680 con 0x7f713c1047e0 2024-09-15T22:10:14.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128018990 con 0x7f713c1047e0 2024-09-15T22:10:14.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.468+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713c1a6f60 con 0x7f713c1047e0 2024-09-15T22:10:14.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.469+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f713c104210 con 0x7f713c1047e0 2024-09-15T22:10:14.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.471+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7128010ac0 con 0x7f713c1047e0 2024-09-15T22:10:14.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.472+0000 7f7133400640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f71200a3350 0x7f71200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:14.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.473+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f71280cfbc0 con 0x7f713c1047e0 2024-09-15T22:10:14.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.473+0000 7f713aa00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f71200a3350 0x7f71200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:14.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.473+0000 7f713aa00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f71200a3350 0x7f71200a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f712c005fd0 tx=0x7f712c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:14.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.476+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f712809c1e0 con 0x7f713c1047e0 2024-09-15T22:10:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:14 smithi154 ceph-mon[34853]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:14 smithi154 ceph-mon[34853]: pgmap v295: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-09-15T22:10:14.521 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:10:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:10:14.263+0000 7fc0fe501640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-15T22:10:14.521 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:10:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:10:14.263+0000 7fc0fe501640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-15T22:10:14.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.676+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f713c062630 con 0x7f71200a3350 2024-09-15T22:10:14.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.703+0000 7f7133400640 1 -- 172.21.15.150:0/3959932067 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f713c062630 con 0x7f71200a3350 2024-09-15T22:10:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f71200a3350 msgr2=0x7f71200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f71200a3350 0x7f71200a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f712c005fd0 tx=0x7f712c009500 comp rx=0 tx=0).stop 2024-09-15T22:10:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 msgr2=0x7f713c19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 0x7f713c19a920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f712800e9f0 tx=0x7f712800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 shutdown_connections 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c108f60 0x7f713c19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f71200a3350 0x7f71200a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f713c1047e0 0x7f713c19a920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 --2- 172.21.15.150:0/3959932067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c103e30 0x7f713c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 >> 172.21.15.150:0/3959932067 conn(0x7f713c0ff8d0 msgr2=0x7f713c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.705+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 shutdown_connections 2024-09-15T22:10:14.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:14.706+0000 7f713be00640 1 -- 172.21.15.150:0/3959932067 wait complete. 2024-09-15T22:10:15.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:15 smithi150 ceph-mon[30886]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:10:15.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:15 smithi169 ceph-mon[35850]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:10:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:15 smithi154 ceph-mon[34853]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:10:15.601 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T22:10:15.970 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:16.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:16 smithi150 ceph-mon[30886]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:16.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:16 smithi150 ceph-mon[30886]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-15T22:10:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:16 smithi169 ceph-mon[35850]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:16.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:16 smithi169 ceph-mon[35850]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-15T22:10:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:16 smithi154 ceph-mon[34853]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:16 smithi154 ceph-mon[34853]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.572+0000 7fe136e00640 1 -- 172.21.15.150:0/3975777323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 msgr2=0x7fe1301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.572+0000 7fe136e00640 1 --2- 172.21.15.150:0/3975777323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe1301021c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe120009ca0 tx=0x7fe12002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 -- 172.21.15.150:0/3975777323 shutdown_connections 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 --2- 172.21.15.150:0/3975777323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe130106f10 0x7fe13010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 --2- 172.21.15.150:0/3975777323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe130102790 0x7fe1301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 --2- 172.21.15.150:0/3975777323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe1301021c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 -- 172.21.15.150:0/3975777323 >> 172.21.15.150:0/3975777323 conn(0x7fe1300fd8c0 msgr2=0x7fe1300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 -- 172.21.15.150:0/3975777323 shutdown_connections 2024-09-15T22:10:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.573+0000 7fe136e00640 1 -- 172.21.15.150:0/3975777323 wait complete. 2024-09-15T22:10:16.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 Processor -- start 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 -- start start 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe13019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe130102790 0x7fe13019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe130106f10 0x7fe13019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe130111f70 con 0x7fe130101de0 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe130111df0 con 0x7fe130106f10 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.574+0000 7fe136e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe1301120f0 con 0x7fe130102790 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe13019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe13019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45058/0 (socket says 172.21.15.150:45058) 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 -- 172.21.15.150:0/4263785263 learned_addr learned my addr 172.21.15.150:0/4263785263 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe127400640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe130102790 0x7fe13019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:16.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe134e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe130106f10 0x7fe13019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 -- 172.21.15.150:0/4263785263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe130102790 msgr2=0x7fe13019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe130102790 0x7fe13019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 -- 172.21.15.150:0/4263785263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe130106f10 msgr2=0x7fe13019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe130106f10 0x7fe13019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.575+0000 7fe12fe00640 1 -- 172.21.15.150:0/4263785263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13019f5f0 con 0x7fe130101de0 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.576+0000 7fe12fe00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe13019a640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe12002ade0 tx=0x7fe1200319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.576+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12002fa20 con 0x7fe130101de0 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.576+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13019f880 con 0x7fe130101de0 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.576+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe12002fbc0 con 0x7fe130101de0 2024-09-15T22:10:16.579 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.576+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1200467b0 con 0x7fe130101de0 2024-09-15T22:10:16.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.576+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1301a71c0 con 0x7fe130101de0 2024-09-15T22:10:16.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.577+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1301021c0 con 0x7fe130101de0 2024-09-15T22:10:16.580 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.579+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe120046950 con 0x7fe130101de0 2024-09-15T22:10:16.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.580+0000 7fe12d600640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe1140a32d0 0x7fe1140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:16.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.580+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe1200f0d30 con 0x7fe130101de0 2024-09-15T22:10:16.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.580+0000 7fe127400640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe1140a32d0 0x7fe1140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:16.582 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.581+0000 7fe127400640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe1140a32d0 0x7fe1140a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe1300ff790 tx=0x7fe11800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:16.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.584+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1200bdb40 con 0x7fe130101de0 2024-09-15T22:10:16.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.786+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe13010de00 con 0x7fe1140a32d0 2024-09-15T22:10:16.794 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.792+0000 7fe12d600640 1 -- 172.21.15.150:0/4263785263 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe13010de00 con 0x7fe1140a32d0 2024-09-15T22:10:16.794 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/qa/sv_0/ad5b6b4e-c2f6-48a7-81f0-249b01fd4fad 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe1140a32d0 msgr2=0x7fe1140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe1140a32d0 0x7fe1140a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe1300ff790 tx=0x7fe11800b410 comp rx=0 tx=0).stop 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 msgr2=0x7fe13019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe13019a640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe12002ade0 tx=0x7fe1200319f0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 shutdown_connections 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe130106f10 0x7fe13019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe130102790 0x7fe13019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe1140a32d0 0x7fe1140a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 --2- 172.21.15.150:0/4263785263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe130101de0 0x7fe13019a640 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:16.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 >> 172.21.15.150:0/4263785263 conn(0x7fe1300fd8c0 msgr2=0x7fe1300fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:16.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 shutdown_connections 2024-09-15T22:10:16.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:16.795+0000 7fe136e00640 1 -- 172.21.15.150:0/4263785263 wait complete. 2024-09-15T22:10:17.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T22:10:17.988 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:18.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:18 smithi150 ceph-mon[30886]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:18.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:18 smithi150 ceph-mon[30886]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-09-15T22:10:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:18 smithi154 ceph-mon[34853]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:18 smithi154 ceph-mon[34853]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-09-15T22:10:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 -- 172.21.15.150:0/98841859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0101049c0 msgr2=0x7fe010108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 --2- 172.21.15.150:0/98841859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0101049c0 0x7fe010108a10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009900 tx=0x7fdffc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 -- 172.21.15.150:0/98841859 shutdown_connections 2024-09-15T22:10:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 --2- 172.21.15.150:0/98841859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe010109140 0x7fe010110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 --2- 172.21.15.150:0/98841859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0101049c0 0x7fe010108a10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 --2- 172.21.15.150:0/98841859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe010104010 0x7fe0101043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 -- 172.21.15.150:0/98841859 >> 172.21.15.150:0/98841859 conn(0x7fe0100ffa50 msgr2=0x7fe010101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 -- 172.21.15.150:0/98841859 shutdown_connections 2024-09-15T22:10:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.557+0000 7fe017e00640 1 -- 172.21.15.150:0/98841859 wait complete. 2024-09-15T22:10:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.558+0000 7fe017e00640 1 Processor -- start 2024-09-15T22:10:18.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.558+0000 7fe017e00640 1 -- start start 2024-09-15T22:10:18.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe017e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 0x7fe01019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:18.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe017e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0101049c0 0x7fe01019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:18.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe017e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe010109140 0x7fe01019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe017e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe010114190 con 0x7fe010104010 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe017e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe010114010 con 0x7fe0101049c0 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe017e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe010114310 con 0x7fe010109140 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe015400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 0x7fe01019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe015400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 0x7fe01019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45084/0 (socket says 172.21.15.150:45084) 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe015e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe010109140 0x7fe01019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe015400640 1 -- 172.21.15.150:0/4065577085 learned_addr learned my addr 172.21.15.150:0/4065577085 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.559+0000 7fe014a00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0101049c0 0x7fe01019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe015400640 1 -- 172.21.15.150:0/4065577085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe010109140 msgr2=0x7fe01019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe015400640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe010109140 0x7fe01019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe015400640 1 -- 172.21.15.150:0/4065577085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0101049c0 msgr2=0x7fe01019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe015400640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0101049c0 0x7fe01019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe015400640 1 -- 172.21.15.150:0/4065577085 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01019f6c0 con 0x7fe010104010 2024-09-15T22:10:18.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe015400640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 0x7fe01019a710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe00400ebc0 tx=0x7fe00400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:18.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004010630 con 0x7fe010104010 2024-09-15T22:10:18.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe004010cb0 con 0x7fe010104010 2024-09-15T22:10:18.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004018bd0 con 0x7fe010104010 2024-09-15T22:10:18.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.560+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01019f9b0 con 0x7fe010104010 2024-09-15T22:10:18.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.561+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0101a7290 con 0x7fe010104010 2024-09-15T22:10:18.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.561+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0101043f0 con 0x7fe010104010 2024-09-15T22:10:18.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.563+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe0040107d0 con 0x7fe010104010 2024-09-15T22:10:18.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.564+0000 7fe00e000640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdff80a32d0 0x7fdff80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:18.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.565+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe0040cfff0 con 0x7fe010104010 2024-09-15T22:10:18.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.565+0000 7fe014a00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdff80a32d0 0x7fdff80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:18.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.565+0000 7fe014a00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdff80a32d0 0x7fdff80a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:18.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.568+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe00409c630 con 0x7fe010104010 2024-09-15T22:10:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:18 smithi169 ceph-mon[35850]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:18 smithi169 ceph-mon[35850]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-09-15T22:10:18.769 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.768+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe010062630 con 0x7fdff80a32d0 2024-09-15T22:10:18.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.793+0000 7fe00e000640 1 -- 172.21.15.150:0/4065577085 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe010062630 con 0x7fdff80a32d0 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdff80a32d0 msgr2=0x7fdff80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdff80a32d0 0x7fdff80a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc005b50 comp rx=0 tx=0).stop 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 msgr2=0x7fe01019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 0x7fe01019a710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe00400ebc0 tx=0x7fe00400c6a0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 shutdown_connections 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe010109140 0x7fe01019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0101049c0 0x7fe01019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdff80a32d0 0x7fdff80a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 --2- 172.21.15.150:0/4065577085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe010104010 0x7fe01019a710 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 >> 172.21.15.150:0/4065577085 conn(0x7fe0100ffa50 msgr2=0x7fe010100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:18.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 shutdown_connections 2024-09-15T22:10:18.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:18.796+0000 7fe017e00640 1 -- 172.21.15.150:0/4065577085 wait complete. 2024-09-15T22:10:19.626 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T22:10:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:20.383 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:20 smithi150 ceph-mon[30886]: from='client.14643 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:20.383 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:20 smithi150 ceph-mon[30886]: pgmap v298: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-09-15T22:10:20.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 -- 172.21.15.150:0/3407946455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 msgr2=0x7f7538110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:20.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 --2- 172.21.15.150:0/3407946455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 0x7f7538110810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7530009ca0 tx=0x7f753002a950 comp rx=0 tx=0).stop 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 -- 172.21.15.150:0/3407946455 shutdown_connections 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 --2- 172.21.15.150:0/3407946455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 0x7f7538110810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 --2- 172.21.15.150:0/3407946455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074f40 0x7f753810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 --2- 172.21.15.150:0/3407946455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7538074620 0x7f7538074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 -- 172.21.15.150:0/3407946455 >> 172.21.15.150:0/3407946455 conn(0x7f75380fd8c0 msgr2=0x7f75380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 -- 172.21.15.150:0/3407946455 shutdown_connections 2024-09-15T22:10:20.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.495+0000 7f753f000640 1 -- 172.21.15.150:0/3407946455 wait complete. 2024-09-15T22:10:20.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.496+0000 7f753f000640 1 Processor -- start 2024-09-15T22:10:20.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.496+0000 7f753f000640 1 -- start start 2024-09-15T22:10:20.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753f000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 0x7f753819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753f000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7538074f40 0x7f753819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753f000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 0x7f753819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753f000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7538114150 con 0x7f753810e3c0 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753f000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7538113fd0 con 0x7f7538074f40 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753f000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f75381142d0 con 0x7f7538074620 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 0x7f753819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 0x7f753819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:34278/0 (socket says 172.21.15.150:34278) 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 -- 172.21.15.150:0/3527211100 learned_addr learned my addr 172.21.15.150:0/3527211100 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f753d000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 0x7f753819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537400640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7538074f40 0x7f753819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:20.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 -- 172.21.15.150:0/3527211100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7538074f40 msgr2=0x7f753819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7538074f40 0x7f753819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 -- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 msgr2=0x7f753819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 0x7f753819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.497+0000 7f7537e00640 1 -- 172.21.15.150:0/3527211100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753819f5a0 con 0x7f7538074620 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.498+0000 7f7537e00640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 0x7f753819a5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f752800d950 tx=0x7f752800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.498+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528017030 con 0x7f7538074620 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.498+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753819f890 con 0x7f7538074620 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.498+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7528004020 con 0x7f7538074620 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.498+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280047a0 con 0x7f7538074620 2024-09-15T22:10:20.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.498+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75381a7170 con 0x7f7538074620 2024-09-15T22:10:20.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.499+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7538074a00 con 0x7f7538074620 2024-09-15T22:10:20.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.501+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f75280041d0 con 0x7f7538074620 2024-09-15T22:10:20.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.502+0000 7f7534c00640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f751c0a3350 0x7f751c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:20.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.502+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f75280cf2b0 con 0x7f7538074620 2024-09-15T22:10:20.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.502+0000 7f7537400640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f751c0a3350 0x7f751c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:20.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.503+0000 7f7537400640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f751c0a3350 0x7f751c0a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f753810f750 tx=0x7f752400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:20.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.507+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f752809bf20 con 0x7f7538074620 2024-09-15T22:10:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:20 smithi154 ceph-mon[34853]: from='client.14643 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:20 smithi154 ceph-mon[34853]: pgmap v298: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-09-15T22:10:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:20 smithi169 ceph-mon[35850]: from='client.14643 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:20 smithi169 ceph-mon[35850]: pgmap v298: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.9 KiB/s wr, 23 op/s 2024-09-15T22:10:20.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.712+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7538062630 con 0x7f751c0a3350 2024-09-15T22:10:20.719 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.717+0000 7f7534c00640 1 -- 172.21.15.150:0/3527211100 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7538062630 con 0x7f751c0a3350 2024-09-15T22:10:20.719 INFO:teuthology.orchestra.run.smithi150.stdout:/volumes/qa/sv_1/5c790d46-90ed-4cc0-952d-75772bb60645 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.719+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f751c0a3350 msgr2=0x7f751c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.719+0000 7f753f000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f751c0a3350 0x7f751c0a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f753810f750 tx=0x7f752400b390 comp rx=0 tx=0).stop 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.719+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 msgr2=0x7f753819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.719+0000 7f753f000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 0x7f753819a5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f752800d950 tx=0x7f752800de10 comp rx=0 tx=0).stop 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 shutdown_connections 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f751c0a3350 0x7f751c0a5810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f753810e3c0 0x7f753819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7538074f40 0x7f753819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 --2- 172.21.15.150:0/3527211100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7538074620 0x7f753819a5f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 >> 172.21.15.150:0/3527211100 conn(0x7f75380fd8c0 msgr2=0x7f75380fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 shutdown_connections 2024-09-15T22:10:20.722 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:20.720+0000 7f753f000640 1 -- 172.21.15.150:0/3527211100 wait complete. 2024-09-15T22:10:21.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:10:21.768 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:22.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 -- 172.21.15.150:0/1718732079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc1047e0 msgr2=0x7fecdc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:22.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 --2- 172.21.15.150:0/1718732079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc1047e0 0x7fecdc108830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009900 tx=0x7fecc402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 -- 172.21.15.150:0/1718732079 shutdown_connections 2024-09-15T22:10:22.315 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 --2- 172.21.15.150:0/1718732079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecdc108f60 0x7fecdc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 --2- 172.21.15.150:0/1718732079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc1047e0 0x7fecdc108830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 --2- 172.21.15.150:0/1718732079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecdc103e30 0x7fecdc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 -- 172.21.15.150:0/1718732079 >> 172.21.15.150:0/1718732079 conn(0x7fecdc0ff8d0 msgr2=0x7fecdc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 -- 172.21.15.150:0/1718732079 shutdown_connections 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.310+0000 7fece2200640 1 -- 172.21.15.150:0/1718732079 wait complete. 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.311+0000 7fece2200640 1 Processor -- start 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.311+0000 7fece2200640 1 -- start start 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 0x7fecdc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece2200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecdc1047e0 0x7fecdc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece2200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecdc108f60 0x7fecdc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:22.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece2200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc113fc0 con 0x7fecdc103e30 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece2200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc113e40 con 0x7fecdc1047e0 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece2200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc114140 con 0x7fecdc108f60 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 0x7fecdc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 0x7fecdc19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39822/0 (socket says 172.21.15.150:39822) 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 -- 172.21.15.150:0/3835625637 learned_addr learned my addr 172.21.15.150:0/3835625637 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece1800640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecdc108f60 0x7fecdc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fecd3e00640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecdc1047e0 0x7fecdc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 -- 172.21.15.150:0/3835625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecdc108f60 msgr2=0x7fecdc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:22.317 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecdc108f60 0x7fecdc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 -- 172.21.15.150:0/3835625637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecdc1047e0 msgr2=0x7fecdc19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecdc1047e0 0x7fecdc19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.312+0000 7fece0e00640 1 -- 172.21.15.150:0/3835625637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc19f400 con 0x7fecdc103e30 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.313+0000 7fece0e00640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 0x7fecdc19a450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d950 tx=0x7feccc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.313+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc017030 con 0x7fecdc103e30 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.313+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feccc004020 con 0x7fecdc103e30 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.313+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecdc19f6f0 con 0x7fecdc103e30 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.313+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc0047a0 con 0x7fecdc103e30 2024-09-15T22:10:22.318 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.313+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecdc1a6fd0 con 0x7fecdc103e30 2024-09-15T22:10:22.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.314+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecdc104210 con 0x7fecdc103e30 2024-09-15T22:10:22.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.316+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7feccc0041d0 con 0x7fecdc103e30 2024-09-15T22:10:22.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.317+0000 7fecda000640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fecc00a3350 0x7fecc00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:22.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.318+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7feccc0cf2a0 con 0x7fecdc103e30 2024-09-15T22:10:22.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.318+0000 7fecd3e00640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fecc00a3350 0x7fecc00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:22.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.318+0000 7fecd3e00640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fecc00a3350 0x7fecc00a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009230 tx=0x7fecc40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:22.323 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.322+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feccc09bf10 con 0x7fecdc103e30 2024-09-15T22:10:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:22 smithi154 ceph-mon[34853]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:22 smithi154 ceph-mon[34853]: pgmap v299: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-09-15T22:10:22.532 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.530+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecdc10bbb0 con 0x7fecdc103e30 2024-09-15T22:10:22.532 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:22 smithi150 ceph-mon[30886]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:22.532 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:22 smithi150 ceph-mon[30886]: pgmap v299: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-09-15T22:10:22.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.531+0000 7fecda000640 1 -- 172.21.15.150:0/3835625637 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11997 (secure 0 0 0) 0x7feccc09b810 con 0x7fecdc103e30 2024-09-15T22:10:22.533 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:22.534 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"btime":"2024-09-15T22:10:10:787282+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:10:10.787262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:10:22.534 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fecc00a3350 msgr2=0x7fecc00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fecc00a3350 0x7fecc00a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009230 tx=0x7fecc40058d0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 msgr2=0x7fecdc19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 0x7fecdc19a450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d950 tx=0x7feccc00de10 comp rx=0 tx=0).stop 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 shutdown_connections 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecdc108f60 0x7fecdc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecdc1047e0 0x7fecdc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fecc00a3350 0x7fecc00a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 --2- 172.21.15.150:0/3835625637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc103e30 0x7fecdc19a450 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:22.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 >> 172.21.15.150:0/3835625637 conn(0x7fecdc0ff8d0 msgr2=0x7fecdc100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:22.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 shutdown_connections 2024-09-15T22:10:22.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:22.534+0000 7fece2200640 1 -- 172.21.15.150:0/3835625637 wait complete. 2024-09-15T22:10:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:22 smithi169 ceph-mon[35850]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:22.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:22 smithi169 ceph-mon[35850]: pgmap v299: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-09-15T22:10:23.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:10:23.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:23 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3835625637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:10:23.658 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:23.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:23 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3835625637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:10:23.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:23 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3835625637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:10:24.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 -- 172.21.15.150:0/1408524037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c1047e0 msgr2=0x7ff75c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:24.174 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 --2- 172.21.15.150:0/1408524037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c1047e0 0x7ff75c108830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff748009900 tx=0x7ff74802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 -- 172.21.15.150:0/1408524037 shutdown_connections 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 --2- 172.21.15.150:0/1408524037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c108f60 0x7ff75c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 --2- 172.21.15.150:0/1408524037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c1047e0 0x7ff75c108830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 --2- 172.21.15.150:0/1408524037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff75c103e30 0x7ff75c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 -- 172.21.15.150:0/1408524037 >> 172.21.15.150:0/1408524037 conn(0x7ff75c0ff910 msgr2=0x7ff75c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 -- 172.21.15.150:0/1408524037 shutdown_connections 2024-09-15T22:10:24.175 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.172+0000 7ff760e00640 1 -- 172.21.15.150:0/1408524037 wait complete. 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.173+0000 7ff760e00640 1 Processor -- start 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.173+0000 7ff760e00640 1 -- start start 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff760e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 0x7ff75c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff760e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c1047e0 0x7ff75c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff760e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff75c108f60 0x7ff75c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff760e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c114010 con 0x7ff75c103e30 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff760e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c113e90 con 0x7ff75c1047e0 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff760e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c114190 con 0x7ff75c108f60 2024-09-15T22:10:24.177 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 0x7ff75c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c1047e0 0x7ff75c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 0x7ff75c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39844/0 (socket says 172.21.15.150:39844) 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75b400640 1 -- 172.21.15.150:0/517072580 learned_addr learned my addr 172.21.15.150:0/517072580 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75be00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff75c108f60 0x7ff75c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75aa00640 1 -- 172.21.15.150:0/517072580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff75c108f60 msgr2=0x7ff75c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75aa00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff75c108f60 0x7ff75c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75aa00640 1 -- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 msgr2=0x7ff75c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75aa00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 0x7ff75c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75aa00640 1 -- 172.21.15.150:0/517072580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c19f480 con 0x7ff75c1047e0 2024-09-15T22:10:24.178 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.174+0000 7ff75b400640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 0x7ff75c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:24.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.175+0000 7ff75aa00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c1047e0 0x7ff75c19aa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff74802a910 tx=0x7ff748003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:24.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.175+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74803f070 con 0x7ff75c1047e0 2024-09-15T22:10:24.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.175+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff748031c90 con 0x7ff75c1047e0 2024-09-15T22:10:24.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.175+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748035030 con 0x7ff75c1047e0 2024-09-15T22:10:24.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.175+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c19f710 con 0x7ff75c1047e0 2024-09-15T22:10:24.179 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.175+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c19fba0 con 0x7ff75c1047e0 2024-09-15T22:10:24.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.177+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75c105310 con 0x7ff75c1047e0 2024-09-15T22:10:24.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.179+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff748042070 con 0x7ff75c1047e0 2024-09-15T22:10:24.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.180+0000 7ff753e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7400a3350 0x7ff7400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:24.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.181+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff7480f0250 con 0x7ff75c1047e0 2024-09-15T22:10:24.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.181+0000 7ff75b400640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7400a3350 0x7ff7400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:24.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.181+0000 7ff75b400640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7400a3350 0x7ff7400a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff74c011500 tx=0x7ff74c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:24.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.185+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7480bc870 con 0x7ff75c1047e0 2024-09-15T22:10:24.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.361+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff75c10bc10 con 0x7ff75c1047e0 2024-09-15T22:10:24.363 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:24 smithi150 ceph-mon[30886]: pgmap v300: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 16 op/s 2024-09-15T22:10:24.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.362+0000 7ff753e00640 1 -- 172.21.15.150:0/517072580 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22348 (secure 0 0 0) 0x7ff7480c0b70 con 0x7ff75c1047e0 2024-09-15T22:10:24.365 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:24.365 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:09:57.693703+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7400a3350 msgr2=0x7ff7400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7400a3350 0x7ff7400a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff74c011500 tx=0x7ff74c005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c1047e0 msgr2=0x7ff75c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c1047e0 0x7ff75c19aa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff74802a910 tx=0x7ff748003b20 comp rx=0 tx=0).stop 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 shutdown_connections 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff75c108f60 0x7ff75c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff75c1047e0 0x7ff75c19aa10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff7400a3350 0x7ff7400a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 --2- 172.21.15.150:0/517072580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff75c103e30 0x7ff75c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:24.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 >> 172.21.15.150:0/517072580 conn(0x7ff75c0ff910 msgr2=0x7ff75c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:24.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 shutdown_connections 2024-09-15T22:10:24.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:24.365+0000 7ff760e00640 1 -- 172.21.15.150:0/517072580 wait complete. 2024-09-15T22:10:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:24 smithi154 ceph-mon[34853]: pgmap v300: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 16 op/s 2024-09-15T22:10:24.610 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:24 smithi169 ceph-mon[35850]: pgmap v300: 97 pgs: 97 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 16 op/s 2024-09-15T22:10:25.055 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:10:25.056 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:10:25.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:25 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/517072580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:25.426 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:25.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:25 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/517072580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:25 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/517072580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 -- 172.21.15.150:0/176872541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c102790 msgr2=0x7fc70c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 --2- 172.21.15.150:0/176872541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c102790 0x7fc70c1067e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc700009900 tx=0x7fc70002a410 comp rx=0 tx=0).stop 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 -- 172.21.15.150:0/176872541 shutdown_connections 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 --2- 172.21.15.150:0/176872541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc70c106f10 0x7fc70c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 --2- 172.21.15.150:0/176872541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c102790 0x7fc70c1067e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 --2- 172.21.15.150:0/176872541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc70c101de0 0x7fc70c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.906+0000 7fc714000640 1 -- 172.21.15.150:0/176872541 >> 172.21.15.150:0/176872541 conn(0x7fc70c0fd8c0 msgr2=0x7fc70c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.907+0000 7fc714000640 1 -- 172.21.15.150:0/176872541 shutdown_connections 2024-09-15T22:10:25.909 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.907+0000 7fc714000640 1 -- 172.21.15.150:0/176872541 wait complete. 2024-09-15T22:10:25.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.907+0000 7fc714000640 1 Processor -- start 2024-09-15T22:10:25.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 -- start start 2024-09-15T22:10:25.911 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 0x7fc70c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc70c102790 0x7fc70c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc70c106f10 0x7fc70c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c111fc0 con 0x7fc70c101de0 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c111e40 con 0x7fc70c102790 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc714000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c112140 con 0x7fc70c106f10 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc711600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 0x7fc70c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc711600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 0x7fc70c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39870/0 (socket says 172.21.15.150:39870) 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc711600640 1 -- 172.21.15.150:0/3857153996 learned_addr learned my addr 172.21.15.150:0/3857153996 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc710c00640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc70c102790 0x7fc70c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.908+0000 7fc712000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc70c106f10 0x7fc70c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:25.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc711600640 1 -- 172.21.15.150:0/3857153996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc70c106f10 msgr2=0x7fc70c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc711600640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc70c106f10 0x7fc70c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc711600640 1 -- 172.21.15.150:0/3857153996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc70c102790 msgr2=0x7fc70c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc711600640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc70c102790 0x7fc70c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc711600640 1 -- 172.21.15.150:0/3857153996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c19f6f0 con 0x7fc70c101de0 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc711600640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 0x7fc70c19a740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800e9f0 tx=0x7fc6f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800cd80 con 0x7fc70c101de0 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6f8005500 con 0x7fc70c101de0 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70c19f9e0 con 0x7fc70c101de0 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8010690 con 0x7fc70c101de0 2024-09-15T22:10:25.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.909+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70c1a72c0 con 0x7fc70c101de0 2024-09-15T22:10:25.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.910+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70c1021c0 con 0x7fc70c101de0 2024-09-15T22:10:25.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.913+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc6f80046c0 con 0x7fc70c101de0 2024-09-15T22:10:25.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.914+0000 7fc70a000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc6f40a32d0 0x7fc6f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:25.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.914+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc6f80cffe0 con 0x7fc70c101de0 2024-09-15T22:10:25.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.915+0000 7fc710c00640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc6f40a32d0 0x7fc6f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:25.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.915+0000 7fc710c00640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc6f40a32d0 0x7fc6f40a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc700000c00 tx=0x7fc700005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:25.917 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:25.916+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6f80541b0 con 0x7fc70c101de0 2024-09-15T22:10:26.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.086+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc70c075430 con 0x7fc6f40a32d0 2024-09-15T22:10:26.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.094+0000 7fc70a000640 1 -- 172.21.15.150:0/3857153996 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258751 (secure 0 0 0) 0x7fc70c075430 con 0x7fc6f40a32d0 2024-09-15T22:10:26.099 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:26.101 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-15T22:10:26.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc6f40a32d0 msgr2=0x7fc6f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:26.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc6f40a32d0 0x7fc6f40a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc700000c00 tx=0x7fc700005b50 comp rx=0 tx=0).stop 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 msgr2=0x7fc70c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 0x7fc70c19a740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800e9f0 tx=0x7fc6f800edf0 comp rx=0 tx=0).stop 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 shutdown_connections 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc70c106f10 0x7fc70c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc70c102790 0x7fc70c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc6f40a32d0 0x7fc6f40a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 --2- 172.21.15.150:0/3857153996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc70c101de0 0x7fc70c19a740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 >> 172.21.15.150:0/3857153996 conn(0x7fc70c0fd8c0 msgr2=0x7fc70c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 shutdown_connections 2024-09-15T22:10:26.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:26.098+0000 7fc714000640 1 -- 172.21.15.150:0/3857153996 wait complete. 2024-09-15T22:10:26.484 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:26 smithi150 ceph-mon[30886]: pgmap v301: 97 pgs: 97 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 KiB/s wr, 20 op/s 2024-09-15T22:10:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:26 smithi154 ceph-mon[34853]: pgmap v301: 97 pgs: 97 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 KiB/s wr, 20 op/s 2024-09-15T22:10:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:26 smithi169 ceph-mon[35850]: pgmap v301: 97 pgs: 97 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 KiB/s wr, 20 op/s 2024-09-15T22:10:26.889 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-09-15T22:10:25.143201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":297,"num_read_kb":257,"num_write":413,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365864,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575960,"statfs":{"total":1151940427776,"available":1151565783040,"internally_reserved":0,"allocated":12754944,"data_stored":7044105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47189,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":171,"num_read_kb":148,"num_write":80,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002912"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685229+0000","last_change":"2024-09-15T22:09:56.697241+0000","last_active":"2024-09-15T22:09:58.685229+0000","last_peered":"2024-09-15T22:09:58.685229+0000","last_clean":"2024-09-15T22:09:58.685229+0000","last_became_active":"2024-09-15T22:09:56.696904+0000","last_became_peered":"2024-09-15T22:09:56.696904+0000","last_unstale":"2024-09-15T22:09:58.685229+0000","last_undegraded":"2024-09-15T22:09:58.685229+0000","last_fullsized":"2024-09-15T22:09:58.685229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.950386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696218+0000","last_change":"2024-09-15T22:09:56.693450+0000","last_active":"2024-09-15T22:09:58.696218+0000","last_peered":"2024-09-15T22:09:58.696218+0000","last_clean":"2024-09-15T22:09:58.696218+0000","last_became_active":"2024-09-15T22:09:56.693140+0000","last_became_peered":"2024-09-15T22:09:56.693140+0000","last_unstale":"2024-09-15T22:09:58.696218+0000","last_undegraded":"2024-09-15T22:09:58.696218+0000","last_fullsized":"2024-09-15T22:09:58.696218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.664485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696028+0000","last_change":"2024-09-15T22:09:56.692816+0000","last_active":"2024-09-15T22:09:58.696028+0000","last_peered":"2024-09-15T22:09:58.696028+0000","last_clean":"2024-09-15T22:09:58.696028+0000","last_became_active":"2024-09-15T22:09:56.692367+0000","last_became_peered":"2024-09-15T22:09:56.692367+0000","last_unstale":"2024-09-15T22:09:58.696028+0000","last_undegraded":"2024-09-15T22:09:58.696028+0000","last_fullsized":"2024-09-15T22:09:58.696028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:36.412415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696279+0000","last_change":"2024-09-15T22:09:56.704312+0000","last_active":"2024-09-15T22:09:58.696279+0000","last_peered":"2024-09-15T22:09:58.696279+0000","last_clean":"2024-09-15T22:09:58.696279+0000","last_became_active":"2024-09-15T22:09:56.703976+0000","last_became_peered":"2024-09-15T22:09:56.703976+0000","last_unstale":"2024-09-15T22:09:58.696279+0000","last_undegraded":"2024-09-15T22:09:58.696279+0000","last_fullsized":"2024-09-15T22:09:58.696279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:59.911956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.690966+0000","last_change":"2024-09-15T22:09:56.697278+0000","last_active":"2024-09-15T22:09:58.690966+0000","last_peered":"2024-09-15T22:09:58.690966+0000","last_clean":"2024-09-15T22:09:58.690966+0000","last_became_active":"2024-09-15T22:09:56.696971+0000","last_became_peered":"2024-09-15T22:09:56.696971+0000","last_unstale":"2024-09-15T22:09:58.690966+0000","last_undegraded":"2024-09-15T22:09:58.690966+0000","last_fullsized":"2024-09-15T22:09:58.690966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:49.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685327+0000","last_change":"2024-09-15T22:09:56.701215+0000","last_active":"2024-09-15T22:09:58.685327+0000","last_peered":"2024-09-15T22:09:58.685327+0000","last_clean":"2024-09-15T22:09:58.685327+0000","last_became_active":"2024-09-15T22:09:56.695891+0000","last_became_peered":"2024-09-15T22:09:56.695891+0000","last_unstale":"2024-09-15T22:09:58.685327+0000","last_undegraded":"2024-09-15T22:09:58.685327+0000","last_fullsized":"2024-09-15T22:09:58.685327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:02.065909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695128+0000","last_change":"2024-09-15T22:09:56.697684+0000","last_active":"2024-09-15T22:09:58.695128+0000","last_peered":"2024-09-15T22:09:58.695128+0000","last_clean":"2024-09-15T22:09:58.695128+0000","last_became_active":"2024-09-15T22:09:56.697360+0000","last_became_peered":"2024-09-15T22:09:56.697360+0000","last_unstale":"2024-09-15T22:09:58.695128+0000","last_undegraded":"2024-09-15T22:09:58.695128+0000","last_fullsized":"2024-09-15T22:09:58.695128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:04.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692369+0000","last_change":"2024-09-15T22:09:56.700712+0000","last_active":"2024-09-15T22:09:58.692369+0000","last_peered":"2024-09-15T22:09:58.692369+0000","last_clean":"2024-09-15T22:09:58.692369+0000","last_became_active":"2024-09-15T22:09:56.700379+0000","last_became_peered":"2024-09-15T22:09:56.700379+0000","last_unstale":"2024-09-15T22:09:58.692369+0000","last_undegraded":"2024-09-15T22:09:58.692369+0000","last_fullsized":"2024-09-15T22:09:58.692369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:28.701496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692017+0000","last_change":"2024-09-15T22:09:56.688316+0000","last_active":"2024-09-15T22:09:58.692017+0000","last_peered":"2024-09-15T22:09:58.692017+0000","last_clean":"2024-09-15T22:09:58.692017+0000","last_became_active":"2024-09-15T22:09:56.687958+0000","last_became_peered":"2024-09-15T22:09:56.687958+0000","last_unstale":"2024-09-15T22:09:58.692017+0000","last_undegraded":"2024-09-15T22:09:58.692017+0000","last_fullsized":"2024-09-15T22:09:58.692017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:37.710002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685506+0000","last_change":"2024-09-15T22:09:56.700740+0000","last_active":"2024-09-15T22:09:58.685506+0000","last_peered":"2024-09-15T22:09:58.685506+0000","last_clean":"2024-09-15T22:09:58.685506+0000","last_became_active":"2024-09-15T22:09:56.700367+0000","last_became_peered":"2024-09-15T22:09:56.700367+0000","last_unstale":"2024-09-15T22:09:58.685506+0000","last_undegraded":"2024-09-15T22:09:58.685506+0000","last_fullsized":"2024-09-15T22:09:58.685506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:39.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695676+0000","last_change":"2024-09-15T22:09:56.693630+0000","last_active":"2024-09-15T22:09:58.695676+0000","last_peered":"2024-09-15T22:09:58.695676+0000","last_clean":"2024-09-15T22:09:58.695676+0000","last_became_active":"2024-09-15T22:09:56.693341+0000","last_became_peered":"2024-09-15T22:09:56.693341+0000","last_unstale":"2024-09-15T22:09:58.695676+0000","last_undegraded":"2024-09-15T22:09:58.695676+0000","last_fullsized":"2024-09-15T22:09:58.695676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:13.738884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696458+0000","last_change":"2024-09-15T22:09:56.704364+0000","last_active":"2024-09-15T22:09:58.696458+0000","last_peered":"2024-09-15T22:09:58.696458+0000","last_clean":"2024-09-15T22:09:58.696458+0000","last_became_active":"2024-09-15T22:09:56.703807+0000","last_became_peered":"2024-09-15T22:09:56.703807+0000","last_unstale":"2024-09-15T22:09:58.696458+0000","last_undegraded":"2024-09-15T22:09:58.696458+0000","last_fullsized":"2024-09-15T22:09:58.696458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:11.054261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684526+0000","last_change":"2024-09-15T22:09:56.698001+0000","last_active":"2024-09-15T22:09:58.684526+0000","last_peered":"2024-09-15T22:09:58.684526+0000","last_clean":"2024-09-15T22:09:58.684526+0000","last_became_active":"2024-09-15T22:09:56.696188+0000","last_became_peered":"2024-09-15T22:09:56.696188+0000","last_unstale":"2024-09-15T22:09:58.684526+0000","last_undegraded":"2024-09-15T22:09:58.684526+0000","last_fullsized":"2024-09-15T22:09:58.684526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:00.113552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695795+0000","last_change":"2024-09-15T22:09:56.693422+0000","last_active":"2024-09-15T22:09:58.695795+0000","last_peered":"2024-09-15T22:09:58.695795+0000","last_clean":"2024-09-15T22:09:58.695795+0000","last_became_active":"2024-09-15T22:09:56.693041+0000","last_became_peered":"2024-09-15T22:09:56.693041+0000","last_unstale":"2024-09-15T22:09:58.695795+0000","last_undegraded":"2024-09-15T22:09:58.695795+0000","last_fullsized":"2024-09-15T22:09:58.695795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:57.145008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696108+0000","last_change":"2024-09-15T22:09:56.704449+0000","last_active":"2024-09-15T22:09:58.696108+0000","last_peered":"2024-09-15T22:09:58.696108+0000","last_clean":"2024-09-15T22:09:58.696108+0000","last_became_active":"2024-09-15T22:09:56.704021+0000","last_became_peered":"2024-09-15T22:09:56.704021+0000","last_unstale":"2024-09-15T22:09:58.696108+0000","last_undegraded":"2024-09-15T22:09:58.696108+0000","last_fullsized":"2024-09-15T22:09:58.696108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:56.149392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691078+0000","last_change":"2024-09-15T22:09:56.693385+0000","last_active":"2024-09-15T22:09:58.691078+0000","last_peered":"2024-09-15T22:09:58.691078+0000","last_clean":"2024-09-15T22:09:58.691078+0000","last_became_active":"2024-09-15T22:09:56.692744+0000","last_became_peered":"2024-09-15T22:09:56.692744+0000","last_unstale":"2024-09-15T22:09:58.691078+0000","last_undegraded":"2024-09-15T22:09:58.691078+0000","last_fullsized":"2024-09-15T22:09:58.691078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:38.996962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685230+0000","last_change":"2024-09-15T22:09:56.695902+0000","last_active":"2024-09-15T22:09:58.685230+0000","last_peered":"2024-09-15T22:09:58.685230+0000","last_clean":"2024-09-15T22:09:58.685230+0000","last_became_active":"2024-09-15T22:09:56.695534+0000","last_became_peered":"2024-09-15T22:09:56.695534+0000","last_unstale":"2024-09-15T22:09:58.685230+0000","last_undegraded":"2024-09-15T22:09:58.685230+0000","last_fullsized":"2024-09-15T22:09:58.685230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:47.052196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697890+0000","last_change":"2024-09-15T22:09:56.695057+0000","last_active":"2024-09-15T22:09:58.697890+0000","last_peered":"2024-09-15T22:09:58.697890+0000","last_clean":"2024-09-15T22:09:58.697890+0000","last_became_active":"2024-09-15T22:09:56.694577+0000","last_became_peered":"2024-09-15T22:09:56.694577+0000","last_unstale":"2024-09-15T22:09:58.697890+0000","last_undegraded":"2024-09-15T22:09:58.697890+0000","last_fullsized":"2024-09-15T22:09:58.697890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:34.572928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694217+0000","last_change":"2024-09-15T22:09:56.698918+0000","last_active":"2024-09-15T22:09:58.694217+0000","last_peered":"2024-09-15T22:09:58.694217+0000","last_clean":"2024-09-15T22:09:58.694217+0000","last_became_active":"2024-09-15T22:09:56.698600+0000","last_became_peered":"2024-09-15T22:09:56.698600+0000","last_unstale":"2024-09-15T22:09:58.694217+0000","last_undegraded":"2024-09-15T22:09:58.694217+0000","last_fullsized":"2024-09-15T22:09:58.694217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:41.350724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684891+0000","last_change":"2024-09-15T22:09:56.700272+0000","last_active":"2024-09-15T22:09:58.684891+0000","last_peered":"2024-09-15T22:09:58.684891+0000","last_clean":"2024-09-15T22:09:58.684891+0000","last_became_active":"2024-09-15T22:09:56.699928+0000","last_became_peered":"2024-09-15T22:09:56.699928+0000","last_unstale":"2024-09-15T22:09:58.684891+0000","last_undegraded":"2024-09-15T22:09:58.684891+0000","last_fullsized":"2024-09-15T22:09:58.684891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:47.697158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684604+0000","last_change":"2024-09-15T22:09:56.698638+0000","last_active":"2024-09-15T22:09:58.684604+0000","last_peered":"2024-09-15T22:09:58.684604+0000","last_clean":"2024-09-15T22:09:58.684604+0000","last_became_active":"2024-09-15T22:09:56.696666+0000","last_became_peered":"2024-09-15T22:09:56.696666+0000","last_unstale":"2024-09-15T22:09:58.684604+0000","last_undegraded":"2024-09-15T22:09:58.684604+0000","last_fullsized":"2024-09-15T22:09:58.684604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:55.272401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691989+0000","last_change":"2024-09-15T22:09:56.696020+0000","last_active":"2024-09-15T22:09:58.691989+0000","last_peered":"2024-09-15T22:09:58.691989+0000","last_clean":"2024-09-15T22:09:58.691989+0000","last_became_active":"2024-09-15T22:09:56.695648+0000","last_became_peered":"2024-09-15T22:09:56.695648+0000","last_unstale":"2024-09-15T22:09:58.691989+0000","last_undegraded":"2024-09-15T22:09:58.691989+0000","last_fullsized":"2024-09-15T22:09:58.691989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:12.413993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692399+0000","last_change":"2024-09-15T22:09:56.695593+0000","last_active":"2024-09-15T22:09:58.692399+0000","last_peered":"2024-09-15T22:09:58.692399+0000","last_clean":"2024-09-15T22:09:58.692399+0000","last_became_active":"2024-09-15T22:09:56.695227+0000","last_became_peered":"2024-09-15T22:09:56.695227+0000","last_unstale":"2024-09-15T22:09:58.692399+0000","last_undegraded":"2024-09-15T22:09:58.692399+0000","last_fullsized":"2024-09-15T22:09:58.692399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:08.685355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.699532+0000","last_change":"2024-09-15T22:09:56.695680+0000","last_active":"2024-09-15T22:09:58.699532+0000","last_peered":"2024-09-15T22:09:58.699532+0000","last_clean":"2024-09-15T22:09:58.699532+0000","last_became_active":"2024-09-15T22:09:56.695247+0000","last_became_peered":"2024-09-15T22:09:56.695247+0000","last_unstale":"2024-09-15T22:09:58.699532+0000","last_undegraded":"2024-09-15T22:09:58.699532+0000","last_fullsized":"2024-09-15T22:09:58.699532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:24.888251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693217+0000","last_change":"2024-09-15T22:09:56.708370+0000","last_active":"2024-09-15T22:09:58.693217+0000","last_peered":"2024-09-15T22:09:58.693217+0000","last_clean":"2024-09-15T22:09:58.693217+0000","last_became_active":"2024-09-15T22:09:56.707971+0000","last_became_peered":"2024-09-15T22:09:56.707971+0000","last_unstale":"2024-09-15T22:09:58.693217+0000","last_undegraded":"2024-09-15T22:09:58.693217+0000","last_fullsized":"2024-09-15T22:09:58.693217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:54.066532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694518+0000","last_change":"2024-09-15T22:09:56.690437+0000","last_active":"2024-09-15T22:09:58.694518+0000","last_peered":"2024-09-15T22:09:58.694518+0000","last_clean":"2024-09-15T22:09:58.694518+0000","last_became_active":"2024-09-15T22:09:56.690063+0000","last_became_peered":"2024-09-15T22:09:56.690063+0000","last_unstale":"2024-09-15T22:09:58.694518+0000","last_undegraded":"2024-09-15T22:09:58.694518+0000","last_fullsized":"2024-09-15T22:09:58.694518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:58.488119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684983+0000","last_change":"2024-09-15T22:09:56.692654+0000","last_active":"2024-09-15T22:09:58.684983+0000","last_peered":"2024-09-15T22:09:58.684983+0000","last_clean":"2024-09-15T22:09:58.684983+0000","last_became_active":"2024-09-15T22:09:56.692096+0000","last_became_peered":"2024-09-15T22:09:56.692096+0000","last_unstale":"2024-09-15T22:09:58.684983+0000","last_undegraded":"2024-09-15T22:09:58.684983+0000","last_fullsized":"2024-09-15T22:09:58.684983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:40.104024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684511+0000","last_change":"2024-09-15T22:09:56.705271+0000","last_active":"2024-09-15T22:09:58.684511+0000","last_peered":"2024-09-15T22:09:58.684511+0000","last_clean":"2024-09-15T22:09:58.684511+0000","last_became_active":"2024-09-15T22:09:56.703538+0000","last_became_peered":"2024-09-15T22:09:56.703538+0000","last_unstale":"2024-09-15T22:09:58.684511+0000","last_undegraded":"2024-09-15T22:09:58.684511+0000","last_fullsized":"2024-09-15T22:09:58.684511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:50.517516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696063+0000","last_change":"2024-09-15T22:09:56.706134+0000","last_active":"2024-09-15T22:09:58.696063+0000","last_peered":"2024-09-15T22:09:58.696063+0000","last_clean":"2024-09-15T22:09:58.696063+0000","last_became_active":"2024-09-15T22:09:56.705699+0000","last_became_peered":"2024-09-15T22:09:56.705699+0000","last_unstale":"2024-09-15T22:09:58.696063+0000","last_undegraded":"2024-09-15T22:09:58.696063+0000","last_fullsized":"2024-09-15T22:09:58.696063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:12:29.296607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694310+0000","last_change":"2024-09-15T22:09:56.698023+0000","last_active":"2024-09-15T22:09:58.694310+0000","last_peered":"2024-09-15T22:09:58.694310+0000","last_clean":"2024-09-15T22:09:58.694310+0000","last_became_active":"2024-09-15T22:09:56.697664+0000","last_became_peered":"2024-09-15T22:09:56.697664+0000","last_unstale":"2024-09-15T22:09:58.694310+0000","last_undegraded":"2024-09-15T22:09:58.694310+0000","last_fullsized":"2024-09-15T22:09:58.694310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:47.387380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693998+0000","last_change":"2024-09-15T22:09:56.702073+0000","last_active":"2024-09-15T22:09:58.693998+0000","last_peered":"2024-09-15T22:09:58.693998+0000","last_clean":"2024-09-15T22:09:58.693998+0000","last_became_active":"2024-09-15T22:09:56.701663+0000","last_became_peered":"2024-09-15T22:09:56.701663+0000","last_unstale":"2024-09-15T22:09:58.693998+0000","last_undegraded":"2024-09-15T22:09:58.693998+0000","last_fullsized":"2024-09-15T22:09:58.693998+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:20.095392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684796+0000","last_change":"2024-09-15T22:09:56.692430+0000","last_active":"2024-09-15T22:09:58.684796+0000","last_peered":"2024-09-15T22:09:58.684796+0000","last_clean":"2024-09-15T22:09:58.684796+0000","last_became_active":"2024-09-15T22:09:56.692068+0000","last_became_peered":"2024-09-15T22:09:56.692068+0000","last_unstale":"2024-09-15T22:09:58.684796+0000","last_undegraded":"2024-09-15T22:09:58.684796+0000","last_fullsized":"2024-09-15T22:09:58.684796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.694497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691440+0000","last_change":"2024-09-15T22:09:56.690234+0000","last_active":"2024-09-15T22:09:58.691440+0000","last_peered":"2024-09-15T22:09:58.691440+0000","last_clean":"2024-09-15T22:09:58.691440+0000","last_became_active":"2024-09-15T22:09:56.689845+0000","last_became_peered":"2024-09-15T22:09:56.689845+0000","last_unstale":"2024-09-15T22:09:58.691440+0000","last_undegraded":"2024-09-15T22:09:58.691440+0000","last_fullsized":"2024-09-15T22:09:58.691440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:32.997578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:18.811259+0000","last_change":"2024-09-15T22:09:54.219344+0000","last_active":"2024-09-15T22:10:18.811259+0000","last_peered":"2024-09-15T22:10:18.811259+0000","last_clean":"2024-09-15T22:10:18.811259+0000","last_became_active":"2024-09-15T22:09:54.218592+0000","last_became_peered":"2024-09-15T22:09:54.218592+0000","last_unstale":"2024-09-15T22:10:18.811259+0000","last_undegraded":"2024-09-15T22:10:18.811259+0000","last_fullsized":"2024-09-15T22:10:18.811259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:44.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697629+0000","last_change":"2024-09-15T22:09:56.703045+0000","last_active":"2024-09-15T22:09:58.697629+0000","last_peered":"2024-09-15T22:09:58.697629+0000","last_clean":"2024-09-15T22:09:58.697629+0000","last_became_active":"2024-09-15T22:09:56.702724+0000","last_became_peered":"2024-09-15T22:09:56.702724+0000","last_unstale":"2024-09-15T22:09:58.697629+0000","last_undegraded":"2024-09-15T22:09:58.697629+0000","last_fullsized":"2024-09-15T22:09:58.697629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.440559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:08.774883+0000","last_change":"2024-09-15T22:09:54.217545+0000","last_active":"2024-09-15T22:10:08.774883+0000","last_peered":"2024-09-15T22:10:08.774883+0000","last_clean":"2024-09-15T22:10:08.774883+0000","last_became_active":"2024-09-15T22:09:54.217158+0000","last_became_peered":"2024-09-15T22:09:54.217158+0000","last_unstale":"2024-09-15T22:10:08.774883+0000","last_undegraded":"2024-09-15T22:10:08.774883+0000","last_fullsized":"2024-09-15T22:10:08.774883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:36.024194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:07.764174+0000","last_change":"2024-09-15T22:09:54.214589+0000","last_active":"2024-09-15T22:10:07.764174+0000","last_peered":"2024-09-15T22:10:07.764174+0000","last_clean":"2024-09-15T22:10:07.764174+0000","last_became_active":"2024-09-15T22:09:54.214115+0000","last_became_peered":"2024-09-15T22:09:54.214115+0000","last_unstale":"2024-09-15T22:10:07.764174+0000","last_undegraded":"2024-09-15T22:10:07.764174+0000","last_fullsized":"2024-09-15T22:10:07.764174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:05.452310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692442+0000","last_change":"2024-09-15T22:09:56.700414+0000","last_active":"2024-09-15T22:09:58.692442+0000","last_peered":"2024-09-15T22:09:58.692442+0000","last_clean":"2024-09-15T22:09:58.692442+0000","last_became_active":"2024-09-15T22:09:56.700041+0000","last_became_peered":"2024-09-15T22:09:56.700041+0000","last_unstale":"2024-09-15T22:09:58.692442+0000","last_undegraded":"2024-09-15T22:09:58.692442+0000","last_fullsized":"2024-09-15T22:09:58.692442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:08.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790184+0000","last_change":"2024-09-15T22:09:54.219547+0000","last_active":"2024-09-15T22:10:09.790184+0000","last_peered":"2024-09-15T22:10:09.790184+0000","last_clean":"2024-09-15T22:10:09.790184+0000","last_became_active":"2024-09-15T22:09:54.218554+0000","last_became_peered":"2024-09-15T22:09:54.218554+0000","last_unstale":"2024-09-15T22:10:09.790184+0000","last_undegraded":"2024-09-15T22:10:09.790184+0000","last_fullsized":"2024-09-15T22:10:09.790184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:09.478853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697019+0000","last_change":"2024-09-15T22:09:56.694749+0000","last_active":"2024-09-15T22:09:58.697019+0000","last_peered":"2024-09-15T22:09:58.697019+0000","last_clean":"2024-09-15T22:09:58.697019+0000","last_became_active":"2024-09-15T22:09:56.694450+0000","last_became_peered":"2024-09-15T22:09:56.694450+0000","last_unstale":"2024-09-15T22:09:58.697019+0000","last_undegraded":"2024-09-15T22:09:58.697019+0000","last_fullsized":"2024-09-15T22:09:58.697019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:39:19.565705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:23.817860+0000","last_change":"2024-09-15T22:09:54.220137+0000","last_active":"2024-09-15T22:10:23.817860+0000","last_peered":"2024-09-15T22:10:23.817860+0000","last_clean":"2024-09-15T22:10:23.817860+0000","last_became_active":"2024-09-15T22:09:54.219738+0000","last_became_peered":"2024-09-15T22:09:54.219738+0000","last_unstale":"2024-09-15T22:10:23.817860+0000","last_undegraded":"2024-09-15T22:10:23.817860+0000","last_fullsized":"2024-09-15T22:10:23.817860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:56.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691657+0000","last_change":"2024-09-15T22:09:56.694869+0000","last_active":"2024-09-15T22:09:58.691657+0000","last_peered":"2024-09-15T22:09:58.691657+0000","last_clean":"2024-09-15T22:09:58.691657+0000","last_became_active":"2024-09-15T22:09:56.694522+0000","last_became_peered":"2024-09-15T22:09:56.694522+0000","last_unstale":"2024-09-15T22:09:58.691657+0000","last_undegraded":"2024-09-15T22:09:58.691657+0000","last_fullsized":"2024-09-15T22:09:58.691657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:33.633471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.787286+0000","last_change":"2024-09-15T22:09:54.218828+0000","last_active":"2024-09-15T22:10:09.787286+0000","last_peered":"2024-09-15T22:10:09.787286+0000","last_clean":"2024-09-15T22:10:09.787286+0000","last_became_active":"2024-09-15T22:09:54.218321+0000","last_became_peered":"2024-09-15T22:09:54.218321+0000","last_unstale":"2024-09-15T22:10:09.787286+0000","last_undegraded":"2024-09-15T22:10:09.787286+0000","last_fullsized":"2024-09-15T22:10:09.787286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:35.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696874+0000","last_change":"2024-09-15T22:09:56.706449+0000","last_active":"2024-09-15T22:09:58.696874+0000","last_peered":"2024-09-15T22:09:58.696874+0000","last_clean":"2024-09-15T22:09:58.696874+0000","last_became_active":"2024-09-15T22:09:56.705380+0000","last_became_peered":"2024-09-15T22:09:56.705380+0000","last_unstale":"2024-09-15T22:09:58.696874+0000","last_undegraded":"2024-09-15T22:09:58.696874+0000","last_fullsized":"2024-09-15T22:09:58.696874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:24.422911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:08.773814+0000","last_change":"2024-09-15T22:09:54.478189+0000","last_active":"2024-09-15T22:10:08.773814+0000","last_peered":"2024-09-15T22:10:08.773814+0000","last_clean":"2024-09-15T22:10:08.773814+0000","last_became_active":"2024-09-15T22:09:54.477846+0000","last_became_peered":"2024-09-15T22:09:54.477846+0000","last_unstale":"2024-09-15T22:10:08.773814+0000","last_undegraded":"2024-09-15T22:10:08.773814+0000","last_fullsized":"2024-09-15T22:10:08.773814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:00.944061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691980+0000","last_change":"2024-09-15T22:09:56.698547+0000","last_active":"2024-09-15T22:09:58.691980+0000","last_peered":"2024-09-15T22:09:58.691980+0000","last_clean":"2024-09-15T22:09:58.691980+0000","last_became_active":"2024-09-15T22:09:56.698144+0000","last_became_peered":"2024-09-15T22:09:56.698144+0000","last_unstale":"2024-09-15T22:09:58.691980+0000","last_undegraded":"2024-09-15T22:09:58.691980+0000","last_fullsized":"2024-09-15T22:09:58.691980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:57.388293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:23.820796+0000","last_change":"2024-09-15T22:09:54.216447+0000","last_active":"2024-09-15T22:10:23.820796+0000","last_peered":"2024-09-15T22:10:23.820796+0000","last_clean":"2024-09-15T22:10:23.820796+0000","last_became_active":"2024-09-15T22:09:54.216102+0000","last_became_peered":"2024-09-15T22:09:54.216102+0000","last_unstale":"2024-09-15T22:10:23.820796+0000","last_undegraded":"2024-09-15T22:10:23.820796+0000","last_fullsized":"2024-09-15T22:10:23.820796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:55.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691162+0000","last_change":"2024-09-15T22:09:56.694011+0000","last_active":"2024-09-15T22:09:58.691162+0000","last_peered":"2024-09-15T22:09:58.691162+0000","last_clean":"2024-09-15T22:09:58.691162+0000","last_became_active":"2024-09-15T22:09:56.693447+0000","last_became_peered":"2024-09-15T22:09:56.693447+0000","last_unstale":"2024-09-15T22:09:58.691162+0000","last_undegraded":"2024-09-15T22:09:58.691162+0000","last_fullsized":"2024-09-15T22:09:58.691162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:10.797740+0000","last_change":"2024-09-15T22:09:54.221406+0000","last_active":"2024-09-15T22:10:10.797740+0000","last_peered":"2024-09-15T22:10:10.797740+0000","last_clean":"2024-09-15T22:10:10.797740+0000","last_became_active":"2024-09-15T22:09:54.220752+0000","last_became_peered":"2024-09-15T22:09:54.220752+0000","last_unstale":"2024-09-15T22:10:10.797740+0000","last_undegraded":"2024-09-15T22:10:10.797740+0000","last_fullsized":"2024-09-15T22:10:10.797740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.198214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684421+0000","last_change":"2024-09-15T22:09:56.697991+0000","last_active":"2024-09-15T22:09:58.684421+0000","last_peered":"2024-09-15T22:09:58.684421+0000","last_clean":"2024-09-15T22:09:58.684421+0000","last_became_active":"2024-09-15T22:09:56.695867+0000","last_became_peered":"2024-09-15T22:09:56.695867+0000","last_unstale":"2024-09-15T22:09:58.684421+0000","last_undegraded":"2024-09-15T22:09:58.684421+0000","last_fullsized":"2024-09-15T22:09:58.684421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:05.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790771+0000","last_change":"2024-09-15T22:09:54.219276+0000","last_active":"2024-09-15T22:10:09.790771+0000","last_peered":"2024-09-15T22:10:09.790771+0000","last_clean":"2024-09-15T22:10:09.790771+0000","last_became_active":"2024-09-15T22:09:54.218940+0000","last_became_peered":"2024-09-15T22:09:54.218940+0000","last_unstale":"2024-09-15T22:10:09.790771+0000","last_undegraded":"2024-09-15T22:10:09.790771+0000","last_fullsized":"2024-09-15T22:10:09.790771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:38.511671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696670+0000","last_change":"2024-09-15T22:09:56.703202+0000","last_active":"2024-09-15T22:09:58.696670+0000","last_peered":"2024-09-15T22:09:58.696670+0000","last_clean":"2024-09-15T22:09:58.696670+0000","last_became_active":"2024-09-15T22:09:56.702871+0000","last_became_peered":"2024-09-15T22:09:56.702871+0000","last_unstale":"2024-09-15T22:09:58.696670+0000","last_undegraded":"2024-09-15T22:09:58.696670+0000","last_fullsized":"2024-09-15T22:09:58.696670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:08.404847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:22.816452+0000","last_change":"2024-09-15T22:09:54.219948+0000","last_active":"2024-09-15T22:10:22.816452+0000","last_peered":"2024-09-15T22:10:22.816452+0000","last_clean":"2024-09-15T22:10:22.816452+0000","last_became_active":"2024-09-15T22:09:54.219603+0000","last_became_peered":"2024-09-15T22:09:54.219603+0000","last_unstale":"2024-09-15T22:10:22.816452+0000","last_undegraded":"2024-09-15T22:10:22.816452+0000","last_fullsized":"2024-09-15T22:10:22.816452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:07.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695480+0000","last_change":"2024-09-15T22:09:56.698203+0000","last_active":"2024-09-15T22:09:58.695480+0000","last_peered":"2024-09-15T22:09:58.695480+0000","last_clean":"2024-09-15T22:09:58.695480+0000","last_became_active":"2024-09-15T22:09:56.697882+0000","last_became_peered":"2024-09-15T22:09:56.697882+0000","last_unstale":"2024-09-15T22:09:58.695480+0000","last_undegraded":"2024-09-15T22:09:58.695480+0000","last_fullsized":"2024-09-15T22:09:58.695480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:29.865810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.789250+0000","last_change":"2024-09-15T22:09:54.477287+0000","last_active":"2024-09-15T22:10:09.789250+0000","last_peered":"2024-09-15T22:10:09.789250+0000","last_clean":"2024-09-15T22:10:09.789250+0000","last_became_active":"2024-09-15T22:09:54.476895+0000","last_became_peered":"2024-09-15T22:09:54.476895+0000","last_unstale":"2024-09-15T22:10:09.789250+0000","last_undegraded":"2024-09-15T22:10:09.789250+0000","last_fullsized":"2024-09-15T22:10:09.789250+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:22.940445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694993+0000","last_change":"2024-09-15T22:09:56.703388+0000","last_active":"2024-09-15T22:09:58.694993+0000","last_peered":"2024-09-15T22:09:58.694993+0000","last_clean":"2024-09-15T22:09:58.694993+0000","last_became_active":"2024-09-15T22:09:56.703053+0000","last_became_peered":"2024-09-15T22:09:56.703053+0000","last_unstale":"2024-09-15T22:09:58.694993+0000","last_undegraded":"2024-09-15T22:09:58.694993+0000","last_fullsized":"2024-09-15T22:09:58.694993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:22.700159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.757526+0000","last_change":"2024-09-15T22:09:54.217269+0000","last_active":"2024-09-15T22:10:09.757526+0000","last_peered":"2024-09-15T22:10:09.757526+0000","last_clean":"2024-09-15T22:10:09.757526+0000","last_became_active":"2024-09-15T22:09:54.216887+0000","last_became_peered":"2024-09-15T22:09:54.216887+0000","last_unstale":"2024-09-15T22:10:09.757526+0000","last_undegraded":"2024-09-15T22:10:09.757526+0000","last_fullsized":"2024-09-15T22:10:09.757526+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:35.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685085+0000","last_change":"2024-09-15T22:09:56.696293+0000","last_active":"2024-09-15T22:09:58.685085+0000","last_peered":"2024-09-15T22:09:58.685085+0000","last_clean":"2024-09-15T22:09:58.685085+0000","last_became_active":"2024-09-15T22:09:56.695954+0000","last_became_peered":"2024-09-15T22:09:56.695954+0000","last_unstale":"2024-09-15T22:09:58.685085+0000","last_undegraded":"2024-09-15T22:09:58.685085+0000","last_fullsized":"2024-09-15T22:09:58.685085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:23.933813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790669+0000","last_change":"2024-09-15T22:09:54.219608+0000","last_active":"2024-09-15T22:10:09.790669+0000","last_peered":"2024-09-15T22:10:09.790669+0000","last_clean":"2024-09-15T22:10:09.790669+0000","last_became_active":"2024-09-15T22:09:54.218700+0000","last_became_peered":"2024-09-15T22:09:54.218700+0000","last_unstale":"2024-09-15T22:10:09.790669+0000","last_undegraded":"2024-09-15T22:10:09.790669+0000","last_fullsized":"2024-09-15T22:10:09.790669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:55.941217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696365+0000","last_change":"2024-09-15T22:09:56.693898+0000","last_active":"2024-09-15T22:09:58.696365+0000","last_peered":"2024-09-15T22:09:58.696365+0000","last_clean":"2024-09-15T22:09:58.696365+0000","last_became_active":"2024-09-15T22:09:56.692960+0000","last_became_peered":"2024-09-15T22:09:56.692960+0000","last_unstale":"2024-09-15T22:09:58.696365+0000","last_undegraded":"2024-09-15T22:09:58.696365+0000","last_fullsized":"2024-09-15T22:09:58.696365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:50.150574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790753+0000","last_change":"2024-09-15T22:09:54.220757+0000","last_active":"2024-09-15T22:10:09.790753+0000","last_peered":"2024-09-15T22:10:09.790753+0000","last_clean":"2024-09-15T22:10:09.790753+0000","last_became_active":"2024-09-15T22:09:54.220371+0000","last_became_peered":"2024-09-15T22:09:54.220371+0000","last_unstale":"2024-09-15T22:10:09.790753+0000","last_undegraded":"2024-09-15T22:10:09.790753+0000","last_fullsized":"2024-09-15T22:10:09.790753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:07.234474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696139+0000","last_change":"2024-09-15T22:09:56.699810+0000","last_active":"2024-09-15T22:09:58.696139+0000","last_peered":"2024-09-15T22:09:58.696139+0000","last_clean":"2024-09-15T22:09:58.696139+0000","last_became_active":"2024-09-15T22:09:56.699279+0000","last_became_peered":"2024-09-15T22:09:56.699279+0000","last_unstale":"2024-09-15T22:09:58.696139+0000","last_undegraded":"2024-09-15T22:09:58.696139+0000","last_fullsized":"2024-09-15T22:09:58.696139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:42.730032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:22.817261+0000","last_change":"2024-09-15T22:09:55.000482+0000","last_active":"2024-09-15T22:10:22.817261+0000","last_peered":"2024-09-15T22:10:22.817261+0000","last_clean":"2024-09-15T22:10:22.817261+0000","last_became_active":"2024-09-15T22:09:55.000088+0000","last_became_peered":"2024-09-15T22:09:55.000088+0000","last_unstale":"2024-09-15T22:10:22.817261+0000","last_undegraded":"2024-09-15T22:10:22.817261+0000","last_fullsized":"2024-09-15T22:10:22.817261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:48.309582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695844+0000","last_change":"2024-09-15T22:09:56.699129+0000","last_active":"2024-09-15T22:09:58.695844+0000","last_peered":"2024-09-15T22:09:58.695844+0000","last_clean":"2024-09-15T22:09:58.695844+0000","last_became_active":"2024-09-15T22:09:56.698107+0000","last_became_peered":"2024-09-15T22:09:56.698107+0000","last_unstale":"2024-09-15T22:09:58.695844+0000","last_undegraded":"2024-09-15T22:09:58.695844+0000","last_fullsized":"2024-09-15T22:09:58.695844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:35.436908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695808+0000","last_change":"2024-09-15T22:08:41.556517+0000","last_active":"2024-09-15T22:09:58.695808+0000","last_peered":"2024-09-15T22:09:58.695808+0000","last_clean":"2024-09-15T22:09:58.695808+0000","last_became_active":"2024-09-15T22:08:41.555887+0000","last_became_peered":"2024-09-15T22:08:41.555887+0000","last_unstale":"2024-09-15T22:09:58.695808+0000","last_undegraded":"2024-09-15T22:09:58.695808+0000","last_fullsized":"2024-09-15T22:09:58.695808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_clean_scrub_stamp":"2024-09-15T22:05:05.654738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:29.105403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:10.794800+0000","last_change":"2024-09-15T22:09:54.220522+0000","last_active":"2024-09-15T22:10:10.794800+0000","last_peered":"2024-09-15T22:10:10.794800+0000","last_clean":"2024-09-15T22:10:10.794800+0000","last_became_active":"2024-09-15T22:09:54.220174+0000","last_became_peered":"2024-09-15T22:09:54.220174+0000","last_unstale":"2024-09-15T22:10:10.794800+0000","last_undegraded":"2024-09-15T22:10:10.794800+0000","last_fullsized":"2024-09-15T22:10:10.794800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:33.909055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692734+0000","last_change":"2024-09-15T22:09:56.703268+0000","last_active":"2024-09-15T22:09:58.692734+0000","last_peered":"2024-09-15T22:09:58.692734+0000","last_clean":"2024-09-15T22:09:58.692734+0000","last_became_active":"2024-09-15T22:09:56.701096+0000","last_became_peered":"2024-09-15T22:09:56.701096+0000","last_unstale":"2024-09-15T22:09:58.692734+0000","last_undegraded":"2024-09-15T22:09:58.692734+0000","last_fullsized":"2024-09-15T22:09:58.692734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:30.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:07.761101+0000","last_change":"2024-09-15T22:09:54.220913+0000","last_active":"2024-09-15T22:10:07.761101+0000","last_peered":"2024-09-15T22:10:07.761101+0000","last_clean":"2024-09-15T22:10:07.761101+0000","last_became_active":"2024-09-15T22:09:54.220476+0000","last_became_peered":"2024-09-15T22:09:54.220476+0000","last_unstale":"2024-09-15T22:10:07.761101+0000","last_undegraded":"2024-09-15T22:10:07.761101+0000","last_fullsized":"2024-09-15T22:10:07.761101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:27.087931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684211+0000","last_change":"2024-09-15T22:09:56.704428+0000","last_active":"2024-09-15T22:09:58.684211+0000","last_peered":"2024-09-15T22:09:58.684211+0000","last_clean":"2024-09-15T22:09:58.684211+0000","last_became_active":"2024-09-15T22:09:56.703856+0000","last_became_peered":"2024-09-15T22:09:56.703856+0000","last_unstale":"2024-09-15T22:09:58.684211+0000","last_undegraded":"2024-09-15T22:09:58.684211+0000","last_fullsized":"2024-09-15T22:09:58.684211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:56.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:22.815743+0000","last_change":"2024-09-15T22:09:54.476737+0000","last_active":"2024-09-15T22:10:22.815743+0000","last_peered":"2024-09-15T22:10:22.815743+0000","last_clean":"2024-09-15T22:10:22.815743+0000","last_became_active":"2024-09-15T22:09:54.476256+0000","last_became_peered":"2024-09-15T22:09:54.476256+0000","last_unstale":"2024-09-15T22:10:22.815743+0000","last_undegraded":"2024-09-15T22:10:22.815743+0000","last_fullsized":"2024-09-15T22:10:22.815743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:26.775968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.699709+0000","last_change":"2024-09-15T22:09:56.703160+0000","last_active":"2024-09-15T22:09:58.699709+0000","last_peered":"2024-09-15T22:09:58.699709+0000","last_clean":"2024-09-15T22:09:58.699709+0000","last_became_active":"2024-09-15T22:09:56.702822+0000","last_became_peered":"2024-09-15T22:09:56.702822+0000","last_unstale":"2024-09-15T22:09:58.699709+0000","last_undegraded":"2024-09-15T22:09:58.699709+0000","last_fullsized":"2024-09-15T22:09:58.699709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:41.188636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:21.814957+0000","last_change":"2024-09-15T22:09:54.219289+0000","last_active":"2024-09-15T22:10:21.814957+0000","last_peered":"2024-09-15T22:10:21.814957+0000","last_clean":"2024-09-15T22:10:21.814957+0000","last_became_active":"2024-09-15T22:09:54.218572+0000","last_became_peered":"2024-09-15T22:09:54.218572+0000","last_unstale":"2024-09-15T22:10:21.814957+0000","last_undegraded":"2024-09-15T22:10:21.814957+0000","last_fullsized":"2024-09-15T22:10:21.814957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:02.294569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685382+0000","last_change":"2024-09-15T22:09:56.698458+0000","last_active":"2024-09-15T22:09:58.685382+0000","last_peered":"2024-09-15T22:09:58.685382+0000","last_clean":"2024-09-15T22:09:58.685382+0000","last_became_active":"2024-09-15T22:09:56.698135+0000","last_became_peered":"2024-09-15T22:09:56.698135+0000","last_unstale":"2024-09-15T22:09:58.685382+0000","last_undegraded":"2024-09-15T22:09:58.685382+0000","last_fullsized":"2024-09-15T22:09:58.685382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:40.002319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697439+0000","last_change":"2024-09-15T22:09:54.478546+0000","last_active":"2024-09-15T22:09:58.697439+0000","last_peered":"2024-09-15T22:09:58.697439+0000","last_clean":"2024-09-15T22:09:58.697439+0000","last_became_active":"2024-09-15T22:09:54.478106+0000","last_became_peered":"2024-09-15T22:09:54.478106+0000","last_unstale":"2024-09-15T22:09:58.697439+0000","last_undegraded":"2024-09-15T22:09:58.697439+0000","last_fullsized":"2024-09-15T22:09:58.697439+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:57.687752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.941367+0000","last_change":"2024-09-15T22:09:56.697014+0000","last_active":"2024-09-15T22:09:58.941367+0000","last_peered":"2024-09-15T22:09:58.941367+0000","last_clean":"2024-09-15T22:09:58.941367+0000","last_became_active":"2024-09-15T22:09:56.696702+0000","last_became_peered":"2024-09-15T22:09:56.696702+0000","last_unstale":"2024-09-15T22:09:58.941367+0000","last_undegraded":"2024-09-15T22:09:58.941367+0000","last_fullsized":"2024-09-15T22:09:58.941367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:08.687166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.791663+0000","last_change":"2024-09-15T22:09:54.477243+0000","last_active":"2024-09-15T22:10:09.791663+0000","last_peered":"2024-09-15T22:10:09.791663+0000","last_clean":"2024-09-15T22:10:09.791663+0000","last_became_active":"2024-09-15T22:09:54.476879+0000","last_became_peered":"2024-09-15T22:09:54.476879+0000","last_unstale":"2024-09-15T22:10:09.791663+0000","last_undegraded":"2024-09-15T22:10:09.791663+0000","last_fullsized":"2024-09-15T22:10:09.791663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:31.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684547+0000","last_change":"2024-09-15T22:09:56.689341+0000","last_active":"2024-09-15T22:09:58.684547+0000","last_peered":"2024-09-15T22:09:58.684547+0000","last_clean":"2024-09-15T22:09:58.684547+0000","last_became_active":"2024-09-15T22:09:56.688925+0000","last_became_peered":"2024-09-15T22:09:56.688925+0000","last_unstale":"2024-09-15T22:09:58.684547+0000","last_undegraded":"2024-09-15T22:09:58.684547+0000","last_fullsized":"2024-09-15T22:09:58.684547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:20.552548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:19.692470+0000","last_change":"2024-09-15T22:09:54.219690+0000","last_active":"2024-09-15T22:10:19.692470+0000","last_peered":"2024-09-15T22:10:19.692470+0000","last_clean":"2024-09-15T22:10:19.692470+0000","last_became_active":"2024-09-15T22:09:54.218962+0000","last_became_peered":"2024-09-15T22:09:54.218962+0000","last_unstale":"2024-09-15T22:10:19.692470+0000","last_undegraded":"2024-09-15T22:10:19.692470+0000","last_fullsized":"2024-09-15T22:10:19.692470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:44.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693269+0000","last_change":"2024-09-15T22:09:56.702350+0000","last_active":"2024-09-15T22:09:58.693269+0000","last_peered":"2024-09-15T22:09:58.693269+0000","last_clean":"2024-09-15T22:09:58.693269+0000","last_became_active":"2024-09-15T22:09:56.699387+0000","last_became_peered":"2024-09-15T22:09:56.699387+0000","last_unstale":"2024-09-15T22:09:58.693269+0000","last_undegraded":"2024-09-15T22:09:58.693269+0000","last_fullsized":"2024-09-15T22:09:58.693269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:47.005526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.791574+0000","last_change":"2024-09-15T22:09:55.000416+0000","last_active":"2024-09-15T22:10:09.791574+0000","last_peered":"2024-09-15T22:10:09.791574+0000","last_clean":"2024-09-15T22:10:09.791574+0000","last_became_active":"2024-09-15T22:09:55.000108+0000","last_became_peered":"2024-09-15T22:09:55.000108+0000","last_unstale":"2024-09-15T22:10:09.791574+0000","last_undegraded":"2024-09-15T22:10:09.791574+0000","last_fullsized":"2024-09-15T22:10:09.791574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:15.005148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696660+0000","last_change":"2024-09-15T22:09:56.707107+0000","last_active":"2024-09-15T22:09:58.696660+0000","last_peered":"2024-09-15T22:09:58.696660+0000","last_clean":"2024-09-15T22:09:58.696660+0000","last_became_active":"2024-09-15T22:09:56.706442+0000","last_became_peered":"2024-09-15T22:09:56.706442+0000","last_unstale":"2024-09-15T22:09:58.696660+0000","last_undegraded":"2024-09-15T22:09:58.696660+0000","last_fullsized":"2024-09-15T22:09:58.696660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:51.381492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:06.748039+0000","last_change":"2024-09-15T22:09:54.477365+0000","last_active":"2024-09-15T22:10:06.748039+0000","last_peered":"2024-09-15T22:10:06.748039+0000","last_clean":"2024-09-15T22:10:06.748039+0000","last_became_active":"2024-09-15T22:09:54.477033+0000","last_became_peered":"2024-09-15T22:09:54.477033+0000","last_unstale":"2024-09-15T22:10:06.748039+0000","last_undegraded":"2024-09-15T22:10:06.748039+0000","last_fullsized":"2024-09-15T22:10:06.748039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:10.634767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.690901+0000","last_change":"2024-09-15T22:09:56.693547+0000","last_active":"2024-09-15T22:09:58.690901+0000","last_peered":"2024-09-15T22:09:58.690901+0000","last_clean":"2024-09-15T22:09:58.690901+0000","last_became_active":"2024-09-15T22:09:56.692923+0000","last_became_peered":"2024-09-15T22:09:56.692923+0000","last_unstale":"2024-09-15T22:09:58.690901+0000","last_undegraded":"2024-09-15T22:09:58.690901+0000","last_fullsized":"2024-09-15T22:09:58.690901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.462232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790970+0000","last_change":"2024-09-15T22:09:54.221737+0000","last_active":"2024-09-15T22:10:09.790970+0000","last_peered":"2024-09-15T22:10:09.790970+0000","last_clean":"2024-09-15T22:10:09.790970+0000","last_became_active":"2024-09-15T22:09:54.221418+0000","last_became_peered":"2024-09-15T22:09:54.221418+0000","last_unstale":"2024-09-15T22:10:09.790970+0000","last_undegraded":"2024-09-15T22:10:09.790970+0000","last_fullsized":"2024-09-15T22:10:09.790970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:35.636403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685081+0000","last_change":"2024-09-15T22:09:56.690290+0000","last_active":"2024-09-15T22:09:58.685081+0000","last_peered":"2024-09-15T22:09:58.685081+0000","last_clean":"2024-09-15T22:09:58.685081+0000","last_became_active":"2024-09-15T22:09:56.689986+0000","last_became_peered":"2024-09-15T22:09:56.689986+0000","last_unstale":"2024-09-15T22:09:58.685081+0000","last_undegraded":"2024-09-15T22:09:58.685081+0000","last_fullsized":"2024-09-15T22:09:58.685081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:53.860697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:08.774592+0000","last_change":"2024-09-15T22:09:54.219569+0000","last_active":"2024-09-15T22:10:08.774592+0000","last_peered":"2024-09-15T22:10:08.774592+0000","last_clean":"2024-09-15T22:10:08.774592+0000","last_became_active":"2024-09-15T22:09:54.219203+0000","last_became_peered":"2024-09-15T22:09:54.219203+0000","last_unstale":"2024-09-15T22:10:08.774592+0000","last_undegraded":"2024-09-15T22:10:08.774592+0000","last_fullsized":"2024-09-15T22:10:08.774592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:21:02.719849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692929+0000","last_change":"2024-09-15T22:09:56.696608+0000","last_active":"2024-09-15T22:09:58.692929+0000","last_peered":"2024-09-15T22:09:58.692929+0000","last_clean":"2024-09-15T22:09:58.692929+0000","last_became_active":"2024-09-15T22:09:56.696301+0000","last_became_peered":"2024-09-15T22:09:56.696301+0000","last_unstale":"2024-09-15T22:09:58.692929+0000","last_undegraded":"2024-09-15T22:09:58.692929+0000","last_fullsized":"2024-09-15T22:09:58.692929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:48.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:06.747043+0000","last_change":"2024-09-15T22:09:54.218426+0000","last_active":"2024-09-15T22:10:06.747043+0000","last_peered":"2024-09-15T22:10:06.747043+0000","last_clean":"2024-09-15T22:10:06.747043+0000","last_became_active":"2024-09-15T22:09:54.218084+0000","last_became_peered":"2024-09-15T22:09:54.218084+0000","last_unstale":"2024-09-15T22:10:06.747043+0000","last_undegraded":"2024-09-15T22:10:06.747043+0000","last_fullsized":"2024-09-15T22:10:06.747043+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:46.067886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696289+0000","last_change":"2024-09-15T22:09:56.696993+0000","last_active":"2024-09-15T22:09:58.696289+0000","last_peered":"2024-09-15T22:09:58.696289+0000","last_clean":"2024-09-15T22:09:58.696289+0000","last_became_active":"2024-09-15T22:09:56.696532+0000","last_became_peered":"2024-09-15T22:09:56.696532+0000","last_unstale":"2024-09-15T22:09:58.696289+0000","last_undegraded":"2024-09-15T22:09:58.696289+0000","last_fullsized":"2024-09-15T22:09:58.696289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:56.385349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695532+0000","last_change":"2024-09-15T22:09:56.703181+0000","last_active":"2024-09-15T22:09:58.695532+0000","last_peered":"2024-09-15T22:09:58.695532+0000","last_clean":"2024-09-15T22:09:58.695532+0000","last_became_active":"2024-09-15T22:09:56.702816+0000","last_became_peered":"2024-09-15T22:09:56.702816+0000","last_unstale":"2024-09-15T22:09:58.695532+0000","last_undegraded":"2024-09-15T22:09:58.695532+0000","last_fullsized":"2024-09-15T22:09:58.695532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:31.123151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.791161+0000","last_change":"2024-09-15T22:09:54.220621+0000","last_active":"2024-09-15T22:10:09.791161+0000","last_peered":"2024-09-15T22:10:09.791161+0000","last_clean":"2024-09-15T22:10:09.791161+0000","last_became_active":"2024-09-15T22:09:54.220280+0000","last_became_peered":"2024-09-15T22:09:54.220280+0000","last_unstale":"2024-09-15T22:10:09.791161+0000","last_undegraded":"2024-09-15T22:10:09.791161+0000","last_fullsized":"2024-09-15T22:10:09.791161+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:33.037698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691515+0000","last_change":"2024-09-15T22:09:56.693653+0000","last_active":"2024-09-15T22:09:58.691515+0000","last_peered":"2024-09-15T22:09:58.691515+0000","last_clean":"2024-09-15T22:09:58.691515+0000","last_became_active":"2024-09-15T22:09:56.692756+0000","last_became_peered":"2024-09-15T22:09:56.692756+0000","last_unstale":"2024-09-15T22:09:58.691515+0000","last_undegraded":"2024-09-15T22:09:58.691515+0000","last_fullsized":"2024-09-15T22:09:58.691515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:19.607542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:10.797732+0000","last_change":"2024-09-15T22:09:54.218597+0000","last_active":"2024-09-15T22:10:10.797732+0000","last_peered":"2024-09-15T22:10:10.797732+0000","last_clean":"2024-09-15T22:10:10.797732+0000","last_became_active":"2024-09-15T22:09:54.218150+0000","last_became_peered":"2024-09-15T22:09:54.218150+0000","last_unstale":"2024-09-15T22:10:10.797732+0000","last_undegraded":"2024-09-15T22:10:10.797732+0000","last_fullsized":"2024-09-15T22:10:10.797732+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:24.733207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696820+0000","last_change":"2024-09-15T22:09:56.692795+0000","last_active":"2024-09-15T22:09:58.696820+0000","last_peered":"2024-09-15T22:09:58.696820+0000","last_clean":"2024-09-15T22:09:58.696820+0000","last_became_active":"2024-09-15T22:09:56.692425+0000","last_became_peered":"2024-09-15T22:09:56.692425+0000","last_unstale":"2024-09-15T22:09:58.696820+0000","last_undegraded":"2024-09-15T22:09:58.696820+0000","last_fullsized":"2024-09-15T22:09:58.696820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:45.920502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.699366+0000","last_change":"2024-09-15T22:09:54.476726+0000","last_active":"2024-09-15T22:09:58.699366+0000","last_peered":"2024-09-15T22:09:58.699366+0000","last_clean":"2024-09-15T22:09:58.699366+0000","last_became_active":"2024-09-15T22:09:54.476317+0000","last_became_peered":"2024-09-15T22:09:54.476317+0000","last_unstale":"2024-09-15T22:09:58.699366+0000","last_undegraded":"2024-09-15T22:09:58.699366+0000","last_fullsized":"2024-09-15T22:09:58.699366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:48.361958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693281+0000","last_change":"2024-09-15T22:09:56.701501+0000","last_active":"2024-09-15T22:09:58.693281+0000","last_peered":"2024-09-15T22:09:58.693281+0000","last_clean":"2024-09-15T22:09:58.693281+0000","last_became_active":"2024-09-15T22:09:56.701166+0000","last_became_peered":"2024-09-15T22:09:56.701166+0000","last_unstale":"2024-09-15T22:09:58.693281+0000","last_undegraded":"2024-09-15T22:09:58.693281+0000","last_fullsized":"2024-09-15T22:09:58.693281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:20.698770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:21.814138+0000","last_change":"2024-09-15T22:09:54.216841+0000","last_active":"2024-09-15T22:10:21.814138+0000","last_peered":"2024-09-15T22:10:21.814138+0000","last_clean":"2024-09-15T22:10:21.814138+0000","last_became_active":"2024-09-15T22:09:54.216458+0000","last_became_peered":"2024-09-15T22:09:54.216458+0000","last_unstale":"2024-09-15T22:10:21.814138+0000","last_undegraded":"2024-09-15T22:10:21.814138+0000","last_fullsized":"2024-09-15T22:10:21.814138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.116014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":171,"num_read_kb":148,"num_write":230,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":168494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612627,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1065370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":427076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":427454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659181,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":426793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888114,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1511424,"data_stored":1019259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":427047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":426618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":474728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607622,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":474508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":428132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:10:26.896 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:10:27.266 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:27.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:27 smithi154 ceph-mon[34853]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:10:27.547 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:27 smithi150 ceph-mon[30886]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:10:27.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:27 smithi169 ceph-mon[35850]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.779+0000 7fc0e7800640 1 -- 172.21.15.150:0/3834212808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0102790 msgr2=0x7fc0e01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.779+0000 7fc0e7800640 1 --2- 172.21.15.150:0/3834212808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0102790 0x7fc0e01067e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009900 tx=0x7fc0cc02a410 comp rx=0 tx=0).stop 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 -- 172.21.15.150:0/3834212808 shutdown_connections 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 --2- 172.21.15.150:0/3834212808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 0x7fc0e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 --2- 172.21.15.150:0/3834212808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0102790 0x7fc0e01067e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 --2- 172.21.15.150:0/3834212808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0101de0 0x7fc0e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 -- 172.21.15.150:0/3834212808 >> 172.21.15.150:0/3834212808 conn(0x7fc0e00fd8c0 msgr2=0x7fc0e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 -- 172.21.15.150:0/3834212808 shutdown_connections 2024-09-15T22:10:27.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.780+0000 7fc0e7800640 1 -- 172.21.15.150:0/3834212808 wait complete. 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 Processor -- start 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 -- start start 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 0x7fc0e0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0102790 0x7fc0e0198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 0x7fc0e019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0111f30 con 0x7fc0e0101de0 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0111db0 con 0x7fc0e0106f10 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e7800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01120b0 con 0x7fc0e0102790 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 0x7fc0e0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:27.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.781+0000 7fc0e4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 0x7fc0e0198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39902/0 (socket says 172.21.15.150:39902) 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 -- 172.21.15.150:0/1855266569 learned_addr learned my addr 172.21.15.150:0/1855266569 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0dfe00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0102790 0x7fc0e0198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e5800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 0x7fc0e019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 -- 172.21.15.150:0/1855266569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0102790 msgr2=0x7fc0e0198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0102790 0x7fc0e0198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 -- 172.21.15.150:0/1855266569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 msgr2=0x7fc0e019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 0x7fc0e019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 -- 172.21.15.150:0/1855266569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e019d400 con 0x7fc0e0101de0 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0dfe00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0102790 0x7fc0e0198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e5800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 0x7fc0e019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.782+0000 7fc0e4e00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 0x7fc0e0198450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400d950 tx=0x7fc0d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:27.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.783+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4017030 con 0x7fc0e0101de0 2024-09-15T22:10:27.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.783+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e019d6f0 con 0x7fc0e0101de0 2024-09-15T22:10:27.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.783+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0d4004020 con 0x7fc0e0101de0 2024-09-15T22:10:27.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.783+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40047a0 con 0x7fc0e0101de0 2024-09-15T22:10:27.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.783+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e01a4fd0 con 0x7fc0e0101de0 2024-09-15T22:10:27.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.784+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e01021c0 con 0x7fc0e0101de0 2024-09-15T22:10:27.787 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.786+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc0d40041d0 con 0x7fc0e0101de0 2024-09-15T22:10:27.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.787+0000 7fc0dd600640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0c80a3350 0x7fc0c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:27.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.787+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc0d40cf2b0 con 0x7fc0e0101de0 2024-09-15T22:10:27.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.787+0000 7fc0dfe00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0c80a3350 0x7fc0c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:27.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.788+0000 7fc0dfe00640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0c80a3350 0x7fc0c80a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009230 tx=0x7fc0cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:27.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.791+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0d409bf20 con 0x7fc0e0101de0 2024-09-15T22:10:27.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.963+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0e0062630 con 0x7fc0c80a3350 2024-09-15T22:10:27.972 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.969+0000 7fc0dd600640 1 -- 172.21.15.150:0/1855266569 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258746 (secure 0 0 0) 0x7fc0e0062630 con 0x7fc0c80a3350 2024-09-15T22:10:27.974 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:27.975 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-15T22:10:27.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0c80a3350 msgr2=0x7fc0c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:27.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0c80a3350 0x7fc0c80a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009230 tx=0x7fc0cc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 msgr2=0x7fc0e0198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 0x7fc0e0198450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400d950 tx=0x7fc0d400de10 comp rx=0 tx=0).stop 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 shutdown_connections 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0e0106f10 0x7fc0e019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0e0102790 0x7fc0e0198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0c80a3350 0x7fc0c80a5810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 --2- 172.21.15.150:0/1855266569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0e0101de0 0x7fc0e0198450 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.973+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 >> 172.21.15.150:0/1855266569 conn(0x7fc0e00fd8c0 msgr2=0x7fc0e00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.974+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 shutdown_connections 2024-09-15T22:10:27.978 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:27.974+0000 7fc0e7800640 1 -- 172.21.15.150:0/1855266569 wait complete. 2024-09-15T22:10:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:28 smithi154 ceph-mon[34853]: pgmap v302: 97 pgs: 97 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-15T22:10:28.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:28 smithi150 ceph-mon[30886]: pgmap v302: 97 pgs: 97 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-15T22:10:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:28 smithi169 ceph-mon[35850]: pgmap v302: 97 pgs: 97 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-09-15T22:10:28.830 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-15T22:10:27.143692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":302,"num_read_kb":257,"num_write":413,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365872,"kb_used_data":12464,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575952,"statfs":{"total":1151940427776,"available":1151565774848,"internally_reserved":0,"allocated":12763136,"data_stored":7051748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":96,"num_write":23,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685229+0000","last_change":"2024-09-15T22:09:56.697241+0000","last_active":"2024-09-15T22:09:58.685229+0000","last_peered":"2024-09-15T22:09:58.685229+0000","last_clean":"2024-09-15T22:09:58.685229+0000","last_became_active":"2024-09-15T22:09:56.696904+0000","last_became_peered":"2024-09-15T22:09:56.696904+0000","last_unstale":"2024-09-15T22:09:58.685229+0000","last_undegraded":"2024-09-15T22:09:58.685229+0000","last_fullsized":"2024-09-15T22:09:58.685229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.950386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696218+0000","last_change":"2024-09-15T22:09:56.693450+0000","last_active":"2024-09-15T22:09:58.696218+0000","last_peered":"2024-09-15T22:09:58.696218+0000","last_clean":"2024-09-15T22:09:58.696218+0000","last_became_active":"2024-09-15T22:09:56.693140+0000","last_became_peered":"2024-09-15T22:09:56.693140+0000","last_unstale":"2024-09-15T22:09:58.696218+0000","last_undegraded":"2024-09-15T22:09:58.696218+0000","last_fullsized":"2024-09-15T22:09:58.696218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.664485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696028+0000","last_change":"2024-09-15T22:09:56.692816+0000","last_active":"2024-09-15T22:09:58.696028+0000","last_peered":"2024-09-15T22:09:58.696028+0000","last_clean":"2024-09-15T22:09:58.696028+0000","last_became_active":"2024-09-15T22:09:56.692367+0000","last_became_peered":"2024-09-15T22:09:56.692367+0000","last_unstale":"2024-09-15T22:09:58.696028+0000","last_undegraded":"2024-09-15T22:09:58.696028+0000","last_fullsized":"2024-09-15T22:09:58.696028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:36.412415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696279+0000","last_change":"2024-09-15T22:09:56.704312+0000","last_active":"2024-09-15T22:09:58.696279+0000","last_peered":"2024-09-15T22:09:58.696279+0000","last_clean":"2024-09-15T22:09:58.696279+0000","last_became_active":"2024-09-15T22:09:56.703976+0000","last_became_peered":"2024-09-15T22:09:56.703976+0000","last_unstale":"2024-09-15T22:09:58.696279+0000","last_undegraded":"2024-09-15T22:09:58.696279+0000","last_fullsized":"2024-09-15T22:09:58.696279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:59.911956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.690966+0000","last_change":"2024-09-15T22:09:56.697278+0000","last_active":"2024-09-15T22:09:58.690966+0000","last_peered":"2024-09-15T22:09:58.690966+0000","last_clean":"2024-09-15T22:09:58.690966+0000","last_became_active":"2024-09-15T22:09:56.696971+0000","last_became_peered":"2024-09-15T22:09:56.696971+0000","last_unstale":"2024-09-15T22:09:58.690966+0000","last_undegraded":"2024-09-15T22:09:58.690966+0000","last_fullsized":"2024-09-15T22:09:58.690966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:49.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685327+0000","last_change":"2024-09-15T22:09:56.701215+0000","last_active":"2024-09-15T22:09:58.685327+0000","last_peered":"2024-09-15T22:09:58.685327+0000","last_clean":"2024-09-15T22:09:58.685327+0000","last_became_active":"2024-09-15T22:09:56.695891+0000","last_became_peered":"2024-09-15T22:09:56.695891+0000","last_unstale":"2024-09-15T22:09:58.685327+0000","last_undegraded":"2024-09-15T22:09:58.685327+0000","last_fullsized":"2024-09-15T22:09:58.685327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:02.065909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695128+0000","last_change":"2024-09-15T22:09:56.697684+0000","last_active":"2024-09-15T22:09:58.695128+0000","last_peered":"2024-09-15T22:09:58.695128+0000","last_clean":"2024-09-15T22:09:58.695128+0000","last_became_active":"2024-09-15T22:09:56.697360+0000","last_became_peered":"2024-09-15T22:09:56.697360+0000","last_unstale":"2024-09-15T22:09:58.695128+0000","last_undegraded":"2024-09-15T22:09:58.695128+0000","last_fullsized":"2024-09-15T22:09:58.695128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:04.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692369+0000","last_change":"2024-09-15T22:09:56.700712+0000","last_active":"2024-09-15T22:09:58.692369+0000","last_peered":"2024-09-15T22:09:58.692369+0000","last_clean":"2024-09-15T22:09:58.692369+0000","last_became_active":"2024-09-15T22:09:56.700379+0000","last_became_peered":"2024-09-15T22:09:56.700379+0000","last_unstale":"2024-09-15T22:09:58.692369+0000","last_undegraded":"2024-09-15T22:09:58.692369+0000","last_fullsized":"2024-09-15T22:09:58.692369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:28.701496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692017+0000","last_change":"2024-09-15T22:09:56.688316+0000","last_active":"2024-09-15T22:09:58.692017+0000","last_peered":"2024-09-15T22:09:58.692017+0000","last_clean":"2024-09-15T22:09:58.692017+0000","last_became_active":"2024-09-15T22:09:56.687958+0000","last_became_peered":"2024-09-15T22:09:56.687958+0000","last_unstale":"2024-09-15T22:09:58.692017+0000","last_undegraded":"2024-09-15T22:09:58.692017+0000","last_fullsized":"2024-09-15T22:09:58.692017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:37.710002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685506+0000","last_change":"2024-09-15T22:09:56.700740+0000","last_active":"2024-09-15T22:09:58.685506+0000","last_peered":"2024-09-15T22:09:58.685506+0000","last_clean":"2024-09-15T22:09:58.685506+0000","last_became_active":"2024-09-15T22:09:56.700367+0000","last_became_peered":"2024-09-15T22:09:56.700367+0000","last_unstale":"2024-09-15T22:09:58.685506+0000","last_undegraded":"2024-09-15T22:09:58.685506+0000","last_fullsized":"2024-09-15T22:09:58.685506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:39.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695676+0000","last_change":"2024-09-15T22:09:56.693630+0000","last_active":"2024-09-15T22:09:58.695676+0000","last_peered":"2024-09-15T22:09:58.695676+0000","last_clean":"2024-09-15T22:09:58.695676+0000","last_became_active":"2024-09-15T22:09:56.693341+0000","last_became_peered":"2024-09-15T22:09:56.693341+0000","last_unstale":"2024-09-15T22:09:58.695676+0000","last_undegraded":"2024-09-15T22:09:58.695676+0000","last_fullsized":"2024-09-15T22:09:58.695676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:13.738884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696458+0000","last_change":"2024-09-15T22:09:56.704364+0000","last_active":"2024-09-15T22:09:58.696458+0000","last_peered":"2024-09-15T22:09:58.696458+0000","last_clean":"2024-09-15T22:09:58.696458+0000","last_became_active":"2024-09-15T22:09:56.703807+0000","last_became_peered":"2024-09-15T22:09:56.703807+0000","last_unstale":"2024-09-15T22:09:58.696458+0000","last_undegraded":"2024-09-15T22:09:58.696458+0000","last_fullsized":"2024-09-15T22:09:58.696458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:11.054261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684526+0000","last_change":"2024-09-15T22:09:56.698001+0000","last_active":"2024-09-15T22:09:58.684526+0000","last_peered":"2024-09-15T22:09:58.684526+0000","last_clean":"2024-09-15T22:09:58.684526+0000","last_became_active":"2024-09-15T22:09:56.696188+0000","last_became_peered":"2024-09-15T22:09:56.696188+0000","last_unstale":"2024-09-15T22:09:58.684526+0000","last_undegraded":"2024-09-15T22:09:58.684526+0000","last_fullsized":"2024-09-15T22:09:58.684526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:00.113552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695795+0000","last_change":"2024-09-15T22:09:56.693422+0000","last_active":"2024-09-15T22:09:58.695795+0000","last_peered":"2024-09-15T22:09:58.695795+0000","last_clean":"2024-09-15T22:09:58.695795+0000","last_became_active":"2024-09-15T22:09:56.693041+0000","last_became_peered":"2024-09-15T22:09:56.693041+0000","last_unstale":"2024-09-15T22:09:58.695795+0000","last_undegraded":"2024-09-15T22:09:58.695795+0000","last_fullsized":"2024-09-15T22:09:58.695795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:57.145008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696108+0000","last_change":"2024-09-15T22:09:56.704449+0000","last_active":"2024-09-15T22:09:58.696108+0000","last_peered":"2024-09-15T22:09:58.696108+0000","last_clean":"2024-09-15T22:09:58.696108+0000","last_became_active":"2024-09-15T22:09:56.704021+0000","last_became_peered":"2024-09-15T22:09:56.704021+0000","last_unstale":"2024-09-15T22:09:58.696108+0000","last_undegraded":"2024-09-15T22:09:58.696108+0000","last_fullsized":"2024-09-15T22:09:58.696108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:56.149392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691078+0000","last_change":"2024-09-15T22:09:56.693385+0000","last_active":"2024-09-15T22:09:58.691078+0000","last_peered":"2024-09-15T22:09:58.691078+0000","last_clean":"2024-09-15T22:09:58.691078+0000","last_became_active":"2024-09-15T22:09:56.692744+0000","last_became_peered":"2024-09-15T22:09:56.692744+0000","last_unstale":"2024-09-15T22:09:58.691078+0000","last_undegraded":"2024-09-15T22:09:58.691078+0000","last_fullsized":"2024-09-15T22:09:58.691078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:38.996962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685230+0000","last_change":"2024-09-15T22:09:56.695902+0000","last_active":"2024-09-15T22:09:58.685230+0000","last_peered":"2024-09-15T22:09:58.685230+0000","last_clean":"2024-09-15T22:09:58.685230+0000","last_became_active":"2024-09-15T22:09:56.695534+0000","last_became_peered":"2024-09-15T22:09:56.695534+0000","last_unstale":"2024-09-15T22:09:58.685230+0000","last_undegraded":"2024-09-15T22:09:58.685230+0000","last_fullsized":"2024-09-15T22:09:58.685230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:47.052196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697890+0000","last_change":"2024-09-15T22:09:56.695057+0000","last_active":"2024-09-15T22:09:58.697890+0000","last_peered":"2024-09-15T22:09:58.697890+0000","last_clean":"2024-09-15T22:09:58.697890+0000","last_became_active":"2024-09-15T22:09:56.694577+0000","last_became_peered":"2024-09-15T22:09:56.694577+0000","last_unstale":"2024-09-15T22:09:58.697890+0000","last_undegraded":"2024-09-15T22:09:58.697890+0000","last_fullsized":"2024-09-15T22:09:58.697890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:34.572928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694217+0000","last_change":"2024-09-15T22:09:56.698918+0000","last_active":"2024-09-15T22:09:58.694217+0000","last_peered":"2024-09-15T22:09:58.694217+0000","last_clean":"2024-09-15T22:09:58.694217+0000","last_became_active":"2024-09-15T22:09:56.698600+0000","last_became_peered":"2024-09-15T22:09:56.698600+0000","last_unstale":"2024-09-15T22:09:58.694217+0000","last_undegraded":"2024-09-15T22:09:58.694217+0000","last_fullsized":"2024-09-15T22:09:58.694217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:41.350724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684891+0000","last_change":"2024-09-15T22:09:56.700272+0000","last_active":"2024-09-15T22:09:58.684891+0000","last_peered":"2024-09-15T22:09:58.684891+0000","last_clean":"2024-09-15T22:09:58.684891+0000","last_became_active":"2024-09-15T22:09:56.699928+0000","last_became_peered":"2024-09-15T22:09:56.699928+0000","last_unstale":"2024-09-15T22:09:58.684891+0000","last_undegraded":"2024-09-15T22:09:58.684891+0000","last_fullsized":"2024-09-15T22:09:58.684891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:47.697158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684604+0000","last_change":"2024-09-15T22:09:56.698638+0000","last_active":"2024-09-15T22:09:58.684604+0000","last_peered":"2024-09-15T22:09:58.684604+0000","last_clean":"2024-09-15T22:09:58.684604+0000","last_became_active":"2024-09-15T22:09:56.696666+0000","last_became_peered":"2024-09-15T22:09:56.696666+0000","last_unstale":"2024-09-15T22:09:58.684604+0000","last_undegraded":"2024-09-15T22:09:58.684604+0000","last_fullsized":"2024-09-15T22:09:58.684604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:55.272401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691989+0000","last_change":"2024-09-15T22:09:56.696020+0000","last_active":"2024-09-15T22:09:58.691989+0000","last_peered":"2024-09-15T22:09:58.691989+0000","last_clean":"2024-09-15T22:09:58.691989+0000","last_became_active":"2024-09-15T22:09:56.695648+0000","last_became_peered":"2024-09-15T22:09:56.695648+0000","last_unstale":"2024-09-15T22:09:58.691989+0000","last_undegraded":"2024-09-15T22:09:58.691989+0000","last_fullsized":"2024-09-15T22:09:58.691989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:12.413993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692399+0000","last_change":"2024-09-15T22:09:56.695593+0000","last_active":"2024-09-15T22:09:58.692399+0000","last_peered":"2024-09-15T22:09:58.692399+0000","last_clean":"2024-09-15T22:09:58.692399+0000","last_became_active":"2024-09-15T22:09:56.695227+0000","last_became_peered":"2024-09-15T22:09:56.695227+0000","last_unstale":"2024-09-15T22:09:58.692399+0000","last_undegraded":"2024-09-15T22:09:58.692399+0000","last_fullsized":"2024-09-15T22:09:58.692399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:08.685355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.699532+0000","last_change":"2024-09-15T22:09:56.695680+0000","last_active":"2024-09-15T22:09:58.699532+0000","last_peered":"2024-09-15T22:09:58.699532+0000","last_clean":"2024-09-15T22:09:58.699532+0000","last_became_active":"2024-09-15T22:09:56.695247+0000","last_became_peered":"2024-09-15T22:09:56.695247+0000","last_unstale":"2024-09-15T22:09:58.699532+0000","last_undegraded":"2024-09-15T22:09:58.699532+0000","last_fullsized":"2024-09-15T22:09:58.699532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:24.888251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693217+0000","last_change":"2024-09-15T22:09:56.708370+0000","last_active":"2024-09-15T22:09:58.693217+0000","last_peered":"2024-09-15T22:09:58.693217+0000","last_clean":"2024-09-15T22:09:58.693217+0000","last_became_active":"2024-09-15T22:09:56.707971+0000","last_became_peered":"2024-09-15T22:09:56.707971+0000","last_unstale":"2024-09-15T22:09:58.693217+0000","last_undegraded":"2024-09-15T22:09:58.693217+0000","last_fullsized":"2024-09-15T22:09:58.693217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:54.066532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694518+0000","last_change":"2024-09-15T22:09:56.690437+0000","last_active":"2024-09-15T22:09:58.694518+0000","last_peered":"2024-09-15T22:09:58.694518+0000","last_clean":"2024-09-15T22:09:58.694518+0000","last_became_active":"2024-09-15T22:09:56.690063+0000","last_became_peered":"2024-09-15T22:09:56.690063+0000","last_unstale":"2024-09-15T22:09:58.694518+0000","last_undegraded":"2024-09-15T22:09:58.694518+0000","last_fullsized":"2024-09-15T22:09:58.694518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:58.488119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684983+0000","last_change":"2024-09-15T22:09:56.692654+0000","last_active":"2024-09-15T22:09:58.684983+0000","last_peered":"2024-09-15T22:09:58.684983+0000","last_clean":"2024-09-15T22:09:58.684983+0000","last_became_active":"2024-09-15T22:09:56.692096+0000","last_became_peered":"2024-09-15T22:09:56.692096+0000","last_unstale":"2024-09-15T22:09:58.684983+0000","last_undegraded":"2024-09-15T22:09:58.684983+0000","last_fullsized":"2024-09-15T22:09:58.684983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:40.104024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684511+0000","last_change":"2024-09-15T22:09:56.705271+0000","last_active":"2024-09-15T22:09:58.684511+0000","last_peered":"2024-09-15T22:09:58.684511+0000","last_clean":"2024-09-15T22:09:58.684511+0000","last_became_active":"2024-09-15T22:09:56.703538+0000","last_became_peered":"2024-09-15T22:09:56.703538+0000","last_unstale":"2024-09-15T22:09:58.684511+0000","last_undegraded":"2024-09-15T22:09:58.684511+0000","last_fullsized":"2024-09-15T22:09:58.684511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:50.517516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696063+0000","last_change":"2024-09-15T22:09:56.706134+0000","last_active":"2024-09-15T22:09:58.696063+0000","last_peered":"2024-09-15T22:09:58.696063+0000","last_clean":"2024-09-15T22:09:58.696063+0000","last_became_active":"2024-09-15T22:09:56.705699+0000","last_became_peered":"2024-09-15T22:09:56.705699+0000","last_unstale":"2024-09-15T22:09:58.696063+0000","last_undegraded":"2024-09-15T22:09:58.696063+0000","last_fullsized":"2024-09-15T22:09:58.696063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:12:29.296607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694310+0000","last_change":"2024-09-15T22:09:56.698023+0000","last_active":"2024-09-15T22:09:58.694310+0000","last_peered":"2024-09-15T22:09:58.694310+0000","last_clean":"2024-09-15T22:09:58.694310+0000","last_became_active":"2024-09-15T22:09:56.697664+0000","last_became_peered":"2024-09-15T22:09:56.697664+0000","last_unstale":"2024-09-15T22:09:58.694310+0000","last_undegraded":"2024-09-15T22:09:58.694310+0000","last_fullsized":"2024-09-15T22:09:58.694310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:47.387380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693998+0000","last_change":"2024-09-15T22:09:56.702073+0000","last_active":"2024-09-15T22:09:58.693998+0000","last_peered":"2024-09-15T22:09:58.693998+0000","last_clean":"2024-09-15T22:09:58.693998+0000","last_became_active":"2024-09-15T22:09:56.701663+0000","last_became_peered":"2024-09-15T22:09:56.701663+0000","last_unstale":"2024-09-15T22:09:58.693998+0000","last_undegraded":"2024-09-15T22:09:58.693998+0000","last_fullsized":"2024-09-15T22:09:58.693998+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:20.095392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684796+0000","last_change":"2024-09-15T22:09:56.692430+0000","last_active":"2024-09-15T22:09:58.684796+0000","last_peered":"2024-09-15T22:09:58.684796+0000","last_clean":"2024-09-15T22:09:58.684796+0000","last_became_active":"2024-09-15T22:09:56.692068+0000","last_became_peered":"2024-09-15T22:09:56.692068+0000","last_unstale":"2024-09-15T22:09:58.684796+0000","last_undegraded":"2024-09-15T22:09:58.684796+0000","last_fullsized":"2024-09-15T22:09:58.684796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.694497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691440+0000","last_change":"2024-09-15T22:09:56.690234+0000","last_active":"2024-09-15T22:09:58.691440+0000","last_peered":"2024-09-15T22:09:58.691440+0000","last_clean":"2024-09-15T22:09:58.691440+0000","last_became_active":"2024-09-15T22:09:56.689845+0000","last_became_peered":"2024-09-15T22:09:56.689845+0000","last_unstale":"2024-09-15T22:09:58.691440+0000","last_undegraded":"2024-09-15T22:09:58.691440+0000","last_fullsized":"2024-09-15T22:09:58.691440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:32.997578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:23.818529+0000","last_change":"2024-09-15T22:09:54.219344+0000","last_active":"2024-09-15T22:10:23.818529+0000","last_peered":"2024-09-15T22:10:23.818529+0000","last_clean":"2024-09-15T22:10:23.818529+0000","last_became_active":"2024-09-15T22:09:54.218592+0000","last_became_peered":"2024-09-15T22:09:54.218592+0000","last_unstale":"2024-09-15T22:10:23.818529+0000","last_undegraded":"2024-09-15T22:10:23.818529+0000","last_fullsized":"2024-09-15T22:10:23.818529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:44.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697629+0000","last_change":"2024-09-15T22:09:56.703045+0000","last_active":"2024-09-15T22:09:58.697629+0000","last_peered":"2024-09-15T22:09:58.697629+0000","last_clean":"2024-09-15T22:09:58.697629+0000","last_became_active":"2024-09-15T22:09:56.702724+0000","last_became_peered":"2024-09-15T22:09:56.702724+0000","last_unstale":"2024-09-15T22:09:58.697629+0000","last_undegraded":"2024-09-15T22:09:58.697629+0000","last_fullsized":"2024-09-15T22:09:58.697629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.440559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:08.774883+0000","last_change":"2024-09-15T22:09:54.217545+0000","last_active":"2024-09-15T22:10:08.774883+0000","last_peered":"2024-09-15T22:10:08.774883+0000","last_clean":"2024-09-15T22:10:08.774883+0000","last_became_active":"2024-09-15T22:09:54.217158+0000","last_became_peered":"2024-09-15T22:09:54.217158+0000","last_unstale":"2024-09-15T22:10:08.774883+0000","last_undegraded":"2024-09-15T22:10:08.774883+0000","last_fullsized":"2024-09-15T22:10:08.774883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:36.024194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:07.764174+0000","last_change":"2024-09-15T22:09:54.214589+0000","last_active":"2024-09-15T22:10:07.764174+0000","last_peered":"2024-09-15T22:10:07.764174+0000","last_clean":"2024-09-15T22:10:07.764174+0000","last_became_active":"2024-09-15T22:09:54.214115+0000","last_became_peered":"2024-09-15T22:09:54.214115+0000","last_unstale":"2024-09-15T22:10:07.764174+0000","last_undegraded":"2024-09-15T22:10:07.764174+0000","last_fullsized":"2024-09-15T22:10:07.764174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:05.452310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692442+0000","last_change":"2024-09-15T22:09:56.700414+0000","last_active":"2024-09-15T22:09:58.692442+0000","last_peered":"2024-09-15T22:09:58.692442+0000","last_clean":"2024-09-15T22:09:58.692442+0000","last_became_active":"2024-09-15T22:09:56.700041+0000","last_became_peered":"2024-09-15T22:09:56.700041+0000","last_unstale":"2024-09-15T22:09:58.692442+0000","last_undegraded":"2024-09-15T22:09:58.692442+0000","last_fullsized":"2024-09-15T22:09:58.692442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:08.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790184+0000","last_change":"2024-09-15T22:09:54.219547+0000","last_active":"2024-09-15T22:10:09.790184+0000","last_peered":"2024-09-15T22:10:09.790184+0000","last_clean":"2024-09-15T22:10:09.790184+0000","last_became_active":"2024-09-15T22:09:54.218554+0000","last_became_peered":"2024-09-15T22:09:54.218554+0000","last_unstale":"2024-09-15T22:10:09.790184+0000","last_undegraded":"2024-09-15T22:10:09.790184+0000","last_fullsized":"2024-09-15T22:10:09.790184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:09.478853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697019+0000","last_change":"2024-09-15T22:09:56.694749+0000","last_active":"2024-09-15T22:09:58.697019+0000","last_peered":"2024-09-15T22:09:58.697019+0000","last_clean":"2024-09-15T22:09:58.697019+0000","last_became_active":"2024-09-15T22:09:56.694450+0000","last_became_peered":"2024-09-15T22:09:56.694450+0000","last_unstale":"2024-09-15T22:09:58.697019+0000","last_undegraded":"2024-09-15T22:09:58.697019+0000","last_fullsized":"2024-09-15T22:09:58.697019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:39:19.565705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:23.817860+0000","last_change":"2024-09-15T22:09:54.220137+0000","last_active":"2024-09-15T22:10:23.817860+0000","last_peered":"2024-09-15T22:10:23.817860+0000","last_clean":"2024-09-15T22:10:23.817860+0000","last_became_active":"2024-09-15T22:09:54.219738+0000","last_became_peered":"2024-09-15T22:09:54.219738+0000","last_unstale":"2024-09-15T22:10:23.817860+0000","last_undegraded":"2024-09-15T22:10:23.817860+0000","last_fullsized":"2024-09-15T22:10:23.817860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:56.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691657+0000","last_change":"2024-09-15T22:09:56.694869+0000","last_active":"2024-09-15T22:09:58.691657+0000","last_peered":"2024-09-15T22:09:58.691657+0000","last_clean":"2024-09-15T22:09:58.691657+0000","last_became_active":"2024-09-15T22:09:56.694522+0000","last_became_peered":"2024-09-15T22:09:56.694522+0000","last_unstale":"2024-09-15T22:09:58.691657+0000","last_undegraded":"2024-09-15T22:09:58.691657+0000","last_fullsized":"2024-09-15T22:09:58.691657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:33.633471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.787286+0000","last_change":"2024-09-15T22:09:54.218828+0000","last_active":"2024-09-15T22:10:09.787286+0000","last_peered":"2024-09-15T22:10:09.787286+0000","last_clean":"2024-09-15T22:10:09.787286+0000","last_became_active":"2024-09-15T22:09:54.218321+0000","last_became_peered":"2024-09-15T22:09:54.218321+0000","last_unstale":"2024-09-15T22:10:09.787286+0000","last_undegraded":"2024-09-15T22:10:09.787286+0000","last_fullsized":"2024-09-15T22:10:09.787286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:35.144823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696874+0000","last_change":"2024-09-15T22:09:56.706449+0000","last_active":"2024-09-15T22:09:58.696874+0000","last_peered":"2024-09-15T22:09:58.696874+0000","last_clean":"2024-09-15T22:09:58.696874+0000","last_became_active":"2024-09-15T22:09:56.705380+0000","last_became_peered":"2024-09-15T22:09:56.705380+0000","last_unstale":"2024-09-15T22:09:58.696874+0000","last_undegraded":"2024-09-15T22:09:58.696874+0000","last_fullsized":"2024-09-15T22:09:58.696874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:24.422911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:08.773814+0000","last_change":"2024-09-15T22:09:54.478189+0000","last_active":"2024-09-15T22:10:08.773814+0000","last_peered":"2024-09-15T22:10:08.773814+0000","last_clean":"2024-09-15T22:10:08.773814+0000","last_became_active":"2024-09-15T22:09:54.477846+0000","last_became_peered":"2024-09-15T22:09:54.477846+0000","last_unstale":"2024-09-15T22:10:08.773814+0000","last_undegraded":"2024-09-15T22:10:08.773814+0000","last_fullsized":"2024-09-15T22:10:08.773814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:00.944061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691980+0000","last_change":"2024-09-15T22:09:56.698547+0000","last_active":"2024-09-15T22:09:58.691980+0000","last_peered":"2024-09-15T22:09:58.691980+0000","last_clean":"2024-09-15T22:09:58.691980+0000","last_became_active":"2024-09-15T22:09:56.698144+0000","last_became_peered":"2024-09-15T22:09:56.698144+0000","last_unstale":"2024-09-15T22:09:58.691980+0000","last_undegraded":"2024-09-15T22:09:58.691980+0000","last_fullsized":"2024-09-15T22:09:58.691980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:57.388293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:23.820796+0000","last_change":"2024-09-15T22:09:54.216447+0000","last_active":"2024-09-15T22:10:23.820796+0000","last_peered":"2024-09-15T22:10:23.820796+0000","last_clean":"2024-09-15T22:10:23.820796+0000","last_became_active":"2024-09-15T22:09:54.216102+0000","last_became_peered":"2024-09-15T22:09:54.216102+0000","last_unstale":"2024-09-15T22:10:23.820796+0000","last_undegraded":"2024-09-15T22:10:23.820796+0000","last_fullsized":"2024-09-15T22:10:23.820796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:55.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691162+0000","last_change":"2024-09-15T22:09:56.694011+0000","last_active":"2024-09-15T22:09:58.691162+0000","last_peered":"2024-09-15T22:09:58.691162+0000","last_clean":"2024-09-15T22:09:58.691162+0000","last_became_active":"2024-09-15T22:09:56.693447+0000","last_became_peered":"2024-09-15T22:09:56.693447+0000","last_unstale":"2024-09-15T22:09:58.691162+0000","last_undegraded":"2024-09-15T22:09:58.691162+0000","last_fullsized":"2024-09-15T22:09:58.691162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:10.797740+0000","last_change":"2024-09-15T22:09:54.221406+0000","last_active":"2024-09-15T22:10:10.797740+0000","last_peered":"2024-09-15T22:10:10.797740+0000","last_clean":"2024-09-15T22:10:10.797740+0000","last_became_active":"2024-09-15T22:09:54.220752+0000","last_became_peered":"2024-09-15T22:09:54.220752+0000","last_unstale":"2024-09-15T22:10:10.797740+0000","last_undegraded":"2024-09-15T22:10:10.797740+0000","last_fullsized":"2024-09-15T22:10:10.797740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.198214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684421+0000","last_change":"2024-09-15T22:09:56.697991+0000","last_active":"2024-09-15T22:09:58.684421+0000","last_peered":"2024-09-15T22:09:58.684421+0000","last_clean":"2024-09-15T22:09:58.684421+0000","last_became_active":"2024-09-15T22:09:56.695867+0000","last_became_peered":"2024-09-15T22:09:56.695867+0000","last_unstale":"2024-09-15T22:09:58.684421+0000","last_undegraded":"2024-09-15T22:09:58.684421+0000","last_fullsized":"2024-09-15T22:09:58.684421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:05.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790771+0000","last_change":"2024-09-15T22:09:54.219276+0000","last_active":"2024-09-15T22:10:09.790771+0000","last_peered":"2024-09-15T22:10:09.790771+0000","last_clean":"2024-09-15T22:10:09.790771+0000","last_became_active":"2024-09-15T22:09:54.218940+0000","last_became_peered":"2024-09-15T22:09:54.218940+0000","last_unstale":"2024-09-15T22:10:09.790771+0000","last_undegraded":"2024-09-15T22:10:09.790771+0000","last_fullsized":"2024-09-15T22:10:09.790771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:38.511671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696670+0000","last_change":"2024-09-15T22:09:56.703202+0000","last_active":"2024-09-15T22:09:58.696670+0000","last_peered":"2024-09-15T22:09:58.696670+0000","last_clean":"2024-09-15T22:09:58.696670+0000","last_became_active":"2024-09-15T22:09:56.702871+0000","last_became_peered":"2024-09-15T22:09:56.702871+0000","last_unstale":"2024-09-15T22:09:58.696670+0000","last_undegraded":"2024-09-15T22:09:58.696670+0000","last_fullsized":"2024-09-15T22:09:58.696670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:08.404847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:22.816452+0000","last_change":"2024-09-15T22:09:54.219948+0000","last_active":"2024-09-15T22:10:22.816452+0000","last_peered":"2024-09-15T22:10:22.816452+0000","last_clean":"2024-09-15T22:10:22.816452+0000","last_became_active":"2024-09-15T22:09:54.219603+0000","last_became_peered":"2024-09-15T22:09:54.219603+0000","last_unstale":"2024-09-15T22:10:22.816452+0000","last_undegraded":"2024-09-15T22:10:22.816452+0000","last_fullsized":"2024-09-15T22:10:22.816452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:07.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695480+0000","last_change":"2024-09-15T22:09:56.698203+0000","last_active":"2024-09-15T22:09:58.695480+0000","last_peered":"2024-09-15T22:09:58.695480+0000","last_clean":"2024-09-15T22:09:58.695480+0000","last_became_active":"2024-09-15T22:09:56.697882+0000","last_became_peered":"2024-09-15T22:09:56.697882+0000","last_unstale":"2024-09-15T22:09:58.695480+0000","last_undegraded":"2024-09-15T22:09:58.695480+0000","last_fullsized":"2024-09-15T22:09:58.695480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:29.865810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.789250+0000","last_change":"2024-09-15T22:09:54.477287+0000","last_active":"2024-09-15T22:10:09.789250+0000","last_peered":"2024-09-15T22:10:09.789250+0000","last_clean":"2024-09-15T22:10:09.789250+0000","last_became_active":"2024-09-15T22:09:54.476895+0000","last_became_peered":"2024-09-15T22:09:54.476895+0000","last_unstale":"2024-09-15T22:10:09.789250+0000","last_undegraded":"2024-09-15T22:10:09.789250+0000","last_fullsized":"2024-09-15T22:10:09.789250+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:22.940445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.694993+0000","last_change":"2024-09-15T22:09:56.703388+0000","last_active":"2024-09-15T22:09:58.694993+0000","last_peered":"2024-09-15T22:09:58.694993+0000","last_clean":"2024-09-15T22:09:58.694993+0000","last_became_active":"2024-09-15T22:09:56.703053+0000","last_became_peered":"2024-09-15T22:09:56.703053+0000","last_unstale":"2024-09-15T22:09:58.694993+0000","last_undegraded":"2024-09-15T22:09:58.694993+0000","last_fullsized":"2024-09-15T22:09:58.694993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:22.700159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.757526+0000","last_change":"2024-09-15T22:09:54.217269+0000","last_active":"2024-09-15T22:10:09.757526+0000","last_peered":"2024-09-15T22:10:09.757526+0000","last_clean":"2024-09-15T22:10:09.757526+0000","last_became_active":"2024-09-15T22:09:54.216887+0000","last_became_peered":"2024-09-15T22:09:54.216887+0000","last_unstale":"2024-09-15T22:10:09.757526+0000","last_undegraded":"2024-09-15T22:10:09.757526+0000","last_fullsized":"2024-09-15T22:10:09.757526+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:35.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685085+0000","last_change":"2024-09-15T22:09:56.696293+0000","last_active":"2024-09-15T22:09:58.685085+0000","last_peered":"2024-09-15T22:09:58.685085+0000","last_clean":"2024-09-15T22:09:58.685085+0000","last_became_active":"2024-09-15T22:09:56.695954+0000","last_became_peered":"2024-09-15T22:09:56.695954+0000","last_unstale":"2024-09-15T22:09:58.685085+0000","last_undegraded":"2024-09-15T22:09:58.685085+0000","last_fullsized":"2024-09-15T22:09:58.685085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:23.933813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790669+0000","last_change":"2024-09-15T22:09:54.219608+0000","last_active":"2024-09-15T22:10:09.790669+0000","last_peered":"2024-09-15T22:10:09.790669+0000","last_clean":"2024-09-15T22:10:09.790669+0000","last_became_active":"2024-09-15T22:09:54.218700+0000","last_became_peered":"2024-09-15T22:09:54.218700+0000","last_unstale":"2024-09-15T22:10:09.790669+0000","last_undegraded":"2024-09-15T22:10:09.790669+0000","last_fullsized":"2024-09-15T22:10:09.790669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:55.941217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696365+0000","last_change":"2024-09-15T22:09:56.693898+0000","last_active":"2024-09-15T22:09:58.696365+0000","last_peered":"2024-09-15T22:09:58.696365+0000","last_clean":"2024-09-15T22:09:58.696365+0000","last_became_active":"2024-09-15T22:09:56.692960+0000","last_became_peered":"2024-09-15T22:09:56.692960+0000","last_unstale":"2024-09-15T22:09:58.696365+0000","last_undegraded":"2024-09-15T22:09:58.696365+0000","last_fullsized":"2024-09-15T22:09:58.696365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:50.150574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790753+0000","last_change":"2024-09-15T22:09:54.220757+0000","last_active":"2024-09-15T22:10:09.790753+0000","last_peered":"2024-09-15T22:10:09.790753+0000","last_clean":"2024-09-15T22:10:09.790753+0000","last_became_active":"2024-09-15T22:09:54.220371+0000","last_became_peered":"2024-09-15T22:09:54.220371+0000","last_unstale":"2024-09-15T22:10:09.790753+0000","last_undegraded":"2024-09-15T22:10:09.790753+0000","last_fullsized":"2024-09-15T22:10:09.790753+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:07.234474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696139+0000","last_change":"2024-09-15T22:09:56.699810+0000","last_active":"2024-09-15T22:09:58.696139+0000","last_peered":"2024-09-15T22:09:58.696139+0000","last_clean":"2024-09-15T22:09:58.696139+0000","last_became_active":"2024-09-15T22:09:56.699279+0000","last_became_peered":"2024-09-15T22:09:56.699279+0000","last_unstale":"2024-09-15T22:09:58.696139+0000","last_undegraded":"2024-09-15T22:09:58.696139+0000","last_fullsized":"2024-09-15T22:09:58.696139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:42.730032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:22.817261+0000","last_change":"2024-09-15T22:09:55.000482+0000","last_active":"2024-09-15T22:10:22.817261+0000","last_peered":"2024-09-15T22:10:22.817261+0000","last_clean":"2024-09-15T22:10:22.817261+0000","last_became_active":"2024-09-15T22:09:55.000088+0000","last_became_peered":"2024-09-15T22:09:55.000088+0000","last_unstale":"2024-09-15T22:10:22.817261+0000","last_undegraded":"2024-09-15T22:10:22.817261+0000","last_fullsized":"2024-09-15T22:10:22.817261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:48.309582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695844+0000","last_change":"2024-09-15T22:09:56.699129+0000","last_active":"2024-09-15T22:09:58.695844+0000","last_peered":"2024-09-15T22:09:58.695844+0000","last_clean":"2024-09-15T22:09:58.695844+0000","last_became_active":"2024-09-15T22:09:56.698107+0000","last_became_peered":"2024-09-15T22:09:56.698107+0000","last_unstale":"2024-09-15T22:09:58.695844+0000","last_undegraded":"2024-09-15T22:09:58.695844+0000","last_fullsized":"2024-09-15T22:09:58.695844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:35.436908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695808+0000","last_change":"2024-09-15T22:08:41.556517+0000","last_active":"2024-09-15T22:09:58.695808+0000","last_peered":"2024-09-15T22:09:58.695808+0000","last_clean":"2024-09-15T22:09:58.695808+0000","last_became_active":"2024-09-15T22:08:41.555887+0000","last_became_peered":"2024-09-15T22:08:41.555887+0000","last_unstale":"2024-09-15T22:09:58.695808+0000","last_undegraded":"2024-09-15T22:09:58.695808+0000","last_fullsized":"2024-09-15T22:09:58.695808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_clean_scrub_stamp":"2024-09-15T22:05:05.654738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:29.105403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:10.794800+0000","last_change":"2024-09-15T22:09:54.220522+0000","last_active":"2024-09-15T22:10:10.794800+0000","last_peered":"2024-09-15T22:10:10.794800+0000","last_clean":"2024-09-15T22:10:10.794800+0000","last_became_active":"2024-09-15T22:09:54.220174+0000","last_became_peered":"2024-09-15T22:09:54.220174+0000","last_unstale":"2024-09-15T22:10:10.794800+0000","last_undegraded":"2024-09-15T22:10:10.794800+0000","last_fullsized":"2024-09-15T22:10:10.794800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:33.909055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692734+0000","last_change":"2024-09-15T22:09:56.703268+0000","last_active":"2024-09-15T22:09:58.692734+0000","last_peered":"2024-09-15T22:09:58.692734+0000","last_clean":"2024-09-15T22:09:58.692734+0000","last_became_active":"2024-09-15T22:09:56.701096+0000","last_became_peered":"2024-09-15T22:09:56.701096+0000","last_unstale":"2024-09-15T22:09:58.692734+0000","last_undegraded":"2024-09-15T22:09:58.692734+0000","last_fullsized":"2024-09-15T22:09:58.692734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:30.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:07.761101+0000","last_change":"2024-09-15T22:09:54.220913+0000","last_active":"2024-09-15T22:10:07.761101+0000","last_peered":"2024-09-15T22:10:07.761101+0000","last_clean":"2024-09-15T22:10:07.761101+0000","last_became_active":"2024-09-15T22:09:54.220476+0000","last_became_peered":"2024-09-15T22:09:54.220476+0000","last_unstale":"2024-09-15T22:10:07.761101+0000","last_undegraded":"2024-09-15T22:10:07.761101+0000","last_fullsized":"2024-09-15T22:10:07.761101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:27.087931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684211+0000","last_change":"2024-09-15T22:09:56.704428+0000","last_active":"2024-09-15T22:09:58.684211+0000","last_peered":"2024-09-15T22:09:58.684211+0000","last_clean":"2024-09-15T22:09:58.684211+0000","last_became_active":"2024-09-15T22:09:56.703856+0000","last_became_peered":"2024-09-15T22:09:56.703856+0000","last_unstale":"2024-09-15T22:09:58.684211+0000","last_undegraded":"2024-09-15T22:09:58.684211+0000","last_fullsized":"2024-09-15T22:09:58.684211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:56.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:22.815743+0000","last_change":"2024-09-15T22:09:54.476737+0000","last_active":"2024-09-15T22:10:22.815743+0000","last_peered":"2024-09-15T22:10:22.815743+0000","last_clean":"2024-09-15T22:10:22.815743+0000","last_became_active":"2024-09-15T22:09:54.476256+0000","last_became_peered":"2024-09-15T22:09:54.476256+0000","last_unstale":"2024-09-15T22:10:22.815743+0000","last_undegraded":"2024-09-15T22:10:22.815743+0000","last_fullsized":"2024-09-15T22:10:22.815743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:26.775968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.699709+0000","last_change":"2024-09-15T22:09:56.703160+0000","last_active":"2024-09-15T22:09:58.699709+0000","last_peered":"2024-09-15T22:09:58.699709+0000","last_clean":"2024-09-15T22:09:58.699709+0000","last_became_active":"2024-09-15T22:09:56.702822+0000","last_became_peered":"2024-09-15T22:09:56.702822+0000","last_unstale":"2024-09-15T22:09:58.699709+0000","last_undegraded":"2024-09-15T22:09:58.699709+0000","last_fullsized":"2024-09-15T22:09:58.699709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:41.188636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:21.814957+0000","last_change":"2024-09-15T22:09:54.219289+0000","last_active":"2024-09-15T22:10:21.814957+0000","last_peered":"2024-09-15T22:10:21.814957+0000","last_clean":"2024-09-15T22:10:21.814957+0000","last_became_active":"2024-09-15T22:09:54.218572+0000","last_became_peered":"2024-09-15T22:09:54.218572+0000","last_unstale":"2024-09-15T22:10:21.814957+0000","last_undegraded":"2024-09-15T22:10:21.814957+0000","last_fullsized":"2024-09-15T22:10:21.814957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:02.294569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685382+0000","last_change":"2024-09-15T22:09:56.698458+0000","last_active":"2024-09-15T22:09:58.685382+0000","last_peered":"2024-09-15T22:09:58.685382+0000","last_clean":"2024-09-15T22:09:58.685382+0000","last_became_active":"2024-09-15T22:09:56.698135+0000","last_became_peered":"2024-09-15T22:09:56.698135+0000","last_unstale":"2024-09-15T22:09:58.685382+0000","last_undegraded":"2024-09-15T22:09:58.685382+0000","last_fullsized":"2024-09-15T22:09:58.685382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:40.002319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.697439+0000","last_change":"2024-09-15T22:09:54.478546+0000","last_active":"2024-09-15T22:09:58.697439+0000","last_peered":"2024-09-15T22:09:58.697439+0000","last_clean":"2024-09-15T22:09:58.697439+0000","last_became_active":"2024-09-15T22:09:54.478106+0000","last_became_peered":"2024-09-15T22:09:54.478106+0000","last_unstale":"2024-09-15T22:09:58.697439+0000","last_undegraded":"2024-09-15T22:09:58.697439+0000","last_fullsized":"2024-09-15T22:09:58.697439+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:57.687752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.941367+0000","last_change":"2024-09-15T22:09:56.697014+0000","last_active":"2024-09-15T22:09:58.941367+0000","last_peered":"2024-09-15T22:09:58.941367+0000","last_clean":"2024-09-15T22:09:58.941367+0000","last_became_active":"2024-09-15T22:09:56.696702+0000","last_became_peered":"2024-09-15T22:09:56.696702+0000","last_unstale":"2024-09-15T22:09:58.941367+0000","last_undegraded":"2024-09-15T22:09:58.941367+0000","last_fullsized":"2024-09-15T22:09:58.941367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:08.687166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.791663+0000","last_change":"2024-09-15T22:09:54.477243+0000","last_active":"2024-09-15T22:10:09.791663+0000","last_peered":"2024-09-15T22:10:09.791663+0000","last_clean":"2024-09-15T22:10:09.791663+0000","last_became_active":"2024-09-15T22:09:54.476879+0000","last_became_peered":"2024-09-15T22:09:54.476879+0000","last_unstale":"2024-09-15T22:10:09.791663+0000","last_undegraded":"2024-09-15T22:10:09.791663+0000","last_fullsized":"2024-09-15T22:10:09.791663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:31.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.684547+0000","last_change":"2024-09-15T22:09:56.689341+0000","last_active":"2024-09-15T22:09:58.684547+0000","last_peered":"2024-09-15T22:09:58.684547+0000","last_clean":"2024-09-15T22:09:58.684547+0000","last_became_active":"2024-09-15T22:09:56.688925+0000","last_became_peered":"2024-09-15T22:09:56.688925+0000","last_unstale":"2024-09-15T22:09:58.684547+0000","last_undegraded":"2024-09-15T22:09:58.684547+0000","last_fullsized":"2024-09-15T22:09:58.684547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:20.552548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:19.692470+0000","last_change":"2024-09-15T22:09:54.219690+0000","last_active":"2024-09-15T22:10:19.692470+0000","last_peered":"2024-09-15T22:10:19.692470+0000","last_clean":"2024-09-15T22:10:19.692470+0000","last_became_active":"2024-09-15T22:09:54.218962+0000","last_became_peered":"2024-09-15T22:09:54.218962+0000","last_unstale":"2024-09-15T22:10:19.692470+0000","last_undegraded":"2024-09-15T22:10:19.692470+0000","last_fullsized":"2024-09-15T22:10:19.692470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:44.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693269+0000","last_change":"2024-09-15T22:09:56.702350+0000","last_active":"2024-09-15T22:09:58.693269+0000","last_peered":"2024-09-15T22:09:58.693269+0000","last_clean":"2024-09-15T22:09:58.693269+0000","last_became_active":"2024-09-15T22:09:56.699387+0000","last_became_peered":"2024-09-15T22:09:56.699387+0000","last_unstale":"2024-09-15T22:09:58.693269+0000","last_undegraded":"2024-09-15T22:09:58.693269+0000","last_fullsized":"2024-09-15T22:09:58.693269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:47.005526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.791574+0000","last_change":"2024-09-15T22:09:55.000416+0000","last_active":"2024-09-15T22:10:09.791574+0000","last_peered":"2024-09-15T22:10:09.791574+0000","last_clean":"2024-09-15T22:10:09.791574+0000","last_became_active":"2024-09-15T22:09:55.000108+0000","last_became_peered":"2024-09-15T22:09:55.000108+0000","last_unstale":"2024-09-15T22:10:09.791574+0000","last_undegraded":"2024-09-15T22:10:09.791574+0000","last_fullsized":"2024-09-15T22:10:09.791574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:15.005148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696660+0000","last_change":"2024-09-15T22:09:56.707107+0000","last_active":"2024-09-15T22:09:58.696660+0000","last_peered":"2024-09-15T22:09:58.696660+0000","last_clean":"2024-09-15T22:09:58.696660+0000","last_became_active":"2024-09-15T22:09:56.706442+0000","last_became_peered":"2024-09-15T22:09:56.706442+0000","last_unstale":"2024-09-15T22:09:58.696660+0000","last_undegraded":"2024-09-15T22:09:58.696660+0000","last_fullsized":"2024-09-15T22:09:58.696660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:51.381492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:06.748039+0000","last_change":"2024-09-15T22:09:54.477365+0000","last_active":"2024-09-15T22:10:06.748039+0000","last_peered":"2024-09-15T22:10:06.748039+0000","last_clean":"2024-09-15T22:10:06.748039+0000","last_became_active":"2024-09-15T22:09:54.477033+0000","last_became_peered":"2024-09-15T22:09:54.477033+0000","last_unstale":"2024-09-15T22:10:06.748039+0000","last_undegraded":"2024-09-15T22:10:06.748039+0000","last_fullsized":"2024-09-15T22:10:06.748039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:10.634767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.690901+0000","last_change":"2024-09-15T22:09:56.693547+0000","last_active":"2024-09-15T22:09:58.690901+0000","last_peered":"2024-09-15T22:09:58.690901+0000","last_clean":"2024-09-15T22:09:58.690901+0000","last_became_active":"2024-09-15T22:09:56.692923+0000","last_became_peered":"2024-09-15T22:09:56.692923+0000","last_unstale":"2024-09-15T22:09:58.690901+0000","last_undegraded":"2024-09-15T22:09:58.690901+0000","last_fullsized":"2024-09-15T22:09:58.690901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.462232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.790970+0000","last_change":"2024-09-15T22:09:54.221737+0000","last_active":"2024-09-15T22:10:09.790970+0000","last_peered":"2024-09-15T22:10:09.790970+0000","last_clean":"2024-09-15T22:10:09.790970+0000","last_became_active":"2024-09-15T22:09:54.221418+0000","last_became_peered":"2024-09-15T22:09:54.221418+0000","last_unstale":"2024-09-15T22:10:09.790970+0000","last_undegraded":"2024-09-15T22:10:09.790970+0000","last_fullsized":"2024-09-15T22:10:09.790970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:35.636403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.685081+0000","last_change":"2024-09-15T22:09:56.690290+0000","last_active":"2024-09-15T22:09:58.685081+0000","last_peered":"2024-09-15T22:09:58.685081+0000","last_clean":"2024-09-15T22:09:58.685081+0000","last_became_active":"2024-09-15T22:09:56.689986+0000","last_became_peered":"2024-09-15T22:09:56.689986+0000","last_unstale":"2024-09-15T22:09:58.685081+0000","last_undegraded":"2024-09-15T22:09:58.685081+0000","last_fullsized":"2024-09-15T22:09:58.685081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:53.860697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:08.774592+0000","last_change":"2024-09-15T22:09:54.219569+0000","last_active":"2024-09-15T22:10:08.774592+0000","last_peered":"2024-09-15T22:10:08.774592+0000","last_clean":"2024-09-15T22:10:08.774592+0000","last_became_active":"2024-09-15T22:09:54.219203+0000","last_became_peered":"2024-09-15T22:09:54.219203+0000","last_unstale":"2024-09-15T22:10:08.774592+0000","last_undegraded":"2024-09-15T22:10:08.774592+0000","last_fullsized":"2024-09-15T22:10:08.774592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:21:02.719849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.692929+0000","last_change":"2024-09-15T22:09:56.696608+0000","last_active":"2024-09-15T22:09:58.692929+0000","last_peered":"2024-09-15T22:09:58.692929+0000","last_clean":"2024-09-15T22:09:58.692929+0000","last_became_active":"2024-09-15T22:09:56.696301+0000","last_became_peered":"2024-09-15T22:09:56.696301+0000","last_unstale":"2024-09-15T22:09:58.692929+0000","last_undegraded":"2024-09-15T22:09:58.692929+0000","last_fullsized":"2024-09-15T22:09:58.692929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:48.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:06.747043+0000","last_change":"2024-09-15T22:09:54.218426+0000","last_active":"2024-09-15T22:10:06.747043+0000","last_peered":"2024-09-15T22:10:06.747043+0000","last_clean":"2024-09-15T22:10:06.747043+0000","last_became_active":"2024-09-15T22:09:54.218084+0000","last_became_peered":"2024-09-15T22:09:54.218084+0000","last_unstale":"2024-09-15T22:10:06.747043+0000","last_undegraded":"2024-09-15T22:10:06.747043+0000","last_fullsized":"2024-09-15T22:10:06.747043+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:46.067886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696289+0000","last_change":"2024-09-15T22:09:56.696993+0000","last_active":"2024-09-15T22:09:58.696289+0000","last_peered":"2024-09-15T22:09:58.696289+0000","last_clean":"2024-09-15T22:09:58.696289+0000","last_became_active":"2024-09-15T22:09:56.696532+0000","last_became_peered":"2024-09-15T22:09:56.696532+0000","last_unstale":"2024-09-15T22:09:58.696289+0000","last_undegraded":"2024-09-15T22:09:58.696289+0000","last_fullsized":"2024-09-15T22:09:58.696289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:56.385349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.695532+0000","last_change":"2024-09-15T22:09:56.703181+0000","last_active":"2024-09-15T22:09:58.695532+0000","last_peered":"2024-09-15T22:09:58.695532+0000","last_clean":"2024-09-15T22:09:58.695532+0000","last_became_active":"2024-09-15T22:09:56.702816+0000","last_became_peered":"2024-09-15T22:09:56.702816+0000","last_unstale":"2024-09-15T22:09:58.695532+0000","last_undegraded":"2024-09-15T22:09:58.695532+0000","last_fullsized":"2024-09-15T22:09:58.695532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:31.123151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:09.791161+0000","last_change":"2024-09-15T22:09:54.220621+0000","last_active":"2024-09-15T22:10:09.791161+0000","last_peered":"2024-09-15T22:10:09.791161+0000","last_clean":"2024-09-15T22:10:09.791161+0000","last_became_active":"2024-09-15T22:09:54.220280+0000","last_became_peered":"2024-09-15T22:09:54.220280+0000","last_unstale":"2024-09-15T22:10:09.791161+0000","last_undegraded":"2024-09-15T22:10:09.791161+0000","last_fullsized":"2024-09-15T22:10:09.791161+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:33.037698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.691515+0000","last_change":"2024-09-15T22:09:56.693653+0000","last_active":"2024-09-15T22:09:58.691515+0000","last_peered":"2024-09-15T22:09:58.691515+0000","last_clean":"2024-09-15T22:09:58.691515+0000","last_became_active":"2024-09-15T22:09:56.692756+0000","last_became_peered":"2024-09-15T22:09:56.692756+0000","last_unstale":"2024-09-15T22:09:58.691515+0000","last_undegraded":"2024-09-15T22:09:58.691515+0000","last_fullsized":"2024-09-15T22:09:58.691515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:19.607542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:10.797732+0000","last_change":"2024-09-15T22:09:54.218597+0000","last_active":"2024-09-15T22:10:10.797732+0000","last_peered":"2024-09-15T22:10:10.797732+0000","last_clean":"2024-09-15T22:10:10.797732+0000","last_became_active":"2024-09-15T22:09:54.218150+0000","last_became_peered":"2024-09-15T22:09:54.218150+0000","last_unstale":"2024-09-15T22:10:10.797732+0000","last_undegraded":"2024-09-15T22:10:10.797732+0000","last_fullsized":"2024-09-15T22:10:10.797732+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:24.733207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.696820+0000","last_change":"2024-09-15T22:09:56.692795+0000","last_active":"2024-09-15T22:09:58.696820+0000","last_peered":"2024-09-15T22:09:58.696820+0000","last_clean":"2024-09-15T22:09:58.696820+0000","last_became_active":"2024-09-15T22:09:56.692425+0000","last_became_peered":"2024-09-15T22:09:56.692425+0000","last_unstale":"2024-09-15T22:09:58.696820+0000","last_undegraded":"2024-09-15T22:09:58.696820+0000","last_fullsized":"2024-09-15T22:09:58.696820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:45.920502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.699366+0000","last_change":"2024-09-15T22:09:54.476726+0000","last_active":"2024-09-15T22:09:58.699366+0000","last_peered":"2024-09-15T22:09:58.699366+0000","last_clean":"2024-09-15T22:09:58.699366+0000","last_became_active":"2024-09-15T22:09:54.476317+0000","last_became_peered":"2024-09-15T22:09:54.476317+0000","last_unstale":"2024-09-15T22:09:58.699366+0000","last_undegraded":"2024-09-15T22:09:58.699366+0000","last_fullsized":"2024-09-15T22:09:58.699366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:48.361958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:09:58.693281+0000","last_change":"2024-09-15T22:09:56.701501+0000","last_active":"2024-09-15T22:09:58.693281+0000","last_peered":"2024-09-15T22:09:58.693281+0000","last_clean":"2024-09-15T22:09:58.693281+0000","last_became_active":"2024-09-15T22:09:56.701166+0000","last_became_peered":"2024-09-15T22:09:56.701166+0000","last_unstale":"2024-09-15T22:09:58.693281+0000","last_undegraded":"2024-09-15T22:09:58.693281+0000","last_fullsized":"2024-09-15T22:09:58.693281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:20.698770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-15T22:10:21.814138+0000","last_change":"2024-09-15T22:09:54.216841+0000","last_active":"2024-09-15T22:10:21.814138+0000","last_peered":"2024-09-15T22:10:21.814138+0000","last_clean":"2024-09-15T22:10:21.814138+0000","last_became_active":"2024-09-15T22:09:54.216458+0000","last_became_peered":"2024-09-15T22:09:54.216458+0000","last_unstale":"2024-09-15T22:10:21.814138+0000","last_undegraded":"2024-09-15T22:10:21.814138+0000","last_fullsized":"2024-09-15T22:10:21.814138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.116014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":176,"num_read_kb":148,"num_write":230,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":176137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612627,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1065370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":427076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":427454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659181,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":426793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888115,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1511424,"data_stored":1019259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":427047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":426618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":474728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607623,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":482151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":428132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:10:28.834 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:10:28.835 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T22:10:28.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T22:10:29.204 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:29.508 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:29 smithi150 ceph-mon[30886]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:10:29.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:29 smithi154 ceph-mon[34853]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:10:29.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:29 smithi169 ceph-mon[35850]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 -- 172.21.15.150:0/3475473152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 msgr2=0x7f14cc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 --2- 172.21.15.150:0/3475473152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 0x7f14cc103280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009900 tx=0x7f14b802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 -- 172.21.15.150:0/3475473152 shutdown_connections 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 --2- 172.21.15.150:0/3475473152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc1037c0 0x7f14cc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 --2- 172.21.15.150:0/3475473152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 0x7f14cc103280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 --2- 172.21.15.150:0/3475473152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14cc101c00 0x7f14cc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 -- 172.21.15.150:0/3475473152 >> 172.21.15.150:0/3475473152 conn(0x7f14cc0fd390 msgr2=0x7f14cc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:29.811 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.808+0000 7f14d3c00640 1 -- 172.21.15.150:0/3475473152 shutdown_connections 2024-09-15T22:10:29.812 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.809+0000 7f14d3c00640 1 -- 172.21.15.150:0/3475473152 wait complete. 2024-09-15T22:10:29.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.809+0000 7f14d3c00640 1 Processor -- start 2024-09-15T22:10:29.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 -- start start 2024-09-15T22:10:29.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 0x7f14cc19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 0x7f14cc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14cc1037c0 0x7f14cc1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc10d8d0 con 0x7f14cc101c00 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc10d750 con 0x7f14cc102e00 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d3c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc10da50 con 0x7f14cc1037c0 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 0x7f14cc19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 0x7f14cc19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35632/0 (socket says 172.21.15.150:35632) 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d1200640 1 -- 172.21.15.150:0/1138878707 learned_addr learned my addr 172.21.15.150:0/1138878707 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14cbe00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 0x7f14cc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.810+0000 7f14d1c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14cc1037c0 0x7f14cc1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d1200640 1 -- 172.21.15.150:0/1138878707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14cc1037c0 msgr2=0x7f14cc1a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d1200640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14cc1037c0 0x7f14cc1a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:29.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d1200640 1 -- 172.21.15.150:0/1138878707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 msgr2=0x7f14cc19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d1200640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 0x7f14cc19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d1200640 1 -- 172.21.15.150:0/1138878707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc1a1da0 con 0x7f14cc101c00 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d1200640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 0x7f14cc19a170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f14c000e9c0 tx=0x7f14c000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c000ccc0 con 0x7f14cc101c00 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14c00035f0 con 0x7f14cc101c00 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c000ce60 con 0x7f14cc101c00 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.811+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc1a2090 con 0x7f14cc101c00 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.812+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc1a2550 con 0x7f14cc101c00 2024-09-15T22:10:29.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.813+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc1a2860 con 0x7f14cc101c00 2024-09-15T22:10:29.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.815+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f14c00037a0 con 0x7f14cc101c00 2024-09-15T22:10:29.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.816+0000 7f14c9600640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14b40a3300 0x7f14b40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:29.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.816+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14c00cfe10 con 0x7f14cc101c00 2024-09-15T22:10:29.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.816+0000 7f14cbe00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14b40a3300 0x7f14b40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:29.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.817+0000 7f14cbe00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14b40a3300 0x7f14b40a57c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14b8031440 tx=0x7f14b80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:29.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:29.818+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14c009ca80 con 0x7f14cc101c00 2024-09-15T22:10:30.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.069+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f14cc1a2a30 con 0x7f14cc101c00 2024-09-15T22:10:30.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.073+0000 7f14c9600640 1 -- 172.21.15.150:0/1138878707 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f14c009c380 con 0x7f14cc101c00 2024-09-15T22:10:30.075 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-15T22:10:30.075 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQBWW+dmZCZDBBAAUhx+C7HftrQrIMKvDWWrHQ== 2024-09-15T22:10:30.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14b40a3300 msgr2=0x7f14b40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:30.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14b40a3300 0x7f14b40a57c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14b8031440 tx=0x7f14b80315b0 comp rx=0 tx=0).stop 2024-09-15T22:10:30.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 msgr2=0x7f14cc19a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:30.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 0x7f14cc19a170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f14c000e9c0 tx=0x7f14c000edc0 comp rx=0 tx=0).stop 2024-09-15T22:10:30.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 shutdown_connections 2024-09-15T22:10:30.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14cc1037c0 0x7f14cc1a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:30.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14cc102e00 0x7f14cc19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:30.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14b40a3300 0x7f14b40a57c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:30.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 --2- 172.21.15.150:0/1138878707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14cc101c00 0x7f14cc19a170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:30.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 >> 172.21.15.150:0/1138878707 conn(0x7f14cc0fd390 msgr2=0x7f14cc074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:30.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 shutdown_connections 2024-09-15T22:10:30.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:30.076+0000 7f14d3c00640 1 -- 172.21.15.150:0/1138878707 wait complete. 2024-09-15T22:10:30.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:30 smithi150 ceph-mon[30886]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-15T22:10:30.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:30 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1138878707' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:10:30.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:30 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1138878707' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:10:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:30 smithi154 ceph-mon[34853]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-15T22:10:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:30 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1138878707' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:10:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:30 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1138878707' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:10:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:30 smithi169 ceph-mon[35850]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-15T22:10:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:30 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1138878707' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:10:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:30 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1138878707' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:10:30.954 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:10:30.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T22:10:30.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:10:31.037 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:10:31.037 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:10:31.037 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T22:10:31.450 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:32.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.019+0000 7f2261200640 1 -- 172.21.15.150:0/813880935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c101de0 msgr2=0x7f225c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:32.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.019+0000 7f2261200640 1 --2- 172.21.15.150:0/813880935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c101de0 0x7f225c1021c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f224c009900 tx=0x7f224c02a410 comp rx=0 tx=0).stop 2024-09-15T22:10:32.022 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 -- 172.21.15.150:0/813880935 shutdown_connections 2024-09-15T22:10:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 --2- 172.21.15.150:0/813880935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c106f10 0x7f225c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 --2- 172.21.15.150:0/813880935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f225c102790 0x7f225c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 --2- 172.21.15.150:0/813880935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c101de0 0x7f225c1021c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 -- 172.21.15.150:0/813880935 >> 172.21.15.150:0/813880935 conn(0x7f225c0fd8c0 msgr2=0x7f225c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 -- 172.21.15.150:0/813880935 shutdown_connections 2024-09-15T22:10:32.023 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.020+0000 7f2261200640 1 -- 172.21.15.150:0/813880935 wait complete. 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.021+0000 7f2261200640 1 Processor -- start 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.021+0000 7f2261200640 1 -- start start 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2261200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 0x7f225c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2261200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f225c102790 0x7f225c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2261200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c106f10 0x7f225c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2261200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f225c111f70 con 0x7f225c106f10 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2261200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f225c111df0 con 0x7f225c101de0 2024-09-15T22:10:32.025 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2261200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1120f0 con 0x7f225c102790 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 0x7f225c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 0x7f225c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:56264/0 (socket says 172.21.15.150:56264) 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 -- 172.21.15.150:0/1257218459 learned_addr learned my addr 172.21.15.150:0/1257218459 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f225a800640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c106f10 0x7f225c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2253e00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f225c102790 0x7f225c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 -- 172.21.15.150:0/1257218459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f225c102790 msgr2=0x7f225c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f225c102790 0x7f225c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 -- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c106f10 msgr2=0x7f225c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c106f10 0x7f225c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.022+0000 7f2259e00640 1 -- 172.21.15.150:0/1257218459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c19d3c0 con 0x7f225c101de0 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.023+0000 7f2259e00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 0x7f225c198410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f224c006010 tx=0x7f224c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.023+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c03f030 con 0x7f225c101de0 2024-09-15T22:10:32.026 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.023+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f224c004440 con 0x7f225c101de0 2024-09-15T22:10:32.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.023+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c035070 con 0x7f225c101de0 2024-09-15T22:10:32.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.023+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225c19d650 con 0x7f225c101de0 2024-09-15T22:10:32.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.023+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225c19dae0 con 0x7f225c101de0 2024-09-15T22:10:32.027 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.024+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225c1021c0 con 0x7f225c101de0 2024-09-15T22:10:32.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.027+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f224c042030 con 0x7f225c101de0 2024-09-15T22:10:32.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.028+0000 7f2252a00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22400a3350 0x7f22400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:32.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.028+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f224c0f02c0 con 0x7f225c101de0 2024-09-15T22:10:32.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.029+0000 7f2253e00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22400a3350 0x7f22400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:32.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.029+0000 7f2253e00640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22400a3350 0x7f22400a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f225c0fdd50 tx=0x7f2244005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:32.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.029+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f224c049030 con 0x7f225c101de0 2024-09-15T22:10:32.252 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.250+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f225c10a0f0 con 0x7f225c101de0 2024-09-15T22:10:32.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.259+0000 7f2252a00640 1 -- 172.21.15.150:0/1257218459 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264059 (secure 0 0 0) 0x7f224c0bcff0 con 0x7f225c101de0 2024-09-15T22:10:32.265 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:32.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22400a3350 msgr2=0x7f22400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:32.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22400a3350 0x7f22400a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f225c0fdd50 tx=0x7f2244005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 msgr2=0x7f225c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 0x7f225c198410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f224c006010 tx=0x7f224c004040 comp rx=0 tx=0).stop 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 shutdown_connections 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22400a3350 0x7f22400a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f225c106f10 0x7f225c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f225c102790 0x7f225c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 --2- 172.21.15.150:0/1257218459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225c101de0 0x7f225c198410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:32.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 >> 172.21.15.150:0/1257218459 conn(0x7f225c0fd8c0 msgr2=0x7f225c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:32.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.264+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 shutdown_connections 2024-09-15T22:10:32.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:32.265+0000 7f2261200640 1 -- 172.21.15.150:0/1257218459 wait complete. 2024-09-15T22:10:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:32 smithi154 ceph-mon[34853]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:10:32.632 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:32 smithi150 ceph-mon[30886]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:10:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:32 smithi169 ceph-mon[35850]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:10:33.111 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1242932536},{"type":"v1","addr":"172.21.15.150:6801","nonce":1242932536}]},"active_addr":"172.21.15.150:6801/1242932536","active_change":"2024-09-15T22:02:43.046745+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.150:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3540537585}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3823234340}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3558756482}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2942053054}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":1607379964}]}]} 2024-09-15T22:10:33.118 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T22:10:33.119 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T22:10:33.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:10:33.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:33 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1257218459' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:10:33.490 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:33.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:33 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1257218459' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:10:33.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:33 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1257218459' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:10:34.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 -- 172.21.15.150:0/1977902750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec10e3c0 msgr2=0x7f7eec110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:34.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/1977902750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec10e3c0 0x7f7eec110810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009ca0 tx=0x7f7ee402a950 comp rx=0 tx=0).stop 2024-09-15T22:10:34.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 -- 172.21.15.150:0/1977902750 shutdown_connections 2024-09-15T22:10:34.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/1977902750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec10e3c0 0x7f7eec110810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/1977902750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7eec074f40 0x7f7eec10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/1977902750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7eec074620 0x7f7eec074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 -- 172.21.15.150:0/1977902750 >> 172.21.15.150:0/1977902750 conn(0x7f7eec0fd8c0 msgr2=0x7f7eec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:34.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 -- 172.21.15.150:0/1977902750 shutdown_connections 2024-09-15T22:10:34.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.005+0000 7f7ef1c00640 1 -- 172.21.15.150:0/1977902750 wait complete. 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 Processor -- start 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 -- start start 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7eec074620 0x7f7eec19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 0x7f7eec19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7eec10e3c0 0x7f7eec19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1141b0 con 0x7f7eec074f40 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec114030 con 0x7f7eec10e3c0 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.006+0000 7f7ef1c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec114330 con 0x7f7eec074620 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 0x7f7eec19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 0x7f7eec19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35674/0 (socket says 172.21.15.150:35674) 2024-09-15T22:10:34.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 -- 172.21.15.150:0/2947493713 learned_addr learned my addr 172.21.15.150:0/2947493713 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7eeaa00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7eec074620 0x7f7eec19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7eeb400640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7eec10e3c0 0x7f7eec19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 -- 172.21.15.150:0/2947493713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7eec074620 msgr2=0x7f7eec19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7eec074620 0x7f7eec19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 -- 172.21.15.150:0/2947493713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7eec10e3c0 msgr2=0x7f7eec19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7eec10e3c0 0x7f7eec19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 -- 172.21.15.150:0/2947493713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec19f600 con 0x7f7eec074f40 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.007+0000 7f7ee2000640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 0x7f7eec19ab90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400e9f0 tx=0x7f7ed400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.008+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400cd80 con 0x7f7eec074f40 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.008+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed4010910 con 0x7f7eec074f40 2024-09-15T22:10:34.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.008+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4018990 con 0x7f7eec074f40 2024-09-15T22:10:34.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.008+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec19f8f0 con 0x7f7eec074f40 2024-09-15T22:10:34.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.008+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec1a71d0 con 0x7f7eec074f40 2024-09-15T22:10:34.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.009+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eec074a00 con 0x7f7eec074f40 2024-09-15T22:10:34.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.011+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7ed4010ac0 con 0x7f7eec074f40 2024-09-15T22:10:34.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.013+0000 7f7ee3e00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7ed00a32d0 0x7f7ed00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:34.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.013+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7ed40cfc80 con 0x7f7eec074f40 2024-09-15T22:10:34.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.013+0000 7f7eeaa00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7ed00a32d0 0x7f7ed00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:34.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.014+0000 7f7eeaa00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7ed00a32d0 0x7f7ed00a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009bd0 tx=0x7f7edc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:34.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.017+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ed409c2a0 con 0x7f7eec074f40 2024-09-15T22:10:34.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.193+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7eec1a7500 con 0x7f7eec074f40 2024-09-15T22:10:34.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.195+0000 7f7ee3e00640 1 -- 172.21.15.150:0/2947493713 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22348 (secure 0 0 0) 0x7f7ed40a05a0 con 0x7f7eec074f40 2024-09-15T22:10:34.197 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:34.197 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:09:57.693703+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:10:34.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7ed00a32d0 msgr2=0x7f7ed00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:34.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7ed00a32d0 0x7f7ed00a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009bd0 tx=0x7f7edc005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:34.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 msgr2=0x7f7eec19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:34.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 0x7f7eec19ab90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400e9f0 tx=0x7f7ed400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 shutdown_connections 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7eec10e3c0 0x7f7eec19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7ed00a32d0 0x7f7ed00a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec074f40 0x7f7eec19ab90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 --2- 172.21.15.150:0/2947493713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7eec074620 0x7f7eec19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 >> 172.21.15.150:0/2947493713 conn(0x7f7eec0fd8c0 msgr2=0x7f7eec0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 shutdown_connections 2024-09-15T22:10:34.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:34.197+0000 7f7ef1c00640 1 -- 172.21.15.150:0/2947493713 wait complete. 2024-09-15T22:10:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:34 smithi154 ceph-mon[34853]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:10:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:34 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2947493713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:34.538 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:34 smithi150 ceph-mon[30886]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:10:34.539 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:34 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2947493713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:34 smithi169 ceph-mon[35850]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:10:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:34 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2947493713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:35.005 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T22:10:35.005 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:10:35.372 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:35.929 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 -- 172.21.15.150:0/3818709090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34112a30 msgr2=0x7f9e34114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3818709090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34112a30 0x7f9e34114e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009ca0 tx=0x7f9e2c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 -- 172.21.15.150:0/3818709090 shutdown_connections 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3818709090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34112a30 0x7f9e34114e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3818709090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34077040 0x7f9e341124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3818709090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e34076720 0x7f9e34076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 -- 172.21.15.150:0/3818709090 >> 172.21.15.150:0/3818709090 conn(0x7f9e340ffa90 msgr2=0x7f9e34101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 -- 172.21.15.150:0/3818709090 shutdown_connections 2024-09-15T22:10:35.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.927+0000 7f9e3c200640 1 -- 172.21.15.150:0/3818709090 wait complete. 2024-09-15T22:10:35.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 Processor -- start 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 -- start start 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34076720 0x7f9e341a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 0x7f9e341a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e34112a30 0x7f9e3419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9e341185c0 con 0x7f9e34077040 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34118440 con 0x7f9e34076720 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.929+0000 7f9e3c200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34118740 con 0x7f9e34112a30 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e39800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34076720 0x7f9e341a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 0x7f9e341a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:35.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e39800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34076720 0x7f9e341a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:56306/0 (socket says 172.21.15.150:56306) 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 0x7f9e341a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35700/0 (socket says 172.21.15.150:35700) 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e39800640 1 -- 172.21.15.150:0/3833086957 learned_addr learned my addr 172.21.15.150:0/3833086957 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e3a200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e34112a30 0x7f9e3419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 -- 172.21.15.150:0/3833086957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e34112a30 msgr2=0x7f9e3419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e34112a30 0x7f9e3419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 -- 172.21.15.150:0/3833086957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34076720 msgr2=0x7f9e341a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34076720 0x7f9e341a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 -- 172.21.15.150:0/3833086957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3419efc0 con 0x7f9e34077040 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.930+0000 7f9e38e00640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 0x7f9e341a4c10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005fd0 tx=0x7f9e2000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.931+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20009c30 con 0x7f9e34077040 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.931+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e20009dd0 con 0x7f9e34077040 2024-09-15T22:10:35.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.931+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3419f2b0 con 0x7f9e34077040 2024-09-15T22:10:35.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.931+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20010460 con 0x7f9e34077040 2024-09-15T22:10:35.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.931+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e341ab5a0 con 0x7f9e34077040 2024-09-15T22:10:35.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.932+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e34076b00 con 0x7f9e34077040 2024-09-15T22:10:35.936 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.934+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9e20003f50 con 0x7f9e34077040 2024-09-15T22:10:35.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.936+0000 7f9e32000640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9e1c0a3350 0x7f9e1c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:35.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.936+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f9e200cf7e0 con 0x7f9e34077040 2024-09-15T22:10:35.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.936+0000 7f9e39800640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9e1c0a3350 0x7f9e1c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:35.938 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.937+0000 7f9e39800640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9e1c0a3350 0x7f9e1c0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e3419f9d0 tx=0x7f9e2800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:35.941 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:35.940+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e20017020 con 0x7f9e34077040 2024-09-15T22:10:36.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.115+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e3410dc20 con 0x7f9e34077040 2024-09-15T22:10:36.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.117+0000 7f9e32000640 1 -- 172.21.15.150:0/3833086957 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22348 (secure 0 0 0) 0x7f9e2009be00 con 0x7f9e34077040 2024-09-15T22:10:36.119 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:10:36.119 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":80,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:09:57.693703+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:10:36.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9e1c0a3350 msgr2=0x7f9e1c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9e1c0a3350 0x7f9e1c0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e3419f9d0 tx=0x7f9e2800b4a0 comp rx=0 tx=0).stop 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 msgr2=0x7f9e341a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 0x7f9e341a4c10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005fd0 tx=0x7f9e2000dde0 comp rx=0 tx=0).stop 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 shutdown_connections 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e34112a30 0x7f9e3419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9e1c0a3350 0x7f9e1c0a5810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e34077040 0x7f9e341a4c10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 --2- 172.21.15.150:0/3833086957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e34076720 0x7f9e341a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 >> 172.21.15.150:0/3833086957 conn(0x7f9e340ffa90 msgr2=0x7f9e34101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:36.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 shutdown_connections 2024-09-15T22:10:36.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:36.120+0000 7f9e3c200640 1 -- 172.21.15.150:0/3833086957 wait complete. 2024-09-15T22:10:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:36 smithi150 ceph-mon[30886]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-15T22:10:36.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:36 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3833086957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:36 smithi154 ceph-mon[34853]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-15T22:10:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:36 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3833086957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:36 smithi169 ceph-mon[35850]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-15T22:10:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:36 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3833086957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:10:36.903 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T22:10:36.904 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T22:10:36.904 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T22:10:36.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T22:10:36.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T22:10:36.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T22:10:36.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T22:10:36.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T22:10:36.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T22:10:36.908 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T22:10:36.908 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T22:10:36.909 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T22:10:37.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:37 smithi150 ceph-mon[30886]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-15T22:10:37.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:37 smithi154 ceph-mon[34853]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-15T22:10:37.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:37 smithi169 ceph-mon[35850]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-15T22:10:37.925 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.246 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.248 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.249 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.251 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.256 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.260 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.268 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.268 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.279 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.588 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.592 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:38.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 -- 172.21.15.150:0/443033259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50106f10 msgr2=0x7f7f5010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:38.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 --2- 172.21.15.150:0/443033259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50106f10 0x7f7f5010ea90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009ca0 tx=0x7f7f4802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 -- 172.21.15.150:0/443033259 shutdown_connections 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 --2- 172.21.15.150:0/443033259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50106f10 0x7f7f5010ea90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 --2- 172.21.15.150:0/443033259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f50102790 0x7f7f501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 --2- 172.21.15.150:0/443033259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50101de0 0x7f7f501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 -- 172.21.15.150:0/443033259 >> 172.21.15.150:0/443033259 conn(0x7f7f500fd8e0 msgr2=0x7f7f500ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 -- 172.21.15.150:0/443033259 shutdown_connections 2024-09-15T22:10:38.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.619+0000 7f7f57000640 1 -- 172.21.15.150:0/443033259 wait complete. 2024-09-15T22:10:38.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.620+0000 7f7f57000640 1 Processor -- start 2024-09-15T22:10:38.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.620+0000 7f7f57000640 1 -- start start 2024-09-15T22:10:38.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f57000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50101de0 0x7f7f500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:38.623 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f57000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50102790 0x7f7f50074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f57000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f50106f10 0x7f7f50074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f57000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50111fc0 con 0x7f7f50101de0 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f57000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50111e40 con 0x7f7f50102790 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f57000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50112140 con 0x7f7f50106f10 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f4fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50101de0 0x7f7f500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f4f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50102790 0x7f7f50074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f55000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f50106f10 0x7f7f50074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f4fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50101de0 0x7f7f500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35724/0 (socket says 172.21.15.150:35724) 2024-09-15T22:10:38.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.621+0000 7f7f4fe00640 1 -- 172.21.15.150:0/3932764328 learned_addr learned my addr 172.21.15.150:0/3932764328 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.622+0000 7f7f55000640 1 -- 172.21.15.150:0/3932764328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50102790 msgr2=0x7f7f50074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.622+0000 7f7f55000640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50102790 0x7f7f50074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.622+0000 7f7f55000640 1 -- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50101de0 msgr2=0x7f7f500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.622+0000 7f7f55000640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f50101de0 0x7f7f500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.622+0000 7f7f55000640 1 -- 172.21.15.150:0/3932764328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f501a68c0 con 0x7f7f50106f10 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.622+0000 7f7f55000640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f50106f10 0x7f7f50074f70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005e30 tx=0x7f7f48003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.623+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48031650 con 0x7f7f50106f10 2024-09-15T22:10:38.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.623+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f480317f0 con 0x7f7f50106f10 2024-09-15T22:10:38.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.623+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4802f990 con 0x7f7f50106f10 2024-09-15T22:10:38.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.623+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f501a6b50 con 0x7f7f50106f10 2024-09-15T22:10:38.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.623+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f501a7040 con 0x7f7f50106f10 2024-09-15T22:10:38.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.624+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f500628c0 con 0x7f7f50106f10 2024-09-15T22:10:38.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.626+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7f4802fb30 con 0x7f7f50106f10 2024-09-15T22:10:38.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.628+0000 7f7f4cc00640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7f340a3350 0x7f7f340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:38.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.628+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7f480f0cd0 con 0x7f7f50106f10 2024-09-15T22:10:38.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.628+0000 7f7f4fe00640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7f340a3350 0x7f7f340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:38.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.628+0000 7f7f4cc00640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] conn(0x7f7f340acba0 0x7f7f340aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:38.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.628+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 --> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f48040ec0 con 0x7f7f340acba0 2024-09-15T22:10:38.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.628+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f7f480f1080 con 0x7f7f50106f10 2024-09-15T22:10:38.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.629+0000 7f7f4f400640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] conn(0x7f7f340acba0 0x7f7f340aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:38.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.629+0000 7f7f4fe00640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7f340a3350 0x7f7f340a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009c90 tx=0x7f7f40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:38.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.629+0000 7f7f4f400640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] conn(0x7f7f340acba0 0x7f7f340aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:38.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.630+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== osd.8 v2:172.21.15.169:6816/2545784116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f48040ec0 con 0x7f7f340acba0 2024-09-15T22:10:38.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.646+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 --> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f50062d90 con 0x7f7f340acba0 2024-09-15T22:10:38.648 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f4cc00640 1 -- 172.21.15.150:0/3932764328 <== osd.8 v2:172.21.15.169:6816/2545784116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7f50062d90 con 0x7f7f340acba0 2024-09-15T22:10:38.649 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] conn(0x7f7f340acba0 msgr2=0x7f7f340aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:38.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f57000640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] conn(0x7f7f340acba0 0x7f7f340aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:38.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7f340a3350 msgr2=0x7f7f340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:38.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f57000640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7f340a3350 0x7f7f340a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009c90 tx=0x7f7f40005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:38.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f50106f10 msgr2=0x7f7f50074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:38.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.647+0000 7f7f57000640 1 --2- 172.21.15.150:0/3932764328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f50106f10 0x7f7f50074f70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005e30 tx=0x7f7f48003f10 comp rx=0 tx=0).stop 2024-09-15T22:10:38.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.648+0000 7f7f55000640 1 -- 172.21.15.150:0/3932764328 reap_dead start 2024-09-15T22:10:38.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.648+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 shutdown_connections 2024-09-15T22:10:38.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.648+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 >> 172.21.15.150:0/3932764328 conn(0x7f7f500fd8e0 msgr2=0x7f7f500feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:38.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.648+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 shutdown_connections 2024-09-15T22:10:38.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:38.648+0000 7f7f57000640 1 -- 172.21.15.150:0/3932764328 wait complete. 2024-09-15T22:10:39.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 -- 172.21.15.150:0/3360060919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 msgr2=0x7f743c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:39.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 --2- 172.21.15.150:0/3360060919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 0x7f743c074a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f742c009900 tx=0x7f742c02a480 comp rx=0 tx=0).stop 2024-09-15T22:10:39.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 -- 172.21.15.150:0/3360060919 shutdown_connections 2024-09-15T22:10:39.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 --2- 172.21.15.150:0/3360060919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c10e3c0 0x7f743c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:39.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 --2- 172.21.15.150:0/3360060919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f743c074f40 0x7f743c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:39.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 --2- 172.21.15.150:0/3360060919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 0x7f743c074a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:39.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 -- 172.21.15.150:0/3360060919 >> 172.21.15.150:0/3360060919 conn(0x7f743c0fd8c0 msgr2=0x7f743c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:39.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.792+0000 7f7443a00640 1 -- 172.21.15.150:0/3360060919 shutdown_connections 2024-09-15T22:10:39.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.793+0000 7f7443a00640 1 -- 172.21.15.150:0/3360060919 wait complete. 2024-09-15T22:10:39.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 Processor -- start 2024-09-15T22:10:39.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 -- start start 2024-09-15T22:10:39.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 0x7f743c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:39.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c074f40 0x7f743c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:39.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f743c10e3c0 0x7f743c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:39.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1141c0 con 0x7f743c074620 2024-09-15T22:10:39.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f743c114040 con 0x7f743c10e3c0 2024-09-15T22:10:39.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7443a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f743c114340 con 0x7f743c074f40 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7433e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c074f40 0x7f743c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7433e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c074f40 0x7f743c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:42340/0 (socket says 172.21.15.150:42340) 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7433e00640 1 -- 172.21.15.150:0/1337568432 learned_addr learned my addr 172.21.15.150:0/1337568432 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.794+0000 7f7441000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 0x7f743c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7441a00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f743c10e3c0 0x7f743c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7433e00640 1 -- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f743c10e3c0 msgr2=0x7f743c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7433e00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f743c10e3c0 0x7f743c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7433e00640 1 -- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 msgr2=0x7f743c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:39.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7433e00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c074620 0x7f743c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:39.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7433e00640 1 -- 172.21.15.150:0/1337568432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c19f640 con 0x7f743c074f40 2024-09-15T22:10:39.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f7433e00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c074f40 0x7f743c19abd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f742400d950 tx=0x7f742400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:39.801 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.795+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424017030 con 0x7f743c074f40 2024-09-15T22:10:39.804 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.796+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c19f930 con 0x7f743c074f40 2024-09-15T22:10:39.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.796+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7424004020 con 0x7f743c074f40 2024-09-15T22:10:39.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.796+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240047a0 con 0x7f743c074f40 2024-09-15T22:10:39.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.796+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c1a7210 con 0x7f743c074f40 2024-09-15T22:10:39.805 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.796+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f743c062980 con 0x7f743c074f40 2024-09-15T22:10:39.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.799+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f74240041d0 con 0x7f743c074f40 2024-09-15T22:10:39.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.800+0000 7f743a000640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f74200a32d0 0x7f74200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:39.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.800+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f74240cfa10 con 0x7f743c074f40 2024-09-15T22:10:39.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.800+0000 7f7441000640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f74200a32d0 0x7f74200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:39.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.801+0000 7f743a000640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] conn(0x7f74200acb20 0x7f74200aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:39.806 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.801+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 --> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74200af5f0 con 0x7f74200acb20 2024-09-15T22:10:39.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.801+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f74240cfdc0 con 0x7f743c074f40 2024-09-15T22:10:39.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.801+0000 7f7441000640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f74200a32d0 0x7f74200a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:39.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.801+0000 7f7441a00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] conn(0x7f74200acb20 0x7f74200aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:39.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.802+0000 7f7441a00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] conn(0x7f74200acb20 0x7f74200aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:39.807 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.803+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== osd.10 v2:172.21.15.154:6824/3374528953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74200af5f0 con 0x7f74200acb20 2024-09-15T22:10:39.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.817+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 --> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f743c062d80 con 0x7f74200acb20 2024-09-15T22:10:39.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f743a000640 1 -- 172.21.15.150:0/1337568432 <== osd.10 v2:172.21.15.154:6824/3374528953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f743c062d80 con 0x7f74200acb20 2024-09-15T22:10:39.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] conn(0x7f74200acb20 msgr2=0x7f74200aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:39.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] conn(0x7f74200acb20 0x7f74200aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:39.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f74200a32d0 msgr2=0x7f74200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:39.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f74200a32d0 0x7f74200a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c005b50 comp rx=0 tx=0).stop 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c074f40 msgr2=0x7f743c19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 --2- 172.21.15.150:0/1337568432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f743c074f40 0x7f743c19abd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f742400d950 tx=0x7f742400de10 comp rx=0 tx=0).stop 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7441a00640 1 -- 172.21.15.150:0/1337568432 reap_dead start 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 shutdown_connections 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.818+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 >> 172.21.15.150:0/1337568432 conn(0x7f743c0fd8c0 msgr2=0x7f743c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.819+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 shutdown_connections 2024-09-15T22:10:39.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:39.819+0000 7f7443a00640 1 -- 172.21.15.150:0/1337568432 wait complete. 2024-09-15T22:10:40.345 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:40 smithi150 ceph-mon[30886]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 -- 172.21.15.150:0/2649726411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 msgr2=0x7f1484112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 --2- 172.21.15.150:0/2649726411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 0x7f1484112330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1470009900 tx=0x7f147002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 -- 172.21.15.150:0/2649726411 shutdown_connections 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 --2- 172.21.15.150:0/2649726411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484112870 0x7f1484114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 --2- 172.21.15.150:0/2649726411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 0x7f1484112330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 --2- 172.21.15.150:0/2649726411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1484076720 0x7f1484076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 -- 172.21.15.150:0/2649726411 >> 172.21.15.150:0/2649726411 conn(0x7f14840ff910 msgr2=0x7f1484101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 -- 172.21.15.150:0/2649726411 shutdown_connections 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.336+0000 7f1483200640 1 -- 172.21.15.150:0/2649726411 wait complete. 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 Processor -- start 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 -- start start 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484076720 0x7f14841a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 0x7f14841a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1484112870 0x7f148419e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1484118400 con 0x7f1484076720 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1484118280 con 0x7f1484112870 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.337+0000 7f1483200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1484118580 con 0x7f1484077040 2024-09-15T22:10:40.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484076720 0x7f14841a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484076720 0x7f14841a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46232/0 (socket says 172.21.15.150:46232) 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 -- 172.21.15.150:0/527267523 learned_addr learned my addr 172.21.15.150:0/527267523 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481400640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 0x7f14841a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1482800640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1484112870 0x7f148419e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 -- 172.21.15.150:0/527267523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 msgr2=0x7f14841a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1484077040 0x7f14841a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 -- 172.21.15.150:0/527267523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1484112870 msgr2=0x7f148419e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1484112870 0x7f148419e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 -- 172.21.15.150:0/527267523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148419efe0 con 0x7f1484076720 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f1481e00640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484076720 0x7f14841a46a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f147400e9f0 tx=0x7f147400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:40.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.338+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400ccc0 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.339+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148419f2d0 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.339+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147400ce60 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.339+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14841ab620 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.339+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474018630 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.339+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1484062940 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.341+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f14740046c0 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f147aa00640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14680a32d0 0x7f14680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14740d07f0 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f1481400640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14680a32d0 0x7f14680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f147aa00640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] conn(0x7f14680acb20 0x7f14680aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 --> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1474017e50 con 0x7f14680acb20 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f14740d0ba0 con 0x7f1484076720 2024-09-15T22:10:40.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.343+0000 7f1482800640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] conn(0x7f14680acb20 0x7f14680aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.344+0000 7f1481400640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14680a32d0 0x7f14680a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1470009230 tx=0x7f14700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:40.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.344+0000 7f1482800640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] conn(0x7f14680acb20 0x7f14680aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:40.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.345+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== osd.0 v2:172.21.15.150:6802/1337195961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1474017e50 con 0x7f14680acb20 2024-09-15T22:10:40.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 --> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1484062dc0 con 0x7f14680acb20 2024-09-15T22:10:40.361 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f147aa00640 1 -- 172.21.15.150:0/527267523 <== osd.0 v2:172.21.15.150:6802/1337195961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1484062dc0 con 0x7f14680acb20 2024-09-15T22:10:40.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] conn(0x7f14680acb20 msgr2=0x7f14680aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] conn(0x7f14680acb20 0x7f14680aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14680a32d0 msgr2=0x7f14680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f14680a32d0 0x7f14680a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1470009230 tx=0x7f14700058d0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484076720 msgr2=0x7f14841a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1483200640 1 --2- 172.21.15.150:0/527267523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1484076720 0x7f14841a46a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f147400e9f0 tx=0x7f147400edf0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.360+0000 7f1482800640 1 -- 172.21.15.150:0/527267523 reap_dead start 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.361+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 shutdown_connections 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.361+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 >> 172.21.15.150:0/527267523 conn(0x7f14840ff910 msgr2=0x7f1484101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.361+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 shutdown_connections 2024-09-15T22:10:40.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.361+0000 7f1483200640 1 -- 172.21.15.150:0/527267523 wait complete. 2024-09-15T22:10:40.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:40 smithi169 ceph-mon[35850]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-15T22:10:40.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:40 smithi154 ceph-mon[34853]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-15T22:10:40.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 -- 172.21.15.150:0/728984536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc108f60 msgr2=0x7fe6cc110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 --2- 172.21.15.150:0/728984536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc108f60 0x7fe6cc110ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009ca0 tx=0x7fe6c402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 -- 172.21.15.150:0/728984536 shutdown_connections 2024-09-15T22:10:40.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 --2- 172.21.15.150:0/728984536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc108f60 0x7fe6cc110ae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.930 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 --2- 172.21.15.150:0/728984536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 --2- 172.21.15.150:0/728984536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc103e30 0x7fe6cc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.569+0000 7fe6d3000640 1 -- 172.21.15.150:0/728984536 >> 172.21.15.150:0/728984536 conn(0x7fe6cc0ff8d0 msgr2=0x7fe6cc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.570+0000 7fe6d3000640 1 -- 172.21.15.150:0/728984536 shutdown_connections 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.570+0000 7fe6d3000640 1 -- 172.21.15.150:0/728984536 wait complete. 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.570+0000 7fe6d3000640 1 Processor -- start 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 -- start start 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc114010 con 0x7fe6cc1047e0 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc113e90 con 0x7fe6cc108f60 2024-09-15T22:10:40.931 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d3000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc114190 con 0x7fe6cc103e30 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d1c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46252/0 (socket says 172.21.15.150:46252) 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d1200640 1 -- 172.21.15.150:0/1381741611 learned_addr learned my addr 172.21.15.150:0/1381741611 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.571+0000 7fe6d2600640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1200640 1 -- 172.21.15.150:0/1381741611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6cc103e30 msgr2=0x7fe6cc19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1200640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1200640 1 -- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc108f60 msgr2=0x7fe6cc19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1200640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1200640 1 -- 172.21.15.150:0/1381741611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc19f3c0 con 0x7fe6cc1047e0 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1c00640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:40.932 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d1200640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800d950 tx=0x7fe6b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8017030 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6b8004020 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6cc19f6b0 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80047a0 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.572+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6cc1a6f90 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.573+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6cc062940 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.575+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe6b80041d0 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6ca000640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6b40a32d0 0x7fe6b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe6b80cf8a0 con 0x7fe6cc1047e0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6d1c00640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6b40a32d0 0x7fe6b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6ca000640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] conn(0x7fe6b40acb20 0x7fe6b40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:40.933 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 --> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6b40af5f0 con 0x7fe6b40acb20 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fe6b80cfd80 con 0x7fe6cc1047e0 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.577+0000 7fe6d2600640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] conn(0x7fe6b40acb20 0x7fe6b40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.578+0000 7fe6d1c00640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6b40a32d0 0x7fe6b40a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0005d00 tx=0x7fe6c000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.578+0000 7fe6d2600640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] conn(0x7fe6b40acb20 0x7fe6b40aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.579+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== osd.1 v2:172.21.15.154:6800/1467569583 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6b40af5f0 con 0x7fe6b40acb20 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.593+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 --> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe6cc062dc0 con 0x7fe6b40acb20 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.593+0000 7fe6ca000640 1 -- 172.21.15.150:0/1381741611 <== osd.1 v2:172.21.15.154:6800/1467569583 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe6cc062dc0 con 0x7fe6b40acb20 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] conn(0x7fe6b40acb20 msgr2=0x7fe6b40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.934 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] conn(0x7fe6b40acb20 0x7fe6b40aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6b40a32d0 msgr2=0x7fe6b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6b40a32d0 0x7fe6b40a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0005d00 tx=0x7fe6c000b410 comp rx=0 tx=0).stop 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc1047e0 msgr2=0x7fe6cc19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 --2- 172.21.15.150:0/1381741611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800d950 tx=0x7fe6b800de10 comp rx=0 tx=0).stop 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d2600640 1 -- 172.21.15.150:0/1381741611 reap_dead start 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 shutdown_connections 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 >> 172.21.15.150:0/1381741611 conn(0x7fe6cc0ff8d0 msgr2=0x7fe6cc100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.594+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 shutdown_connections 2024-09-15T22:10:40.935 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:40.595+0000 7fe6d3000640 1 -- 172.21.15.150:0/1381741611 wait complete. 2024-09-15T22:10:41.544 INFO:teuthology.orchestra.run.smithi150.stdout:227633266725 2024-09-15T22:10:41.544 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T22:10:41.975 INFO:teuthology.orchestra.run.smithi150.stdout:283467841563 2024-09-15T22:10:41.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T22:10:42.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 -- 172.21.15.150:0/3723099436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d01079c0 msgr2=0x7fd0d0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 --2- 172.21.15.150:0/3723099436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d01079c0 0x7fd0d0107da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009930 tx=0x7fd0c002a440 comp rx=0 tx=0).stop 2024-09-15T22:10:42.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 -- 172.21.15.150:0/3723099436 shutdown_connections 2024-09-15T22:10:42.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 --2- 172.21.15.150:0/3723099436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d0102360 0x7fd0d010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 --2- 172.21.15.150:0/3723099436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0d01019c0 0x7fd0d0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 --2- 172.21.15.150:0/3723099436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d01079c0 0x7fd0d0107da0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.186+0000 7fd0d5600640 1 -- 172.21.15.150:0/3723099436 >> 172.21.15.150:0/3723099436 conn(0x7fd0d00fd740 msgr2=0x7fd0d00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.187+0000 7fd0d5600640 1 -- 172.21.15.150:0/3723099436 shutdown_connections 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.187+0000 7fd0d5600640 1 -- 172.21.15.150:0/3723099436 wait complete. 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 Processor -- start 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 -- start start 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d01019c0 0x7fd0d019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d0102360 0x7fd0d019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0d01079c0 0x7fd0d019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.198 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d0111e10 con 0x7fd0d0102360 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d0111c90 con 0x7fd0d01019c0 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.188+0000 7fd0d5600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d0111f90 con 0x7fd0d01079c0 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d01019c0 0x7fd0d019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cf400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d0102360 0x7fd0d019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0d4c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0d01079c0 0x7fd0d019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d01019c0 0x7fd0d019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54308/0 (socket says 172.21.15.150:54308) 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 -- 172.21.15.150:0/1794571826 learned_addr learned my addr 172.21.15.150:0/1794571826 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 -- 172.21.15.150:0/1794571826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0d01079c0 msgr2=0x7fd0d019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0d01079c0 0x7fd0d019ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 -- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d0102360 msgr2=0x7fd0d019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0d0102360 0x7fd0d019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 -- 172.21.15.150:0/1794571826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d019f4c0 con 0x7fd0d01019c0 2024-09-15T22:10:42.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.189+0000 7fd0cfe00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d01019c0 0x7fd0d019a510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0c002a960 tx=0x7fd0c0003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.190+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c003f070 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.190+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d019f750 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.190+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c0031c90 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.190+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0035030 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.190+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d01a7090 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.191+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0d00fe8b0 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.193+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd0c0042070 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.194+0000 7fd0ccc00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0b40a32d0 0x7fd0b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.194+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd0c00f03e0 con 0x7fd0d01019c0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.195+0000 7fd0cf400640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0b40a32d0 0x7fd0b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.195+0000 7fd0ccc00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] conn(0x7fd0b40acb20 0x7fd0b40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.195+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 --> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0b40af5f0 con 0x7fd0b40acb20 2024-09-15T22:10:42.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.195+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd0c00f0790 con 0x7fd0d01019c0 2024-09-15T22:10:42.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.195+0000 7fd0d4c00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] conn(0x7fd0b40acb20 0x7fd0b40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.195+0000 7fd0cf400640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0b40a32d0 0x7fd0b40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0d010ec90 tx=0x7fd0bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:42.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.196+0000 7fd0d4c00640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] conn(0x7fd0b40acb20 0x7fd0b40aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:42.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.197+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== osd.6 v2:172.21.15.150:6818/2947582295 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0b40af5f0 con 0x7fd0b40acb20 2024-09-15T22:10:42.213 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.211+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 --> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0d0103100 con 0x7fd0b40acb20 2024-09-15T22:10:42.214 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.212+0000 7fd0ccc00640 1 -- 172.21.15.150:0/1794571826 <== osd.6 v2:172.21.15.150:6818/2947582295 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd0d0103100 con 0x7fd0b40acb20 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] conn(0x7fd0b40acb20 msgr2=0x7fd0b40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] conn(0x7fd0b40acb20 0x7fd0b40aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0b40a32d0 msgr2=0x7fd0b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0b40a32d0 0x7fd0b40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0d010ec90 tx=0x7fd0bc005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d01019c0 msgr2=0x7fd0d019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 --2- 172.21.15.150:0/1794571826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0d01019c0 0x7fd0d019a510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0c002a960 tx=0x7fd0c0003b20 comp rx=0 tx=0).stop 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d4c00640 1 -- 172.21.15.150:0/1794571826 reap_dead start 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 shutdown_connections 2024-09-15T22:10:42.215 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 >> 172.21.15.150:0/1794571826 conn(0x7fd0d00fd740 msgr2=0x7fd0d00fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:42.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 shutdown_connections 2024-09-15T22:10:42.216 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.213+0000 7fd0d5600640 1 -- 172.21.15.150:0/1794571826 wait complete. 2024-09-15T22:10:42.440 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:42 smithi150 ceph-mon[30886]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-15T22:10:42.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:42 smithi169 ceph-mon[35850]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-15T22:10:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:42 smithi154 ceph-mon[34853]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-15T22:10:42.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 -- 172.21.15.150:0/3919563420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e8104010 msgr2=0x7fd0e81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3919563420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e8104010 0x7fd0e81043f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009900 tx=0x7fd0d802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 -- 172.21.15.150:0/3919563420 shutdown_connections 2024-09-15T22:10:42.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3919563420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0e8109140 0x7fd0e8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3919563420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e81049c0 0x7fd0e8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3919563420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e8104010 0x7fd0e81043f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 -- 172.21.15.150:0/3919563420 >> 172.21.15.150:0/3919563420 conn(0x7fd0e80ffa50 msgr2=0x7fd0e8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:42.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 -- 172.21.15.150:0/3919563420 shutdown_connections 2024-09-15T22:10:42.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.736+0000 7fd0eec00640 1 -- 172.21.15.150:0/3919563420 wait complete. 2024-09-15T22:10:42.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.737+0000 7fd0eec00640 1 Processor -- start 2024-09-15T22:10:42.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 -- start start 2024-09-15T22:10:42.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0e8104010 0x7fd0e819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e81049c0 0x7fd0e819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e8109140 0x7fd0e819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8114190 con 0x7fd0e81049c0 2024-09-15T22:10:42.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8114010 con 0x7fd0e8109140 2024-09-15T22:10:42.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0eec00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8114310 con 0x7fd0e8104010 2024-09-15T22:10:42.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0e7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0e8104010 0x7fd0e819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0df400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e81049c0 0x7fd0e819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0e7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0e8104010 0x7fd0e819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:42434/0 (socket says 172.21.15.150:42434) 2024-09-15T22:10:42.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0e7e00640 1 -- 172.21.15.150:0/3266983635 learned_addr learned my addr 172.21.15.150:0/3266983635 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:42.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.738+0000 7fd0ecc00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e8109140 0x7fd0e819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0df400640 1 -- 172.21.15.150:0/3266983635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0e8104010 msgr2=0x7fd0e819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0df400640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0e8104010 0x7fd0e819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0df400640 1 -- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e8109140 msgr2=0x7fd0e819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0df400640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0e8109140 0x7fd0e819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0df400640 1 -- 172.21.15.150:0/3266983635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e819f5c0 con 0x7fd0e81049c0 2024-09-15T22:10:42.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0df400640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e81049c0 0x7fd0e819ab50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e9f0 tx=0x7fd0d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:42.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d000ccc0 con 0x7fd0e81049c0 2024-09-15T22:10:42.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d0010910 con 0x7fd0e81049c0 2024-09-15T22:10:42.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0018960 con 0x7fd0e81049c0 2024-09-15T22:10:42.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.739+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e819f8b0 con 0x7fd0e81049c0 2024-09-15T22:10:42.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.740+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e81a7190 con 0x7fd0e81049c0 2024-09-15T22:10:42.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.741+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0e8062980 con 0x7fd0e81049c0 2024-09-15T22:10:42.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.742+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd0d0010ac0 con 0x7fd0e81049c0 2024-09-15T22:10:42.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.744+0000 7fd0e5600640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.744+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd0d00d0510 con 0x7fd0e81049c0 2024-09-15T22:10:42.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.744+0000 7fd0e7e00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.744+0000 7fd0e5600640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] conn(0x7fd0cc0acba0 0x7fd0cc0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:42.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.744+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 --> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0d0028ea0 con 0x7fd0cc0acba0 2024-09-15T22:10:42.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.744+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd0d00d08c0 con 0x7fd0e81049c0 2024-09-15T22:10:42.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.745+0000 7fd0ecc00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] conn(0x7fd0cc0acba0 0x7fd0cc0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:42.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.745+0000 7fd0e7e00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80096c0 tx=0x7fd0d80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:42.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.745+0000 7fd0ecc00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] conn(0x7fd0cc0acba0 0x7fd0cc0aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:42.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.746+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== osd.4 v2:172.21.15.154:6808/3739544078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0d0028ea0 con 0x7fd0cc0acba0 2024-09-15T22:10:42.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.768+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 --> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0e8062e50 con 0x7fd0cc0acba0 2024-09-15T22:10:42.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0e5600640 1 -- 172.21.15.150:0/3266983635 <== osd.4 v2:172.21.15.154:6808/3739544078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd0e8062e50 con 0x7fd0cc0acba0 2024-09-15T22:10:42.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] conn(0x7fd0cc0acba0 msgr2=0x7fd0cc0aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] conn(0x7fd0cc0acba0 0x7fd0cc0aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0cc0a3350 msgr2=0x7fd0cc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80096c0 tx=0x7fd0d80046c0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e81049c0 msgr2=0x7fd0e819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 --2- 172.21.15.150:0/3266983635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e81049c0 0x7fd0e819ab50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e9f0 tx=0x7fd0d000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:10:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0ecc00640 1 -- 172.21.15.150:0/3266983635 reap_dead start 2024-09-15T22:10:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 shutdown_connections 2024-09-15T22:10:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.769+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 >> 172.21.15.150:0/3266983635 conn(0x7fd0e80ffa50 msgr2=0x7fd0e8100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.770+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 shutdown_connections 2024-09-15T22:10:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:42.770+0000 7fd0eec00640 1 -- 172.21.15.150:0/3266983635 wait complete. 2024-09-15T22:10:43.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8, 3, 6]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-15T22:10:43.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-09-15T22:10:43.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8, 3, 6]}]: dispatch 2024-09-15T22:10:43.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-15T22:10:43.523 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]: dispatch 2024-09-15T22:10:43.659 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8, 3, 6]}]: dispatch 2024-09-15T22:10:43.660 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-15T22:10:43.660 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-09-15T22:10:43.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 -- 172.21.15.150:0/1885404879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8104010 msgr2=0x7f71b81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:43.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 --2- 172.21.15.150:0/1885404879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8104010 0x7f71b81043f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a802a410 comp rx=0 tx=0).stop 2024-09-15T22:10:43.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 -- 172.21.15.150:0/1885404879 shutdown_connections 2024-09-15T22:10:43.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 --2- 172.21.15.150:0/1885404879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8109140 0x7f71b8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 --2- 172.21.15.150:0/1885404879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71b81049c0 0x7f71b8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 --2- 172.21.15.150:0/1885404879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8104010 0x7f71b81043f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 -- 172.21.15.150:0/1885404879 >> 172.21.15.150:0/1885404879 conn(0x7f71b80ffa50 msgr2=0x7f71b8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:43.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 -- 172.21.15.150:0/1885404879 shutdown_connections 2024-09-15T22:10:43.775 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.772+0000 7f71bf200640 1 -- 172.21.15.150:0/1885404879 wait complete. 2024-09-15T22:10:43.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.773+0000 7f71bf200640 1 Processor -- start 2024-09-15T22:10:43.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.773+0000 7f71bf200640 1 -- start start 2024-09-15T22:10:43.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.773+0000 7f71bf200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8104010 0x7f71b819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:43.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71bf200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71b81049c0 0x7f71b819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:43.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71bf200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8109140 0x7f71b819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71bf200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f71b8114160 con 0x7f71b8109140 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71bf200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71b8113fe0 con 0x7f71b8104010 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71bf200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71b81142e0 con 0x7f71b81049c0 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8104010 0x7f71b819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8104010 0x7f71b819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54352/0 (socket says 172.21.15.150:54352) 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71bd200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8109140 0x7f71b819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 -- 172.21.15.150:0/519719934 learned_addr learned my addr 172.21.15.150:0/519719934 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7400640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71b81049c0 0x7f71b819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 -- 172.21.15.150:0/519719934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71b81049c0 msgr2=0x7f71b819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71b81049c0 0x7f71b819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 -- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8109140 msgr2=0x7f71b819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:43.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8109140 0x7f71b819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7e00640 1 -- 172.21.15.150:0/519719934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b819f610 con 0x7f71b8104010 2024-09-15T22:10:43.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.774+0000 7f71b7400640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71b81049c0 0x7f71b819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:43.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.775+0000 7f71b7e00640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8104010 0x7f71b819a660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71a8006010 tx=0x7f71a80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:43.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.775+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a803f030 con 0x7f71b8104010 2024-09-15T22:10:43.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.775+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b819f8a0 con 0x7f71b8104010 2024-09-15T22:10:43.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.775+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a8003ce0 con 0x7f71b8104010 2024-09-15T22:10:43.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.775+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8035070 con 0x7f71b8104010 2024-09-15T22:10:43.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.775+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b81a71e0 con 0x7f71b8104010 2024-09-15T22:10:43.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.776+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71b8062980 con 0x7f71b8104010 2024-09-15T22:10:43.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.778+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f71a8042030 con 0x7f71b8104010 2024-09-15T22:10:43.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b4c00640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f719c0a3350 0x7f719c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8248+0+0 (secure 0 0 0) 0x7f71a80f0610 con 0x7f71b8104010 2024-09-15T22:10:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b7400640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f719c0a3350 0x7f719c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b4c00640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] conn(0x7f719c0acf80 0x7f719c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 --> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71a8036e90 con 0x7f719c0acf80 2024-09-15T22:10:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f71a80f09c0 con 0x7f71b8104010 2024-09-15T22:10:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71bd200640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] conn(0x7f719c0acf80 0x7f719c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:43.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.780+0000 7f71b7400640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f719c0a3350 0x7f719c0a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71a40058c0 tx=0x7f71a4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:43.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.781+0000 7f71bd200640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] conn(0x7f719c0acf80 0x7f719c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:43.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.782+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== osd.7 v2:172.21.15.154:6816/1862188814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71a8036e90 con 0x7f719c0acf80 2024-09-15T22:10:43.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.796+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 --> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71b8062d80 con 0x7f719c0acf80 2024-09-15T22:10:43.798 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71b4c00640 1 -- 172.21.15.150:0/519719934 <== osd.7 v2:172.21.15.154:6816/1862188814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f71b8062d80 con 0x7f719c0acf80 2024-09-15T22:10:43.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] conn(0x7f719c0acf80 msgr2=0x7f719c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:43.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] conn(0x7f719c0acf80 0x7f719c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f719c0a3350 msgr2=0x7f719c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:43.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f719c0a3350 0x7f719c0a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71a40058c0 tx=0x7f71a4005850 comp rx=0 tx=0).stop 2024-09-15T22:10:43.799 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8104010 msgr2=0x7f71b819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:43.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 --2- 172.21.15.150:0/519719934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b8104010 0x7f71b819a660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71a8006010 tx=0x7f71a80042f0 comp rx=0 tx=0).stop 2024-09-15T22:10:43.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bd200640 1 -- 172.21.15.150:0/519719934 reap_dead start 2024-09-15T22:10:43.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 shutdown_connections 2024-09-15T22:10:43.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 >> 172.21.15.150:0/519719934 conn(0x7f71b80ffa50 msgr2=0x7f71b8100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:43.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.797+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 shutdown_connections 2024-09-15T22:10:43.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:43.798+0000 7f71bf200640 1 -- 172.21.15.150:0/519719934 wait complete. 2024-09-15T22:10:44.379 INFO:teuthology.orchestra.run.smithi150.stdout:128849018938 2024-09-15T22:10:44.379 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T22:10:44.480 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-15T22:10:44.481 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-15T22:10:44.481 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-15T22:10:44.481 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-15T22:10:44.481 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-15T22:10:44.481 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-15T22:10:44.484 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-15T22:10:44.484 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8, 3, 6]}]': finished 2024-09-15T22:10:44.484 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-15T22:10:44.484 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-15T22:10:44.484 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:44 smithi150 ceph-mon[30886]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:10:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-15T22:10:44.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8, 3, 6]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-15T22:10:44.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:44 smithi154 ceph-mon[34853]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-15T22:10:44.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8, 3, 6]}]': finished 2024-09-15T22:10:44.715 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-15T22:10:44.715 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-15T22:10:44.715 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:44 smithi169 ceph-mon[35850]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:10:44.734 INFO:teuthology.orchestra.run.smithi150.stdout:51539607626 2024-09-15T22:10:44.734 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T22:10:45.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 -- 172.21.15.150:0/3497573926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 msgr2=0x7f5500110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 --2- 172.21.15.150:0/3497573926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 0x7f5500110ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009ca0 tx=0x7f54f802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 -- 172.21.15.150:0/3497573926 shutdown_connections 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 --2- 172.21.15.150:0/3497573926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 0x7f5500110ca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 --2- 172.21.15.150:0/3497573926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55001049a0 0x7f55001089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 --2- 172.21.15.150:0/3497573926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 0x7f55001043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 -- 172.21.15.150:0/3497573926 >> 172.21.15.150:0/3497573926 conn(0x7f55000ffa90 msgr2=0x7f5500101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 -- 172.21.15.150:0/3497573926 shutdown_connections 2024-09-15T22:10:45.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.340+0000 7f5505000640 1 -- 172.21.15.150:0/3497573926 wait complete. 2024-09-15T22:10:45.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 Processor -- start 2024-09-15T22:10:45.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 -- start start 2024-09-15T22:10:45.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 0x7f550019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:45.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55001049a0 0x7f550019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:45.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 0x7f550019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:45.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5500114180 con 0x7f5500109120 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5500114000 con 0x7f5500103ff0 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.342+0000 7f5505000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5500114300 con 0x7f55001049a0 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 0x7f550019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 0x7f550019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54374/0 (socket says 172.21.15.150:54374) 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 -- 172.21.15.150:0/1503505027 learned_addr learned my addr 172.21.15.150:0/1503505027 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fd400640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55001049a0 0x7f550019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fe800640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 0x7f550019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 -- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55001049a0 msgr2=0x7f550019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55001049a0 0x7f550019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 -- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 msgr2=0x7f550019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:45.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5500109120 0x7f550019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.343+0000 7f54fde00640 1 -- 172.21.15.150:0/1503505027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550019f5f0 con 0x7f5500103ff0 2024-09-15T22:10:45.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.344+0000 7f54fde00640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 0x7f550019a640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54f000ea60 tx=0x7f54f000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:45.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.344+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f000cde0 con 0x7f5500103ff0 2024-09-15T22:10:45.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.344+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f00035f0 con 0x7f5500103ff0 2024-09-15T22:10:45.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.344+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550019f8e0 con 0x7f5500103ff0 2024-09-15T22:10:45.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.344+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0010670 con 0x7f5500103ff0 2024-09-15T22:10:45.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.344+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55001a71c0 con 0x7f5500103ff0 2024-09-15T22:10:45.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.345+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5500100f60 con 0x7f5500103ff0 2024-09-15T22:10:45.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.347+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f54f00037a0 con 0x7f5500103ff0 2024-09-15T22:10:45.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.348+0000 7f54f6a00640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f54e40a3350 0x7f54e40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:45.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.348+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f54f00d0160 con 0x7f5500103ff0 2024-09-15T22:10:45.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.348+0000 7f54fd400640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f54e40a3350 0x7f54e40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:45.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.349+0000 7f54f6a00640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] conn(0x7f54e40acf80 0x7f54e40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:45.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.349+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 --> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54f001ee70 con 0x7f54e40acf80 2024-09-15T22:10:45.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.349+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f54f00d0510 con 0x7f5500103ff0 2024-09-15T22:10:45.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.349+0000 7f54fd400640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f54e40a3350 0x7f54e40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f550010aa90 tx=0x7f54ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:45.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.349+0000 7f54fe800640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] conn(0x7f54e40acf80 0x7f54e40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:45.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.350+0000 7f54fe800640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] conn(0x7f54e40acf80 0x7f54e40af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:45.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.350+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== osd.11 v2:172.21.15.169:6824/33837423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54f001ee70 con 0x7f54e40acf80 2024-09-15T22:10:45.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.364+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 --> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55001054d0 con 0x7f54e40acf80 2024-09-15T22:10:45.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f54f6a00640 1 -- 172.21.15.150:0/1503505027 <== osd.11 v2:172.21.15.169:6824/33837423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f55001054d0 con 0x7f54e40acf80 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] conn(0x7f54e40acf80 msgr2=0x7f54e40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] conn(0x7f54e40acf80 0x7f54e40af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f54e40a3350 msgr2=0x7f54e40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f54e40a3350 0x7f54e40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f550010aa90 tx=0x7f54ec005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 msgr2=0x7f550019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 --2- 172.21.15.150:0/1503505027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500103ff0 0x7f550019a640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54f000ea60 tx=0x7f54f000ef20 comp rx=0 tx=0).stop 2024-09-15T22:10:45.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f54fe800640 1 -- 172.21.15.150:0/1503505027 reap_dead start 2024-09-15T22:10:45.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 shutdown_connections 2024-09-15T22:10:45.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 >> 172.21.15.150:0/1503505027 conn(0x7f55000ffa90 msgr2=0x7f5500100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:45.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 shutdown_connections 2024-09-15T22:10:45.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:45.366+0000 7f5505000640 1 -- 172.21.15.150:0/1503505027 wait complete. 2024-09-15T22:10:45.439 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:45 smithi150 ceph-mon[30886]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:10:45.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:45 smithi154 ceph-mon[34853]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:10:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:45 smithi169 ceph-mon[35850]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:10:46.014 INFO:teuthology.orchestra.run.smithi150.stdout:197568495659 2024-09-15T22:10:46.015 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T22:10:46.373 INFO:teuthology.orchestra.run.smithi150.stdout:176093659185 2024-09-15T22:10:46.373 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T22:10:46.504 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:46 smithi150 ceph-mon[30886]: pgmap v313: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 12 op/s 2024-09-15T22:10:46.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:46 smithi154 ceph-mon[34853]: pgmap v313: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 12 op/s 2024-09-15T22:10:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:46 smithi169 ceph-mon[35850]: pgmap v313: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 383 B/s wr, 12 op/s 2024-09-15T22:10:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:313532612632 2024-09-15T22:10:47.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T22:10:48.031 INFO:teuthology.orchestra.run.smithi150.stdout:34359738448 2024-09-15T22:10:48.031 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T22:10:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 -- 172.21.15.150:0/3742709219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d0103660 msgr2=0x7f83d010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 --2- 172.21.15.150:0/3742709219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d0103660 0x7f83d010bb50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009900 tx=0x7f83bc02a480 comp rx=0 tx=0).stop 2024-09-15T22:10:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 -- 172.21.15.150:0/3742709219 shutdown_connections 2024-09-15T22:10:48.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 --2- 172.21.15.150:0/3742709219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83d010c170 0x7f83d010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 --2- 172.21.15.150:0/3742709219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d0103660 0x7f83d010bb50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 --2- 172.21.15.150:0/3742709219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 0x7f83d0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 -- 172.21.15.150:0/3742709219 >> 172.21.15.150:0/3742709219 conn(0x7f83d00fc7a0 msgr2=0x7f83d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 -- 172.21.15.150:0/3742709219 shutdown_connections 2024-09-15T22:10:48.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.184+0000 7f83d4a00640 1 -- 172.21.15.150:0/3742709219 wait complete. 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 Processor -- start 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 -- start start 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 0x7f83d01a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83d0103660 0x7f83d01a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d010c170 0x7f83d010ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f83d0111f70 con 0x7f83d010c170 2024-09-15T22:10:48.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83d0111df0 con 0x7f83d0102d40 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.185+0000 7f83d4a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83d01120f0 con 0x7f83d0103660 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 0x7f83d01a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 0x7f83d01a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54388/0 (socket says 172.21.15.150:54388) 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 -- 172.21.15.150:0/4232124072 learned_addr learned my addr 172.21.15.150:0/4232124072 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83ce800640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d010c170 0x7f83d010ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cd400640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83d0103660 0x7f83d01a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 -- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83d0103660 msgr2=0x7f83d01a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83d0103660 0x7f83d01a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 -- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d010c170 msgr2=0x7f83d010ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83d010c170 0x7f83d010ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 -- 172.21.15.150:0/4232124072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d010b440 con 0x7f83d0102d40 2024-09-15T22:10:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.186+0000 7f83cde00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 0x7f83d01a46d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83c000ebc0 tx=0x7f83c000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.187+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0010630 con 0x7f83d0102d40 2024-09-15T22:10:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.187+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c0010cb0 con 0x7f83d0102d40 2024-09-15T22:10:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.187+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0018bd0 con 0x7f83d0102d40 2024-09-15T22:10:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.187+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d010b730 con 0x7f83d0102d40 2024-09-15T22:10:48.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.187+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d01ab5a0 con 0x7f83d0102d40 2024-09-15T22:10:48.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.188+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83d0102450 con 0x7f83d0102d40 2024-09-15T22:10:48.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.190+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f83c00107d0 con 0x7f83d0102d40 2024-09-15T22:10:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.191+0000 7f83c6a00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83b40a3350 0x7f83b40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.192 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.191+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f83c00d0500 con 0x7f83d0102d40 2024-09-15T22:10:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.192+0000 7f83cd400640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83b40a3350 0x7f83b40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.192+0000 7f83c6a00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] conn(0x7f83b40acf80 0x7f83b40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.192+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 --> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83c0019ec0 con 0x7f83b40acf80 2024-09-15T22:10:48.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.192+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f83c00d08b0 con 0x7f83d0102d40 2024-09-15T22:10:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.192+0000 7f83ce800640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] conn(0x7f83b40acf80 0x7f83b40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.193+0000 7f83cd400640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83b40a3350 0x7f83b40a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009230 tx=0x7f83bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.193+0000 7f83ce800640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] conn(0x7f83b40acf80 0x7f83b40af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:48.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.194+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== osd.2 v2:172.21.15.169:6800/2021221848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83c0019ec0 con 0x7f83b40acf80 2024-09-15T22:10:48.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.208+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 --> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83d006b070 con 0x7f83b40acf80 2024-09-15T22:10:48.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83c6a00640 1 -- 172.21.15.150:0/4232124072 <== osd.2 v2:172.21.15.169:6800/2021221848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f83d006b070 con 0x7f83b40acf80 2024-09-15T22:10:48.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] conn(0x7f83b40acf80 msgr2=0x7f83b40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] conn(0x7f83b40acf80 0x7f83b40af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83b40a3350 msgr2=0x7f83b40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83b40a3350 0x7f83b40a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009230 tx=0x7f83bc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 msgr2=0x7f83d01a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 --2- 172.21.15.150:0/4232124072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83d0102d40 0x7f83d01a46d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f83c000ebc0 tx=0x7f83c000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83ce800640 1 -- 172.21.15.150:0/4232124072 reap_dead start 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 shutdown_connections 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.209+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 >> 172.21.15.150:0/4232124072 conn(0x7f83d00fc7a0 msgr2=0x7f83d010d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.210+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 shutdown_connections 2024-09-15T22:10:48.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.210+0000 7f83d4a00640 1 -- 172.21.15.150:0/4232124072 wait complete. 2024-09-15T22:10:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:48 smithi154 ceph-mon[34853]: pgmap v314: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-15T22:10:48.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 -- 172.21.15.150:0/2360304053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0106f10 msgr2=0x7fbad010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 --2- 172.21.15.150:0/2360304053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0106f10 0x7fbad010ea90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009900 tx=0x7fbac802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 -- 172.21.15.150:0/2360304053 shutdown_connections 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 --2- 172.21.15.150:0/2360304053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0106f10 0x7fbad010ea90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 --2- 172.21.15.150:0/2360304053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbad0102790 0x7fbad01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 --2- 172.21.15.150:0/2360304053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad0101de0 0x7fbad01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 -- 172.21.15.150:0/2360304053 >> 172.21.15.150:0/2360304053 conn(0x7fbad00fd8c0 msgr2=0x7fbad00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 -- 172.21.15.150:0/2360304053 shutdown_connections 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.441+0000 7fbad6400640 1 -- 172.21.15.150:0/2360304053 wait complete. 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 Processor -- start 2024-09-15T22:10:48.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 -- start start 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0101de0 0x7fbad00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbad0102790 0x7fbad0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad0106f10 0x7fbad0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbad0111fc0 con 0x7fbad0101de0 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbad0111e40 con 0x7fbad0102790 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.442+0000 7fbad6400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbad0112140 con 0x7fbad0106f10 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0101de0 0x7fbad00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0101de0 0x7fbad00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46364/0 (socket says 172.21.15.150:46364) 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 -- 172.21.15.150:0/1861510282 learned_addr learned my addr 172.21.15.150:0/1861510282 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbac6a00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbad0102790 0x7fbad0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacfe00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad0106f10 0x7fbad0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 -- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad0106f10 msgr2=0x7fbad0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad0106f10 0x7fbad0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 -- 172.21.15.150:0/1861510282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbad0102790 msgr2=0x7fbad0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbad0102790 0x7fbad0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 -- 172.21.15.150:0/1861510282 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad01a68b0 con 0x7fbad0101de0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacfe00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbad0106f10 0x7fbad0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.443+0000 7fbacf400640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0101de0 0x7fbad00744f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009d50 tx=0x7fbac000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.444+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0003b70 con 0x7fbad0101de0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.444+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad01a6ba0 con 0x7fbad0101de0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.444+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbac0003d10 con 0x7fbad0101de0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.444+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0010a20 con 0x7fbad0101de0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.444+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad01a70e0 con 0x7fbad0101de0 2024-09-15T22:10:48.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.445+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbad00fed80 con 0x7fbad0101de0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.447+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbac0010bc0 con 0x7fbad0101de0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.448+0000 7fbaccc00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbab40a32d0 0x7fbab40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.448+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fbac00d04b0 con 0x7fbad0101de0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.448+0000 7fbac6a00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbab40a32d0 0x7fbab40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.448+0000 7fbaccc00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] conn(0x7fbab40acf00 0x7fbab40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.448+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 --> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbac001aec0 con 0x7fbab40acf00 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.448+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fbac00d0860 con 0x7fbad0101de0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.449+0000 7fbacfe00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] conn(0x7fbab40acf00 0x7fbab40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.449+0000 7fbac6a00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbab40a32d0 0x7fbab40a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbad01087d0 tx=0x7fbab8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:48.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.449+0000 7fbacfe00640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] conn(0x7fbab40acf00 0x7fbab40af3a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.450+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== osd.5 v2:172.21.15.169:6808/2553035733 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbac001aec0 con 0x7fbab40acf00 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.464+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 --> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbad01032c0 con 0x7fbab40acf00 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.465+0000 7fbaccc00640 1 -- 172.21.15.150:0/1861510282 <== osd.5 v2:172.21.15.169:6808/2553035733 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbad01032c0 con 0x7fbab40acf00 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] conn(0x7fbab40acf00 msgr2=0x7fbab40af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] conn(0x7fbab40acf00 0x7fbab40af3a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbab40a32d0 msgr2=0x7fbab40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbab40a32d0 0x7fbab40a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbad01087d0 tx=0x7fbab8005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0101de0 msgr2=0x7fbad00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 --2- 172.21.15.150:0/1861510282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbad0101de0 0x7fbad00744f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009d50 tx=0x7fbac000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbacfe00640 1 -- 172.21.15.150:0/1861510282 reap_dead start 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 shutdown_connections 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 >> 172.21.15.150:0/1861510282 conn(0x7fbad00fd8c0 msgr2=0x7fbad00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 shutdown_connections 2024-09-15T22:10:48.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:48.466+0000 7fbad6400640 1 -- 172.21.15.150:0/1861510282 wait complete. 2024-09-15T22:10:48.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:48 smithi150 ceph-mon[30886]: pgmap v314: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-15T22:10:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:48 smithi169 ceph-mon[35850]: pgmap v314: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-15T22:10:49.284 INFO:teuthology.orchestra.run.smithi150.stdout:146028888120 2024-09-15T22:10:49.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T22:10:49.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 -- 172.21.15.150:0/1943068820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 msgr2=0x7fd7d0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:49.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 --2- 172.21.15.150:0/1943068820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 0x7fd7d0108a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009900 tx=0x7fd7bc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 -- 172.21.15.150:0/1943068820 shutdown_connections 2024-09-15T22:10:49.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 --2- 172.21.15.150:0/1943068820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0109140 0x7fd7d0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 --2- 172.21.15.150:0/1943068820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 0x7fd7d0108a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 --2- 172.21.15.150:0/1943068820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d0104010 0x7fd7d01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 -- 172.21.15.150:0/1943068820 >> 172.21.15.150:0/1943068820 conn(0x7fd7d00ffa50 msgr2=0x7fd7d0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:49.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 -- 172.21.15.150:0/1943068820 shutdown_connections 2024-09-15T22:10:49.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.559+0000 7fd7d7400640 1 -- 172.21.15.150:0/1943068820 wait complete. 2024-09-15T22:10:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.561+0000 7fd7d7400640 1 Processor -- start 2024-09-15T22:10:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.561+0000 7fd7d7400640 1 -- start start 2024-09-15T22:10:49.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.561+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0104010 0x7fd7d0073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.561+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 0x7fd7d006cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d0109140 0x7fd7d006d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d7400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01141b0 con 0x7fd7d0104010 2024-09-15T22:10:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d7400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0114030 con 0x7fd7d0109140 2024-09-15T22:10:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d7400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0114330 con 0x7fd7d01049c0 2024-09-15T22:10:49.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0104010 0x7fd7d0073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0104010 0x7fd7d0073ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:46388/0 (socket says 172.21.15.150:46388) 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7cfe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 0x7fd7d006cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d4a00640 1 -- 172.21.15.150:0/584142143 learned_addr learned my addr 172.21.15.150:0/584142143 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.562+0000 7fd7d5400640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d0109140 0x7fd7d006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.563+0000 7fd7d4a00640 1 -- 172.21.15.150:0/584142143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 msgr2=0x7fd7d006cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.563+0000 7fd7d4a00640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d01049c0 0x7fd7d006cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.563+0000 7fd7d4a00640 1 -- 172.21.15.150:0/584142143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d0109140 msgr2=0x7fd7d006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:49.565 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.563+0000 7fd7d4a00640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d0109140 0x7fd7d006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.563+0000 7fd7d4a00640 1 -- 172.21.15.150:0/584142143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d006d730 con 0x7fd7d0104010 2024-09-15T22:10:49.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.564+0000 7fd7d4a00640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0104010 0x7fd7d0073ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400e9f0 tx=0x7fd7c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:49.566 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.564+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400cd80 con 0x7fd7d0104010 2024-09-15T22:10:49.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.564+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c4005500 con 0x7fd7d0104010 2024-09-15T22:10:49.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.564+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4010690 con 0x7fd7d0104010 2024-09-15T22:10:49.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.564+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d00715f0 con 0x7fd7d0104010 2024-09-15T22:10:49.567 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.565+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d0071ab0 con 0x7fd7d0104010 2024-09-15T22:10:49.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.566+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7d0072010 con 0x7fd7d0104010 2024-09-15T22:10:49.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.570+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd7c40046c0 con 0x7fd7d0104010 2024-09-15T22:10:49.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.572+0000 7fd7cd600640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7b80a3350 0x7fd7b80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:49.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.572+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fd7c40d03b0 con 0x7fd7d0104010 2024-09-15T22:10:49.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.573+0000 7fd7cd600640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] conn(0x7fd7b80acf80 0x7fd7b80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:49.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.573+0000 7fd7cfe00640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7b80a3350 0x7fd7b80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:49.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.573+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 --> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7c4025ea0 con 0x7fd7b80acf80 2024-09-15T22:10:49.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.573+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd7c40d0800 con 0x7fd7d0104010 2024-09-15T22:10:49.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.573+0000 7fd7d5400640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] conn(0x7fd7b80acf80 0x7fd7b80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:49.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.574+0000 7fd7d5400640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] conn(0x7fd7b80acf80 0x7fd7b80af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:49.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.574+0000 7fd7cfe00640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7b80a3350 0x7fd7b80a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000c00 tx=0x7fd7bc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:49.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.575+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== osd.3 v2:172.21.15.150:6810/720589173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7c4025ea0 con 0x7fd7b80acf80 2024-09-15T22:10:49.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.593+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 --> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7d0072410 con 0x7fd7b80acf80 2024-09-15T22:10:49.595 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.594+0000 7fd7cd600640 1 -- 172.21.15.150:0/584142143 <== osd.3 v2:172.21.15.150:6810/720589173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd7d0072410 con 0x7fd7b80acf80 2024-09-15T22:10:49.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.594+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] conn(0x7fd7b80acf80 msgr2=0x7fd7b80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:49.596 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.594+0000 7fd7d7400640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] conn(0x7fd7b80acf80 0x7fd7b80af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7b80a3350 msgr2=0x7fd7b80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:49.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d7400640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd7b80a3350 0x7fd7b80a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000c00 tx=0x7fd7bc005b50 comp rx=0 tx=0).stop 2024-09-15T22:10:49.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0104010 msgr2=0x7fd7d0073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:49.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d7400640 1 --2- 172.21.15.150:0/584142143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d0104010 0x7fd7d0073ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400e9f0 tx=0x7fd7c400edf0 comp rx=0 tx=0).stop 2024-09-15T22:10:49.597 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d5400640 1 -- 172.21.15.150:0/584142143 reap_dead start 2024-09-15T22:10:49.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 shutdown_connections 2024-09-15T22:10:49.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.595+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 >> 172.21.15.150:0/584142143 conn(0x7fd7d00ffa50 msgr2=0x7fd7d0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:49.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.596+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 shutdown_connections 2024-09-15T22:10:49.598 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:49.596+0000 7fd7d7400640 1 -- 172.21.15.150:0/584142143 wait complete. 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 -- 172.21.15.150:0/3100589666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c102b90 msgr2=0x7f3b6c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 --2- 172.21.15.150:0/3100589666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c102b90 0x7f3b6c102f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009900 tx=0x7f3b5c02a480 comp rx=0 tx=0).stop 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 -- 172.21.15.150:0/3100589666 shutdown_connections 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 --2- 172.21.15.150:0/3100589666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b6c10bfc0 0x7f3b6c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 --2- 172.21.15.150:0/3100589666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c1034b0 0x7f3b6c10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 --2- 172.21.15.150:0/3100589666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c102b90 0x7f3b6c102f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 -- 172.21.15.150:0/3100589666 >> 172.21.15.150:0/3100589666 conn(0x7f3b6c0fc610 msgr2=0x7f3b6c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 -- 172.21.15.150:0/3100589666 shutdown_connections 2024-09-15T22:10:50.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.251+0000 7f3b70c00640 1 -- 172.21.15.150:0/3100589666 wait complete. 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.252+0000 7f3b70c00640 1 Processor -- start 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.252+0000 7f3b70c00640 1 -- start start 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.252+0000 7f3b70c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c102b90 0x7f3b6c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.252+0000 7f3b70c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b6c1034b0 0x7f3b6c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.252+0000 7f3b70c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c10bfc0 0x7f3b6c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b70c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c111e10 con 0x7f3b6c1034b0 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b70c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c111c90 con 0x7f3b6c10bfc0 2024-09-15T22:10:50.255 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b70c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c111f90 con 0x7f3b6c102b90 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c102b90 0x7f3b6c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c102b90 0x7f3b6c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:35052/0 (socket says 172.21.15.150:35052) 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 -- 172.21.15.150:0/2707680355 learned_addr learned my addr 172.21.15.150:0/2707680355 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6aa00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b6c1034b0 0x7f3b6c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6be00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c10bfc0 0x7f3b6c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 -- 172.21.15.150:0/2707680355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c10bfc0 msgr2=0x7f3b6c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b6c10bfc0 0x7f3b6c19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 -- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b6c1034b0 msgr2=0x7f3b6c19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b6c1034b0 0x7f3b6c19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:50.256 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.253+0000 7f3b6b400640 1 -- 172.21.15.150:0/2707680355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c19f420 con 0x7f3b6c102b90 2024-09-15T22:10:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.254+0000 7f3b6b400640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c102b90 0x7f3b6c19a470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c004770 tx=0x7f3b5c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.254+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c03f070 con 0x7f3b6c102b90 2024-09-15T22:10:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.254+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b5c031ca0 con 0x7f3b6c102b90 2024-09-15T22:10:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.254+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c035030 con 0x7f3b6c102b90 2024-09-15T22:10:50.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.254+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c19f6b0 con 0x7f3b6c102b90 2024-09-15T22:10:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.254+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1a6ff0 con 0x7f3b6c102b90 2024-09-15T22:10:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.255+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b6c0fec80 con 0x7f3b6c102b90 2024-09-15T22:10:50.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.256+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3b5c042070 con 0x7f3b6c102b90 2024-09-15T22:10:50.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b63e00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3b500a3350 0x7f3b500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f3b5c0effe0 con 0x7f3b6c102b90 2024-09-15T22:10:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b6aa00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3b500a3350 0x7f3b500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b63e00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] conn(0x7f3b500acf80 0x7f3b500af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 --> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b5c02fec0 con 0x7f3b500acf80 2024-09-15T22:10:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3b5c0f7050 con 0x7f3b6c102b90 2024-09-15T22:10:50.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.258+0000 7f3b6be00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] conn(0x7f3b500acf80 0x7f3b500af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.259+0000 7f3b6aa00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3b500a3350 0x7f3b500a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c10def0 tx=0x7f3b58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.259+0000 7f3b6be00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] conn(0x7f3b500acf80 0x7f3b500af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:50.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.260+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== osd.9 v2:172.21.15.150:6826/3744711849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b5c02fec0 con 0x7f3b500acf80 2024-09-15T22:10:50.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.274+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 --> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b6c06a850 con 0x7f3b500acf80 2024-09-15T22:10:50.276 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.274+0000 7f3b63e00640 1 -- 172.21.15.150:0/2707680355 <== osd.9 v2:172.21.15.150:6826/3744711849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3b6c06a850 con 0x7f3b500acf80 2024-09-15T22:10:50.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] conn(0x7f3b500acf80 msgr2=0x7f3b500af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:50.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] conn(0x7f3b500acf80 0x7f3b500af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:50.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3b500a3350 msgr2=0x7f3b500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:50.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3b500a3350 0x7f3b500a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c10def0 tx=0x7f3b58005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c102b90 msgr2=0x7f3b6c19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 --2- 172.21.15.150:0/2707680355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b6c102b90 0x7f3b6c19a470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c004770 tx=0x7f3b5c003c10 comp rx=0 tx=0).stop 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b6be00640 1 -- 172.21.15.150:0/2707680355 reap_dead start 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 shutdown_connections 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 >> 172.21.15.150:0/2707680355 conn(0x7f3b6c0fc610 msgr2=0x7f3b6c0fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 shutdown_connections 2024-09-15T22:10:50.278 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:50.275+0000 7f3b70c00640 1 -- 172.21.15.150:0/2707680355 wait complete. 2024-09-15T22:10:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:50 smithi150 ceph-mon[30886]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:50.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:50 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:50 smithi169 ceph-mon[35850]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:50.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:50 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:50 smithi154 ceph-mon[34853]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:50 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:50.577 INFO:teuthology.orchestra.run.smithi150.stdout:68719476806 2024-09-15T22:10:50.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T22:10:51.126 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:51.128 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:51.415 INFO:teuthology.orchestra.run.smithi150.stdout:257698037795 2024-09-15T22:10:51.416 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T22:10:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:51 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:51 smithi150 ceph-mon[30886]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:52.059 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 -- 172.21.15.150:0/1954006542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01079d0 msgr2=0x7f8bf0107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/1954006542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01079d0 0x7f8bf0107db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009930 tx=0x7f8be402a420 comp rx=0 tx=0).stop 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 -- 172.21.15.150:0/1954006542 shutdown_connections 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/1954006542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0102370 0x7f8bf010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/1954006542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bf01019d0 0x7f8bf0101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/1954006542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01079d0 0x7f8bf0107db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 -- 172.21.15.150:0/1954006542 >> 172.21.15.150:0/1954006542 conn(0x7f8bf00fd710 msgr2=0x7f8bf00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 -- 172.21.15.150:0/1954006542 shutdown_connections 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.963+0000 7f8bf6c00640 1 -- 172.21.15.150:0/1954006542 wait complete. 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.964+0000 7f8bf6c00640 1 Processor -- start 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.964+0000 7f8bf6c00640 1 -- start start 2024-09-15T22:10:52.060 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 0x7f8bf01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0102370 0x7f8bf0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bf01079d0 0x7f8bf019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0111e20 con 0x7f8bf01019d0 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0111ca0 con 0x7f8bf0102370 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0111fa0 con 0x7f8bf01079d0 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 0x7f8bf01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 0x7f8bf01982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47752/0 (socket says 172.21.15.150:47752) 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 -- 172.21.15.150:0/2588750291 learned_addr learned my addr 172.21.15.150:0/2588750291 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf6200640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bf01079d0 0x7f8bf019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf4e00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0102370 0x7f8bf0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 -- 172.21.15.150:0/2588750291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bf01079d0 msgr2=0x7f8bf019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:52.061 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bf01079d0 0x7f8bf019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 -- 172.21.15.150:0/2588750291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0102370 msgr2=0x7f8bf0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0102370 0x7f8bf0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.965+0000 7f8bf5800640 1 -- 172.21.15.150:0/2588750291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf019d290 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.966+0000 7f8bf5800640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 0x7f8bf01982e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8be402a940 tx=0x7f8be4003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.966+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be403f070 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.966+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be4031c90 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.966+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf019d520 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.966+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4035030 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.966+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a4e60 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.967+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf0101e30 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.969+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8be4042070 con 0x7f8bf01019d0 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.970+0000 7f8bee000640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8bd80a3350 0x7f8bd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:52.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.970+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f8be40f0090 con 0x7f8bf01019d0 2024-09-15T22:10:52.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.971+0000 7f8bf4e00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8bd80a3350 0x7f8bd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:52.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.971+0000 7f8bf4e00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8bd80a3350 0x7f8bd80a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00ffd10 tx=0x7f8bdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:52.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:51.975+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8be40bc590 con 0x7f8bf01019d0 2024-09-15T22:10:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.156+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f8bf0109f40 con 0x7f8bf01019d0 2024-09-15T22:10:52.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.156+0000 7f8bee000640 1 -- 172.21.15.150:0/2588750291 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8be40c0890 con 0x7f8bf01019d0 2024-09-15T22:10:52.158 INFO:teuthology.orchestra.run.smithi150.stdout:283467841565 2024-09-15T22:10:52.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8bd80a3350 msgr2=0x7f8bd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8bd80a3350 0x7f8bd80a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00ffd10 tx=0x7f8bdc005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 msgr2=0x7f8bf01982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 0x7f8bf01982e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8be402a940 tx=0x7f8be4003b20 comp rx=0 tx=0).stop 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 shutdown_connections 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bf01079d0 0x7f8bf019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0102370 0x7f8bf0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8bd80a3350 0x7f8bd80a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 --2- 172.21.15.150:0/2588750291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bf01019d0 0x7f8bf01982e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 >> 172.21.15.150:0/2588750291 conn(0x7f8bf00fd710 msgr2=0x7f8bf00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 shutdown_connections 2024-09-15T22:10:52.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:52.159+0000 7f8bf6c00640 1 -- 172.21.15.150:0/2588750291 wait complete. 2024-09-15T22:10:52.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:51 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:51 smithi169 ceph-mon[35850]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:52.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:51 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:10:52.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:51 smithi154 ceph-mon[34853]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:52.428 INFO:teuthology.orchestra.run.smithi150.stdout:98784247874 2024-09-15T22:10:52.429 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.087+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1146772594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0106f10 msgr2=0x7f4eb010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.087+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1146772594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0106f10 0x7f4eb010ea90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009900 tx=0x7f4ea802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1146772594 shutdown_connections 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1146772594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0106f10 0x7f4eb010ea90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1146772594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eb0102790 0x7f4eb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1146772594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb0101de0 0x7f4eb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1146772594 >> 172.21.15.150:0/1146772594 conn(0x7f4eb00fd8c0 msgr2=0x7f4eb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:53.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1146772594 shutdown_connections 2024-09-15T22:10:53.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.088+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1146772594 wait complete. 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.089+0000 7f4eb4a00640 1 Processor -- start 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.089+0000 7f4eb4a00640 1 -- start start 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eb4a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eb0101de0 0x7f4eb0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eb4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 0x7f4eb0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eb4a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb0106f10 0x7f4eb019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eb4a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0111fc0 con 0x7f4eb0102790 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eb4a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0111e40 con 0x7f4eb0106f10 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eb4a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0112140 con 0x7f4eb0101de0 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 0x7f4eb0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:53.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 0x7f4eb0198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47760/0 (socket says 172.21.15.150:47760) 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 -- 172.21.15.150:0/1231272911 learned_addr learned my addr 172.21.15.150:0/1231272911 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eade00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eb0101de0 0x7f4eb0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4eae800640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb0106f10 0x7f4eb019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 -- 172.21.15.150:0/1231272911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eb0101de0 msgr2=0x7f4eb0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eb0101de0 0x7f4eb0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 -- 172.21.15.150:0/1231272911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb0106f10 msgr2=0x7f4eb019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb0106f10 0x7f4eb019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.090+0000 7f4ea5400640 1 -- 172.21.15.150:0/1231272911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb019d3b0 con 0x7f4eb0102790 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.091+0000 7f4ea5400640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 0x7f4eb0198940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800eb90 tx=0x7f4e9800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.091+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98004d20 con 0x7f4eb0102790 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.091+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e9800ee90 con 0x7f4eb0102790 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.091+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb019d6a0 con 0x7f4eb0102790 2024-09-15T22:10:53.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.091+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98010830 con 0x7f4eb0102790 2024-09-15T22:10:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.091+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb01a4f80 con 0x7f4eb0102790 2024-09-15T22:10:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.092+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb01021c0 con 0x7f4eb0102790 2024-09-15T22:10:53.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.094+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4e98005020 con 0x7f4eb0102790 2024-09-15T22:10:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.095+0000 7f4ea7400640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4e940a32d0 0x7f4e940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.095+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f4e980d0180 con 0x7f4eb0102790 2024-09-15T22:10:53.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.096+0000 7f4eade00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4e940a32d0 0x7f4e940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:53.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.096+0000 7f4eade00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4e940a32d0 0x7f4e940a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005d00 tx=0x7f4ea000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:53.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.100+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e9809ccd0 con 0x7f4eb0102790 2024-09-15T22:10:53.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:52 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2588750291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:10:53.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:52 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2588750291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:10:53.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:52 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2588750291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:10:53.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.279+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4eb01a51e0 con 0x7f4eb0102790 2024-09-15T22:10:53.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.280+0000 7f4ea7400640 1 -- 172.21.15.150:0/1231272911 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e9809c5d0 con 0x7f4eb0102790 2024-09-15T22:10:53.282 INFO:teuthology.orchestra.run.smithi150.stdout:51539607629 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4e940a32d0 msgr2=0x7f4e940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4e940a32d0 0x7f4e940a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005d00 tx=0x7f4ea000b410 comp rx=0 tx=0).stop 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 msgr2=0x7f4eb0198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 0x7f4eb0198940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800eb90 tx=0x7f4e9800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 shutdown_connections 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb0106f10 0x7f4eb019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4e940a32d0 0x7f4e940a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0102790 0x7f4eb0198940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 --2- 172.21.15.150:0/1231272911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eb0101de0 0x7f4eb0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:53.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 >> 172.21.15.150:0/1231272911 conn(0x7f4eb00fd8c0 msgr2=0x7f4eb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:53.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 shutdown_connections 2024-09-15T22:10:53.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:53.282+0000 7f4eb4a00640 1 -- 172.21.15.150:0/1231272911 wait complete. 2024-09-15T22:10:53.450 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841563 got 283467841565 for osd.10 2024-09-15T22:10:53.450 DEBUG:teuthology.parallel:result is None 2024-09-15T22:10:54.040 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:53 smithi150 ceph-mon[30886]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:54.041 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:53 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1231272911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:10:54.079 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607626 got 51539607629 for osd.1 2024-09-15T22:10:54.079 DEBUG:teuthology.parallel:result is None 2024-09-15T22:10:54.111 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:53 smithi169 ceph-mon[35850]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:54.111 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:53 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1231272911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:10:54.125 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.129 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.130 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.132 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.138 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.256 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.261 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:54.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:53 smithi154 ceph-mon[34853]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:10:54.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:53 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1231272911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 -- 172.21.15.150:0/1504178332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 msgr2=0x7f79ac076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 --2- 172.21.15.150:0/1504178332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac076b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009900 tx=0x7f79a002a410 comp rx=0 tx=0).stop 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 -- 172.21.15.150:0/1504178332 shutdown_connections 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 --2- 172.21.15.150:0/1504178332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 0x7f79ac114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 --2- 172.21.15.150:0/1504178332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 0x7f79ac112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 --2- 172.21.15.150:0/1504178332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac076b00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.363 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 -- 172.21.15.150:0/1504178332 >> 172.21.15.150:0/1504178332 conn(0x7f79ac0ff8f0 msgr2=0x7f79ac101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:55.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 -- 172.21.15.150:0/1504178332 shutdown_connections 2024-09-15T22:10:55.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.361+0000 7f79b2600640 1 -- 172.21.15.150:0/1504178332 wait complete. 2024-09-15T22:10:55.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.362+0000 7f79b2600640 1 Processor -- start 2024-09-15T22:10:55.364 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 -- start start 2024-09-15T22:10:55.365 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 0x7f79ac1a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 0x7f79ac19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac118430 con 0x7f79ac077040 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac1182b0 con 0x7f79ac112870 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b2600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac1185b0 con 0x7f79ac076720 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b1200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b1200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac1a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:35116/0 (socket says 172.21.15.150:35116) 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.363+0000 7f79b1200640 1 -- 172.21.15.150:0/1360633697 learned_addr learned my addr 172.21.15.150:0/1360633697 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79abe00640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 0x7f79ac1a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.366 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1c00640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 0x7f79ac19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1200640 1 -- 172.21.15.150:0/1360633697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 msgr2=0x7f79ac19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1200640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 0x7f79ac19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1200640 1 -- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 msgr2=0x7f79ac1a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1200640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 0x7f79ac1a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1200640 1 -- 172.21.15.150:0/1360633697 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac19ef90 con 0x7f79ac076720 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79abe00640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 0x7f79ac1a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1c00640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 0x7f79ac19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:55.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b1200640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac1a4650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79a0004770 tx=0x7f79a0003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:55.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a003f070 con 0x7f79ac076720 2024-09-15T22:10:55.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79a0031ca0 con 0x7f79ac076720 2024-09-15T22:10:55.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac19f220 con 0x7f79ac076720 2024-09-15T22:10:55.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.364+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a0035030 con 0x7f79ac076720 2024-09-15T22:10:55.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.365+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac1ab400 con 0x7f79ac076720 2024-09-15T22:10:55.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.366+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac077e60 con 0x7f79ac076720 2024-09-15T22:10:55.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.367+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f79a0042070 con 0x7f79ac076720 2024-09-15T22:10:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.370+0000 7f79a9600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f79940a3350 0x7f79940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.370+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f79a00f0180 con 0x7f79ac076720 2024-09-15T22:10:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.370+0000 7f79abe00640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f79940a3350 0x7f79940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.371+0000 7f79abe00640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f79940a3350 0x7f79940a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79ac19ff70 tx=0x7f7998005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:55.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.372+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79a00bcd90 con 0x7f79ac076720 2024-09-15T22:10:55.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 -- 172.21.15.150:0/3708096879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074620 msgr2=0x7fe6b8074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.492 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 --2- 172.21.15.150:0/3708096879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074620 0x7fe6b8074a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009860 tx=0x7fe6ac02a3d0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 -- 172.21.15.150:0/3708096879 shutdown_connections 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 --2- 172.21.15.150:0/3708096879 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b810e1e0 0x7fe6b8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 --2- 172.21.15.150:0/3708096879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b8074f40 0x7fe6b810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 --2- 172.21.15.150:0/3708096879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074620 0x7fe6b8074a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.234+0000 7fe6bde00640 1 -- 172.21.15.150:0/3708096879 >> 172.21.15.150:0/3708096879 conn(0x7fe6b80fd700 msgr2=0x7fe6b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.235+0000 7fe6bde00640 1 -- 172.21.15.150:0/3708096879 shutdown_connections 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.235+0000 7fe6bde00640 1 -- 172.21.15.150:0/3708096879 wait complete. 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.235+0000 7fe6bde00640 1 Processor -- start 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 -- start start 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 0x7fe6b819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074f40 0x7fe6b819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b810e1e0 0x7fe6b819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8113fe0 con 0x7fe6b8074620 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8113e60 con 0x7fe6b810e1e0 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bde00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8114160 con 0x7fe6b8074f40 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 0x7fe6b819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 0x7fe6b819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47774/0 (socket says 172.21.15.150:47774) 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6bca00640 1 -- 172.21.15.150:0/4219313279 learned_addr learned my addr 172.21.15.150:0/4219313279 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.236+0000 7fe6b7e00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074f40 0x7fe6b819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bd400640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b810e1e0 0x7fe6b819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bca00640 1 -- 172.21.15.150:0/4219313279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074f40 msgr2=0x7fe6b819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bca00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074f40 0x7fe6b819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bca00640 1 -- 172.21.15.150:0/4219313279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b810e1e0 msgr2=0x7fe6b819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bca00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b810e1e0 0x7fe6b819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bca00640 1 -- 172.21.15.150:0/4219313279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b819f490 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6b7e00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074f40 0x7fe6b819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bd400640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b810e1e0 0x7fe6b819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bca00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 0x7fe6b819a4e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009980 tx=0x7fe6ac0309a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac040070 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6ac005620 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b819f720 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0049b0 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.237+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b81a7060 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.239+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b8075cd0 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.240+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe6ac043070 con 0x7fe6b8074620 2024-09-15T22:10:55.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.242+0000 7fe6b5600640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6a00a32d0 0x7fe6a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.242+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fe6ac0f0930 con 0x7fe6b8074620 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.242+0000 7fe6b7e00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6a00a32d0 0x7fe6a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.242+0000 7fe6b7e00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6a00a32d0 0x7fe6a00a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80ffd00 tx=0x7fe6a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.246+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6ac0bd480 con 0x7fe6b8074620 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.436+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe6b8109360 con 0x7fe6b8074620 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.436+0000 7fe6b5600640 1 -- 172.21.15.150:0/4219313279 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe6ac0bcd80 con 0x7fe6b8074620 2024-09-15T22:10:55.496 INFO:teuthology.orchestra.run.smithi150.stdout:227633266728 2024-09-15T22:10:55.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.438+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6a00a32d0 msgr2=0x7fe6a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.438+0000 7fe6bde00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6a00a32d0 0x7fe6a00a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80ffd00 tx=0x7fe6a4005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:55.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.438+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 msgr2=0x7fe6b819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.438+0000 7fe6bde00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 0x7fe6b819a4e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009980 tx=0x7fe6ac0309a0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 shutdown_connections 2024-09-15T22:10:55.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b810e1e0 0x7fe6b819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6b8074f40 0x7fe6b819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe6a00a32d0 0x7fe6a00a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 --2- 172.21.15.150:0/4219313279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6b8074620 0x7fe6b819a4e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 >> 172.21.15.150:0/4219313279 conn(0x7fe6b80fd700 msgr2=0x7fe6b80fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:55.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 shutdown_connections 2024-09-15T22:10:55.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.439+0000 7fe6bde00640 1 -- 172.21.15.150:0/4219313279 wait complete. 2024-09-15T22:10:55.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.559+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f79ac02d7c0 con 0x7f79ac076720 2024-09-15T22:10:55.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.559+0000 7f79a9600640 1 -- 172.21.15.150:0/1360633697 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79a00bc690 con 0x7f79ac076720 2024-09-15T22:10:55.561 INFO:teuthology.orchestra.run.smithi150.stdout:34359738450 2024-09-15T22:10:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f79940a3350 msgr2=0x7f79940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f79940a3350 0x7f79940a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79ac19ff70 tx=0x7f7998005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 msgr2=0x7f79ac1a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:55.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac1a4650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79a0004770 tx=0x7f79a0003c10 comp rx=0 tx=0).stop 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 shutdown_connections 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac112870 0x7f79ac19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f79940a3350 0x7f79940a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79ac077040 0x7f79ac1a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 --2- 172.21.15.150:0/1360633697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79ac076720 0x7f79ac1a4650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.561+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 >> 172.21.15.150:0/1360633697 conn(0x7f79ac0ff8f0 msgr2=0x7f79ac101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.562+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 shutdown_connections 2024-09-15T22:10:55.564 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:55.562+0000 7f79b2600640 1 -- 172.21.15.150:0/1360633697 wait complete. 2024-09-15T22:10:56.408 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:56 smithi150 ceph-mon[30886]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:10:56.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:56 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/4219313279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:10:56.409 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:56 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1360633697' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:10:56.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:56 smithi169 ceph-mon[35850]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:10:56.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:56 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/4219313279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:10:56.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:56 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1360633697' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:10:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:56 smithi154 ceph-mon[34853]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:10:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:56 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/4219313279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:10:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:56 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1360633697' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:10:56.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 -- 172.21.15.150:0/2424614223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 msgr2=0x7f24a4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:56.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 --2- 172.21.15.150:0/2424614223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a4104210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2494009900 tx=0x7f249402a410 comp rx=0 tx=0).stop 2024-09-15T22:10:56.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 -- 172.21.15.150:0/2424614223 shutdown_connections 2024-09-15T22:10:56.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 --2- 172.21.15.150:0/2424614223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24a4108f60 0x7f24a4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 --2- 172.21.15.150:0/2424614223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a41047e0 0x7f24a4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 --2- 172.21.15.150:0/2424614223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a4104210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 -- 172.21.15.150:0/2424614223 >> 172.21.15.150:0/2424614223 conn(0x7f24a40ff8d0 msgr2=0x7f24a4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:56.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.519+0000 7f24a9400640 1 -- 172.21.15.150:0/2424614223 shutdown_connections 2024-09-15T22:10:56.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.520+0000 7f24a9400640 1 -- 172.21.15.150:0/2424614223 wait complete. 2024-09-15T22:10:56.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.520+0000 7f24a9400640 1 Processor -- start 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 -- start start 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24a41047e0 0x7f24a419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4108f60 0x7f24a419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4114010 con 0x7f24a4103e30 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4113e90 con 0x7f24a4108f60 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.521+0000 7f24a9400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4114190 con 0x7f24a41047e0 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:56.524 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47784/0 (socket says 172.21.15.150:47784) 2024-09-15T22:10:56.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 -- 172.21.15.150:0/3258857117 learned_addr learned my addr 172.21.15.150:0/3258857117 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:56.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f249be00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24a41047e0 0x7f24a419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:56.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a8a00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4108f60 0x7f24a419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:56.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 -- 172.21.15.150:0/3258857117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24a41047e0 msgr2=0x7f24a419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24a41047e0 0x7f24a419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 -- 172.21.15.150:0/3258857117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4108f60 msgr2=0x7f24a419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4108f60 0x7f24a419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.522+0000 7f24a3e00640 1 -- 172.21.15.150:0/3258857117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a419f440 con 0x7f24a4103e30 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.523+0000 7f24a3e00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a419a490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2494004770 tx=0x7f2494003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.523+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249403f070 con 0x7f24a4103e30 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.523+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2494031ca0 con 0x7f24a4103e30 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.523+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a419f6d0 con 0x7f24a4103e30 2024-09-15T22:10:56.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.523+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494035030 con 0x7f24a4103e30 2024-09-15T22:10:56.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.523+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41a7010 con 0x7f24a4103e30 2024-09-15T22:10:56.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.525+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a4104210 con 0x7f24a4103e30 2024-09-15T22:10:56.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.526+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f2494042070 con 0x7f24a4103e30 2024-09-15T22:10:56.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.528+0000 7f24a1600640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f24880a3350 0x7f24880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:56.529 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.528+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f24940f0070 con 0x7f24a4103e30 2024-09-15T22:10:56.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.528+0000 7f249be00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f24880a3350 0x7f24880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:56.530 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.529+0000 7f249be00640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f24880a3350 0x7f24880a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24a40ffcf0 tx=0x7f248c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:56.533 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.531+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24940bcce0 con 0x7f24a4103e30 2024-09-15T22:10:56.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.719+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f24a410c140 con 0x7f24a4103e30 2024-09-15T22:10:56.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.719+0000 7f24a1600640 1 -- 172.21.15.150:0/3258857117 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24940bc5e0 con 0x7f24a4103e30 2024-09-15T22:10:56.721 INFO:teuthology.orchestra.run.smithi150.stdout:98784247875 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f24880a3350 msgr2=0x7f24880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f24880a3350 0x7f24880a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24a40ffcf0 tx=0x7f248c005f90 comp rx=0 tx=0).stop 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 msgr2=0x7f24a419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a419a490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2494004770 tx=0x7f2494003c10 comp rx=0 tx=0).stop 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 shutdown_connections 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4108f60 0x7f24a419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24a41047e0 0x7f24a419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f24880a3350 0x7f24880a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 --2- 172.21.15.150:0/3258857117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24a4103e30 0x7f24a419a490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 >> 172.21.15.150:0/3258857117 conn(0x7f24a40ff8d0 msgr2=0x7f24a4100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 shutdown_connections 2024-09-15T22:10:56.724 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:56.722+0000 7f24a9400640 1 -- 172.21.15.150:0/3258857117 wait complete. 2024-09-15T22:10:56.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266725 got 227633266728 for osd.8 2024-09-15T22:10:56.969 DEBUG:teuthology.parallel:result is None 2024-09-15T22:10:57.519 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:57 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3258857117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:10:57.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:57 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3258857117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:10:57.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:57 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3258857117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 -- 172.21.15.150:0/1382152861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 msgr2=0x7f50a0102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 --2- 172.21.15.150:0/1382152861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a0102f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5090009900 tx=0x7f509002a480 comp rx=0 tx=0).stop 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 -- 172.21.15.150:0/1382152861 shutdown_connections 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 --2- 172.21.15.150:0/1382152861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a010bfc0 0x7f50a010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 --2- 172.21.15.150:0/1382152861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a01034b0 0x7f50a010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 --2- 172.21.15.150:0/1382152861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a0102f70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 -- 172.21.15.150:0/1382152861 >> 172.21.15.150:0/1382152861 conn(0x7f50a00fc610 msgr2=0x7f50a00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 -- 172.21.15.150:0/1382152861 shutdown_connections 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.728+0000 7f50a6200640 1 -- 172.21.15.150:0/1382152861 wait complete. 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.729+0000 7f50a6200640 1 Processor -- start 2024-09-15T22:10:58.016 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.729+0000 7f50a6200640 1 -- start start 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.729+0000 7f50a6200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a6200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 0x7f50a019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a6200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a010bfc0 0x7f50a019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a6200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f50a0111dc0 con 0x7f50a01034b0 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a6200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50a0111c40 con 0x7f50a010bfc0 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a6200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50a0111f40 con 0x7f50a0102b90 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 0x7f50a019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a4e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 0x7f50a019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47806/0 (socket says 172.21.15.150:47806) 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a4e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:35144/0 (socket says 172.21.15.150:35144) 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 -- 172.21.15.150:0/3322229001 learned_addr learned my addr 172.21.15.150:0/3322229001 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:58.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a5800640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a010bfc0 0x7f50a019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 -- 172.21.15.150:0/3322229001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 msgr2=0x7f50a019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 -- 172.21.15.150:0/3322229001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a010bfc0 msgr2=0x7f50a019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a010bfc0 0x7f50a019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f5097e00640 1 -- 172.21.15.150:0/3322229001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a019f4f0 con 0x7f50a01034b0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.730+0000 7f50a4e00640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.731+0000 7f5097e00640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 0x7f50a019aa80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f508800d950 tx=0x7f508800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.731+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088017030 con 0x7f50a01034b0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.731+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508800be10 con 0x7f50a01034b0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.731+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a019f7e0 con 0x7f50a01034b0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.731+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880055f0 con 0x7f50a01034b0 2024-09-15T22:10:58.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.731+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a01a70c0 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.732+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a0102f70 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.734+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5088009a30 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.735+0000 7f509e000640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f50840a3350 0x7f50840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.736+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f50880cf2e0 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.736+0000 7f50a4e00640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f50840a3350 0x7f50840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.736+0000 7f50a4e00640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f50840a3350 0x7f50840a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5090009230 tx=0x7f50900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.740+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f508809be90 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.920+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f50a01a7380 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.921+0000 7f509e000640 1 -- 172.21.15.150:0/3322229001 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f508809b790 con 0x7f50a01034b0 2024-09-15T22:10:58.019 INFO:teuthology.orchestra.run.smithi150.stdout:197568495661 2024-09-15T22:10:58.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f50840a3350 msgr2=0x7f50840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f50840a3350 0x7f50840a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5090009230 tx=0x7f50900058d0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 msgr2=0x7f50a019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 0x7f50a019aa80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f508800d950 tx=0x7f508800dd50 comp rx=0 tx=0).stop 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 shutdown_connections 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a010bfc0 0x7f50a019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f50840a3350 0x7f50840a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50a01034b0 0x7f50a019aa80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 --2- 172.21.15.150:0/3322229001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50a0102b90 0x7f50a019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 >> 172.21.15.150:0/3322229001 conn(0x7f50a00fc610 msgr2=0x7f50a010d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 shutdown_connections 2024-09-15T22:10:58.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:57.923+0000 7f50a6200640 1 -- 172.21.15.150:0/3322229001 wait complete. 2024-09-15T22:10:58.196 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:58.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247874 got 98784247875 for osd.3 2024-09-15T22:10:58.409 DEBUG:teuthology.parallel:result is None 2024-09-15T22:10:58.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:58 smithi150 ceph-mon[30886]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:10:58.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:58 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3322229001' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:10:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:58 smithi154 ceph-mon[34853]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:10:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:58 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3322229001' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:10:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:58 smithi169 ceph-mon[35850]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:10:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:58 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3322229001' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:10:58.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.842+0000 7f8139800640 1 -- 172.21.15.150:0/2895322414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81341049a0 msgr2=0x7f81341089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.842+0000 7f8139800640 1 --2- 172.21.15.150:0/2895322414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81341049a0 0x7f81341089f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8120009900 tx=0x7f812002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 -- 172.21.15.150:0/2895322414 shutdown_connections 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 --2- 172.21.15.150:0/2895322414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8134109120 0x7f8134110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 --2- 172.21.15.150:0/2895322414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81341049a0 0x7f81341089f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 --2- 172.21.15.150:0/2895322414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8134103ff0 0x7f81341043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 -- 172.21.15.150:0/2895322414 >> 172.21.15.150:0/2895322414 conn(0x7f81340ffa90 msgr2=0x7f8134101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 -- 172.21.15.150:0/2895322414 shutdown_connections 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 -- 172.21.15.150:0/2895322414 wait complete. 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.843+0000 7f8139800640 1 Processor -- start 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 -- start start 2024-09-15T22:10:58.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8134103ff0 0x7f813419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81341049a0 0x7f813419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 0x7f813419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8134114120 con 0x7f8134109120 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8134113fa0 con 0x7f81341049a0 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8139800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81341142a0 con 0x7f8134103ff0 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8133400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 0x7f813419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8133400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 0x7f813419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47828/0 (socket says 172.21.15.150:47828) 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8133400640 1 -- 172.21.15.150:0/2624558783 learned_addr learned my addr 172.21.15.150:0/2624558783 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8132a00640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8134103ff0 0x7f813419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.844+0000 7f8132000640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81341049a0 0x7f813419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8133400640 1 -- 172.21.15.150:0/2624558783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8134103ff0 msgr2=0x7f813419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8133400640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8134103ff0 0x7f813419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8133400640 1 -- 172.21.15.150:0/2624558783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81341049a0 msgr2=0x7f813419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8133400640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81341049a0 0x7f813419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8133400640 1 -- 172.21.15.150:0/2624558783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813419f5f0 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8132000640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81341049a0 0x7f813419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8133400640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 0x7f813419ef10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f812c00efd0 tx=0x7f812c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c003b70 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f812c003d10 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813419f8e0 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0109f0 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.845+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341a71c0 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.847+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81341043d0 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.848+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f812c004020 con 0x7f8134109120 2024-09-15T22:10:58.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.850+0000 7f812b400640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f81180a32d0 0x7f81180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:58.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.850+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f812c0cff60 con 0x7f8134109120 2024-09-15T22:10:58.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.850+0000 7f8132a00640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f81180a32d0 0x7f81180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:58.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.851+0000 7f8132a00640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f81180a32d0 0x7f81180a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8124005d00 tx=0x7f812400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:58.863 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:58.854+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f812c09cab0 con 0x7f8134109120 2024-09-15T22:10:59.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.036+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f813410bdd0 con 0x7f8134109120 2024-09-15T22:10:59.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.037+0000 7f812b400640 1 -- 172.21.15.150:0/2624558783 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f812c09c3b0 con 0x7f8134109120 2024-09-15T22:10:59.039 INFO:teuthology.orchestra.run.smithi150.stdout:128849018941 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f81180a32d0 msgr2=0x7f81180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f81180a32d0 0x7f81180a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8124005d00 tx=0x7f812400b410 comp rx=0 tx=0).stop 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 msgr2=0x7f813419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 0x7f813419ef10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f812c00efd0 tx=0x7f812c00c6a0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 shutdown_connections 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f81180a32d0 0x7f81180a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8134109120 0x7f813419ef10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81341049a0 0x7f813419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 --2- 172.21.15.150:0/2624558783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8134103ff0 0x7f813419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 >> 172.21.15.150:0/2624558783 conn(0x7f81340ffa90 msgr2=0x7f8134100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:59.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 shutdown_connections 2024-09-15T22:10:59.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.039+0000 7f8139800640 1 -- 172.21.15.150:0/2624558783 wait complete. 2024-09-15T22:10:59.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738448 got 34359738450 for osd.0 2024-09-15T22:10:59.211 DEBUG:teuthology.parallel:result is None 2024-09-15T22:10:59.393 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:10:59 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2624558783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:10:59.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:10:59 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2624558783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:10:59.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:10:59 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2624558783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:10:59.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 -- 172.21.15.150:0/1356615554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 msgr2=0x7f976c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 --2- 172.21.15.150:0/1356615554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 0x7f976c104210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9760009900 tx=0x7f976002a410 comp rx=0 tx=0).stop 2024-09-15T22:10:59.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 -- 172.21.15.150:0/1356615554 shutdown_connections 2024-09-15T22:10:59.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 --2- 172.21.15.150:0/1356615554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c108f60 0x7f976c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 --2- 172.21.15.150:0/1356615554 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c1047e0 0x7f976c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 --2- 172.21.15.150:0/1356615554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 0x7f976c104210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 -- 172.21.15.150:0/1356615554 >> 172.21.15.150:0/1356615554 conn(0x7f976c0ff8d0 msgr2=0x7f976c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:59.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 -- 172.21.15.150:0/1356615554 shutdown_connections 2024-09-15T22:10:59.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.750+0000 7f9773200640 1 -- 172.21.15.150:0/1356615554 wait complete. 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.751+0000 7f9773200640 1 Processor -- start 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.751+0000 7f9773200640 1 -- start start 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.751+0000 7f9773200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 0x7f976c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9773200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c1047e0 0x7f976c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9773200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 0x7f976c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9773200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f976c114010 con 0x7f976c108f60 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9773200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f976c113e90 con 0x7f976c1047e0 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9773200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f976c114190 con 0x7f976c103e30 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 0x7f976c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:59.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9771e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 0x7f976c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:59.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 0x7f976c19ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47840/0 (socket says 172.21.15.150:47840) 2024-09-15T22:10:59.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 -- 172.21.15.150:0/470106243 learned_addr learned my addr 172.21.15.150:0/470106243 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:10:59.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9771400640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c1047e0 0x7f976c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:59.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 -- 172.21.15.150:0/470106243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 msgr2=0x7f976c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 0x7f976c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 -- 172.21.15.150:0/470106243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c1047e0 msgr2=0x7f976c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c1047e0 0x7f976c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.752+0000 7f9772800640 1 -- 172.21.15.150:0/470106243 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976c19f440 con 0x7f976c108f60 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.753+0000 7f9772800640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 0x7f976c19ed60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f976800eb10 tx=0x7f976800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.753+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9768004b20 con 0x7f976c108f60 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.753+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9768004cc0 con 0x7f976c108f60 2024-09-15T22:10:59.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.753+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976c19f730 con 0x7f976c108f60 2024-09-15T22:10:59.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.753+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9768010760 con 0x7f976c108f60 2024-09-15T22:10:59.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.753+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f976c1a7010 con 0x7f976c108f60 2024-09-15T22:10:59.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.755+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976c104210 con 0x7f976c108f60 2024-09-15T22:10:59.758 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.756+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9768005020 con 0x7f976c108f60 2024-09-15T22:10:59.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.758+0000 7f9766a00640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f97540a32d0 0x7f97540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:59.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.759+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f97680d0150 con 0x7f976c108f60 2024-09-15T22:10:59.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.759+0000 7f9771e00640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f97540a32d0 0x7f97540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:59.761 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.759+0000 7f9771e00640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f97540a32d0 0x7f97540a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9760000c00 tx=0x7f9760005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:59.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.762+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f976809cca0 con 0x7f976c108f60 2024-09-15T22:10:59.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.952+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f976c10bbb0 con 0x7f976c108f60 2024-09-15T22:10:59.954 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.953+0000 7f9766a00640 1 -- 172.21.15.150:0/470106243 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f976809c5a0 con 0x7f976c108f60 2024-09-15T22:10:59.955 INFO:teuthology.orchestra.run.smithi150.stdout:313532612635 2024-09-15T22:10:59.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f97540a32d0 msgr2=0x7f97540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.957 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f97540a32d0 0x7f97540a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9760000c00 tx=0x7f9760005b50 comp rx=0 tx=0).stop 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 msgr2=0x7f976c19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 0x7f976c19ed60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f976800eb10 tx=0x7f976800c2d0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 shutdown_connections 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f97540a32d0 0x7f97540a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f976c108f60 0x7f976c19ed60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c1047e0 0x7f976c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 --2- 172.21.15.150:0/470106243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f976c103e30 0x7f976c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.955+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 >> 172.21.15.150:0/470106243 conn(0x7f976c0ff8d0 msgr2=0x7f976c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.956+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 shutdown_connections 2024-09-15T22:10:59.958 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:10:59.956+0000 7f9773200640 1 -- 172.21.15.150:0/470106243 wait complete. 2024-09-15T22:11:00.296 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:00 smithi150 ceph-mon[30886]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:11:00.296 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:00 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/470106243' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:11:00.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.408+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3505442277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb41034b0 msgr2=0x7f3fb410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.408+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3505442277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb41034b0 0x7f3fb410b9a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009900 tx=0x7f3f9c02a480 comp rx=0 tx=0).stop 2024-09-15T22:11:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3505442277 shutdown_connections 2024-09-15T22:11:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3505442277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb410bfc0 0x7f3fb410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3505442277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb41034b0 0x7f3fb410b9a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3505442277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb4102b90 0x7f3fb4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3505442277 >> 172.21.15.150:0/3505442277 conn(0x7f3fb40fc610 msgr2=0x7f3fb40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:00.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3505442277 shutdown_connections 2024-09-15T22:11:00.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.409+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3505442277 wait complete. 2024-09-15T22:11:00.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 Processor -- start 2024-09-15T22:11:00.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 -- start start 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 0x7f3fb41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb41034b0 0x7f3fb41987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb410bfc0 0x7f3fb419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4111e10 con 0x7f3fb4102b90 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4111c90 con 0x7f3fb410bfc0 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.411+0000 7f3fb9e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4111f90 con 0x7f3fb41034b0 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb8a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 0x7f3fb41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:00.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb410bfc0 0x7f3fb419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb8a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 0x7f3fb41982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55198/0 (socket says 172.21.15.150:55198) 2024-09-15T22:11:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb8a00640 1 -- 172.21.15.150:0/3778668400 learned_addr learned my addr 172.21.15.150:0/3778668400 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fabe00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb41034b0 0x7f3fb41987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb9400640 1 -- 172.21.15.150:0/3778668400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb41034b0 msgr2=0x7f3fb41987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb9400640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb41034b0 0x7f3fb41987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb9400640 1 -- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 msgr2=0x7f3fb41982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:00.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb9400640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 0x7f3fb41982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb9400640 1 -- 172.21.15.150:0/3778668400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb419d260 con 0x7f3fb410bfc0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fabe00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb41034b0 0x7f3fb41987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.412+0000 7f3fb8a00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 0x7f3fb41982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.413+0000 7f3fb9400640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb410bfc0 0x7f3fb419cb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e940 tx=0x7f3fac00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.413+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac004d20 con 0x7f3fb410bfc0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.413+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fac005020 con 0x7f3fb410bfc0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.413+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb419d550 con 0x7f3fb410bfc0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.413+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0116b0 con 0x7f3fb410bfc0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.413+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb41a4e30 con 0x7f3fb410bfc0 2024-09-15T22:11:00.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.415+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb4102f70 con 0x7f3fb410bfc0 2024-09-15T22:11:00.418 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.416+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3fac0054d0 con 0x7f3fb410bfc0 2024-09-15T22:11:00.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.419+0000 7f3fb2000640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3f980a3350 0x7f3f980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:00.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.419+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f3fac0cfe10 con 0x7f3fb410bfc0 2024-09-15T22:11:00.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.419+0000 7f3fb8a00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3f980a3350 0x7f3f980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:00.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.419+0000 7f3fb8a00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3f980a3350 0x7f3f980a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4011550 tx=0x7f3fa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:00.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.422+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fac0d3030 con 0x7f3fb410bfc0 2024-09-15T22:11:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:00 smithi154 ceph-mon[34853]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:11:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:00 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/470106243' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:11:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.606+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3fb4106aa0 con 0x7f3fb410bfc0 2024-09-15T22:11:00.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.606+0000 7f3fb2000640 1 -- 172.21.15.150:0/3778668400 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3fac016030 con 0x7f3fb410bfc0 2024-09-15T22:11:00.608 INFO:teuthology.orchestra.run.smithi150.stdout:176093659188 2024-09-15T22:11:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3f980a3350 msgr2=0x7f3f980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3f980a3350 0x7f3f980a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4011550 tx=0x7f3fa4005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb410bfc0 msgr2=0x7f3fb419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb410bfc0 0x7f3fb419cb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e940 tx=0x7f3fac00ee00 comp rx=0 tx=0).stop 2024-09-15T22:11:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 shutdown_connections 2024-09-15T22:11:00.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb410bfc0 0x7f3fb419cb80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fb41034b0 0x7f3fb41987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3f980a3350 0x7f3f980a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 --2- 172.21.15.150:0/3778668400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3fb4102b90 0x7f3fb41982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 >> 172.21.15.150:0/3778668400 conn(0x7f3fb40fc610 msgr2=0x7f3fb40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 shutdown_connections 2024-09-15T22:11:00.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:00.609+0000 7f3fb9e00640 1 -- 172.21.15.150:0/3778668400 wait complete. 2024-09-15T22:11:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:00 smithi169 ceph-mon[35850]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:11:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:00 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/470106243' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:11:01.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495659 got 197568495661 for osd.7 2024-09-15T22:11:01.004 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:01.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:01 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3778668400' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:11:01.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:01 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3778668400' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:11:01.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:01 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3778668400' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:11:02.085 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:02.086 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:02.128 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018938 got 128849018941 for osd.4 2024-09-15T22:11:02.128 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:02.435 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659185 got 176093659188 for osd.6 2024-09-15T22:11:02.435 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:02.511 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:02 smithi150 ceph-mon[30886]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:02 smithi154 ceph-mon[34853]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 -- 172.21.15.150:0/3232738642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38541034b0 msgr2=0x7f385410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 --2- 172.21.15.150:0/3232738642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38541034b0 0x7f385410b9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3840009900 tx=0x7f384002a480 comp rx=0 tx=0).stop 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 -- 172.21.15.150:0/3232738642 shutdown_connections 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 --2- 172.21.15.150:0/3232738642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f385410bfc0 0x7f385410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 --2- 172.21.15.150:0/3232738642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38541034b0 0x7f385410b9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 --2- 172.21.15.150:0/3232738642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3854102b90 0x7f3854102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.631+0000 7f3853200640 1 -- 172.21.15.150:0/3232738642 >> 172.21.15.150:0/3232738642 conn(0x7f38540fc610 msgr2=0x7f38540fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.632+0000 7f3853200640 1 -- 172.21.15.150:0/3232738642 shutdown_connections 2024-09-15T22:11:02.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.632+0000 7f3853200640 1 -- 172.21.15.150:0/3232738642 wait complete. 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.632+0000 7f3853200640 1 Processor -- start 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 -- start start 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 0x7f385419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38541034b0 0x7f385419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f385410bfc0 0x7f385419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111e10 con 0x7f385410bfc0 2024-09-15T22:11:02.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111c90 con 0x7f3854102b90 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3853200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111f90 con 0x7f38541034b0 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3851e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 0x7f385419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3851e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 0x7f385419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60830/0 (socket says 172.21.15.150:60830) 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3851e00640 1 -- 172.21.15.150:0/3446047581 learned_addr learned my addr 172.21.15.150:0/3446047581 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3852800640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f385410bfc0 0x7f385419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.633+0000 7f3851400640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38541034b0 0x7f385419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3851e00640 1 -- 172.21.15.150:0/3446047581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38541034b0 msgr2=0x7f385419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3851e00640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38541034b0 0x7f385419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3851e00640 1 -- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f385410bfc0 msgr2=0x7f385419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3851e00640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f385410bfc0 0x7f385419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3851e00640 1 -- 172.21.15.150:0/3446047581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385419f480 con 0x7f3854102b90 2024-09-15T22:11:02.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3851e00640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 0x7f385419a4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f384400e9f0 tx=0x7f384400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:02.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384400cd80 con 0x7f3854102b90 2024-09-15T22:11:02.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385419f770 con 0x7f3854102b90 2024-09-15T22:11:02.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3844005500 con 0x7f3854102b90 2024-09-15T22:11:02.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.634+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38541a7050 con 0x7f3854102b90 2024-09-15T22:11:02.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.635+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844010430 con 0x7f3854102b90 2024-09-15T22:11:02.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.636+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3854102f70 con 0x7f3854102b90 2024-09-15T22:11:02.640 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.638+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f38440046c0 con 0x7f3854102b90 2024-09-15T22:11:02.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.639+0000 7f384aa00640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f38380a3350 0x7f38380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:02.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.639+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f38440cfe00 con 0x7f3854102b90 2024-09-15T22:11:02.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.639+0000 7f3851400640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f38380a3350 0x7f38380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:02.641 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.640+0000 7f3851400640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f38380a3350 0x7f38380a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3840000c00 tx=0x7f3840005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:02.644 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.643+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f384409c950 con 0x7f3854102b90 2024-09-15T22:11:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:02 smithi169 ceph-mon[35850]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:02.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.843+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f38541a7280 con 0x7f3854102b90 2024-09-15T22:11:02.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.844+0000 7f384aa00640 1 -- 172.21.15.150:0/3446047581 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f384409c250 con 0x7f3854102b90 2024-09-15T22:11:02.846 INFO:teuthology.orchestra.run.smithi150.stdout:146028888123 2024-09-15T22:11:02.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.846+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f38380a3350 msgr2=0x7f38380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:02.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.846+0000 7f3853200640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f38380a3350 0x7f38380a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3840000c00 tx=0x7f3840005b50 comp rx=0 tx=0).stop 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.846+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 msgr2=0x7f385419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.846+0000 7f3853200640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 0x7f385419a4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f384400e9f0 tx=0x7f384400edf0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 shutdown_connections 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f38380a3350 0x7f38380a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f385410bfc0 0x7f385419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38541034b0 0x7f385419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 --2- 172.21.15.150:0/3446047581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3854102b90 0x7f385419a4d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 >> 172.21.15.150:0/3446047581 conn(0x7f38540fc610 msgr2=0x7f385410d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 shutdown_connections 2024-09-15T22:11:02.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:02.847+0000 7f3853200640 1 -- 172.21.15.150:0/3446047581 wait complete. 2024-09-15T22:11:03.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 -- 172.21.15.150:0/2405746606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a80074620 msgr2=0x7f1a80074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:03.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 --2- 172.21.15.150:0/2405746606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a80074620 0x7f1a80074a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009900 tx=0x7f1a7002a480 comp rx=0 tx=0).stop 2024-09-15T22:11:03.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 -- 172.21.15.150:0/2405746606 shutdown_connections 2024-09-15T22:11:03.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 --2- 172.21.15.150:0/2405746606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a8010e3c0 0x7f1a80110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 --2- 172.21.15.150:0/2405746606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 --2- 172.21.15.150:0/2405746606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a80074620 0x7f1a80074a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 -- 172.21.15.150:0/2405746606 >> 172.21.15.150:0/2405746606 conn(0x7f1a800fd8c0 msgr2=0x7f1a800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 -- 172.21.15.150:0/2405746606 shutdown_connections 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.402+0000 7f1a85200640 1 -- 172.21.15.150:0/2405746606 wait complete. 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 Processor -- start 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 -- start start 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a80074620 0x7f1a8019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a8010e3c0 0x7f1a8019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801141a0 con 0x7f1a8010e3c0 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80114020 con 0x7f1a80074620 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a85200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80114320 con 0x7f1a80074f40 2024-09-15T22:11:03.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.403+0000 7f1a77e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49656/0 (socket says 172.21.15.150:49656) 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 -- 172.21.15.150:0/2173592389 learned_addr learned my addr 172.21.15.150:0/2173592389 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a7e800640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a8010e3c0 0x7f1a8019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a7de00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a80074620 0x7f1a8019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 -- 172.21.15.150:0/2173592389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a80074620 msgr2=0x7f1a8019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a80074620 0x7f1a8019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 -- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a8010e3c0 msgr2=0x7f1a8019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a8010e3c0 0x7f1a8019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 -- 172.21.15.150:0/2173592389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8019f610 con 0x7f1a80074f40 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.404+0000 7f1a77e00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8019aba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e9f0 tx=0x7f1a6800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.405+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800cd80 con 0x7f1a80074f40 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.405+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8019f900 con 0x7f1a80074f40 2024-09-15T22:11:03.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.405+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a68010910 con 0x7f1a80074f40 2024-09-15T22:11:03.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.405+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a680188f0 con 0x7f1a80074f40 2024-09-15T22:11:03.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.405+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a801a71e0 con 0x7f1a80074f40 2024-09-15T22:11:03.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.406+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a80074a00 con 0x7f1a80074f40 2024-09-15T22:11:03.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.408+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1a68010ac0 con 0x7f1a80074f40 2024-09-15T22:11:03.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.409+0000 7f1a76a00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1a640a32d0 0x7f1a640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:03.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.409+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f1a680cfea0 con 0x7f1a80074f40 2024-09-15T22:11:03.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.409+0000 7f1a7de00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1a640a32d0 0x7f1a640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:03.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.410+0000 7f1a7de00640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1a640a32d0 0x7f1a640a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a70000c00 tx=0x7f1a70005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:03.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.413+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a6809c3a0 con 0x7f1a80074f40 2024-09-15T22:11:03.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:03 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3446047581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:11:03.553 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:03 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3446047581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:11:03.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.624+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1a80108fb0 con 0x7f1a80074f40 2024-09-15T22:11:03.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.625+0000 7f1a76a00640 1 -- 172.21.15.150:0/2173592389 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1a680a06a0 con 0x7f1a80074f40 2024-09-15T22:11:03.627 INFO:teuthology.orchestra.run.smithi150.stdout:257698037797 2024-09-15T22:11:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1a640a32d0 msgr2=0x7f1a640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1a640a32d0 0x7f1a640a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a70000c00 tx=0x7f1a70005b50 comp rx=0 tx=0).stop 2024-09-15T22:11:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 msgr2=0x7f1a8019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:03.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8019aba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e9f0 tx=0x7f1a6800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 shutdown_connections 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1a640a32d0 0x7f1a640a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a8010e3c0 0x7f1a8019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a80074f40 0x7f1a8019aba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 --2- 172.21.15.150:0/2173592389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a80074620 0x7f1a8019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.627+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 >> 172.21.15.150:0/2173592389 conn(0x7f1a800fd8c0 msgr2=0x7f1a800fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.628+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 shutdown_connections 2024-09-15T22:11:03.630 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:03.628+0000 7f1a85200640 1 -- 172.21.15.150:0/2173592389 wait complete. 2024-09-15T22:11:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:03 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3446047581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:11:03.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612632 got 313532612635 for osd.11 2024-09-15T22:11:03.941 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:04.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:04 smithi150 ceph-mon[30886]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-15T22:11:04.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:04 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2173592389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:11:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:04 smithi154 ceph-mon[34853]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-15T22:11:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:04 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2173592389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:11:04.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 -- 172.21.15.150:0/2505560999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 msgr2=0x7fc0501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 --2- 172.21.15.150:0/2505560999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc0501021c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc038009860 tx=0x7fc03802a340 comp rx=0 tx=0).stop 2024-09-15T22:11:04.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 -- 172.21.15.150:0/2505560999 shutdown_connections 2024-09-15T22:11:04.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 --2- 172.21.15.150:0/2505560999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050106f10 0x7fc05010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 --2- 172.21.15.150:0/2505560999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc050102790 0x7fc0501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 --2- 172.21.15.150:0/2505560999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc0501021c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 -- 172.21.15.150:0/2505560999 >> 172.21.15.150:0/2505560999 conn(0x7fc0500fd8c0 msgr2=0x7fc0500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:04.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 -- 172.21.15.150:0/2505560999 shutdown_connections 2024-09-15T22:11:04.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.549+0000 7fc057400640 1 -- 172.21.15.150:0/2505560999 wait complete. 2024-09-15T22:11:04.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 Processor -- start 2024-09-15T22:11:04.556 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 -- start start 2024-09-15T22:11:04.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc050198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:04.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 0x7fc050198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:04.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc050106f10 0x7fc05019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:04.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc050111f70 con 0x7fc050106f10 2024-09-15T22:11:04.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc050111df0 con 0x7fc050101de0 2024-09-15T22:11:04.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc057400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501120f0 con 0x7fc050102790 2024-09-15T22:11:04.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.550+0000 7fc047e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 0x7fc050198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:04.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc050198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:04.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc047e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 0x7fc050198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49674/0 (socket says 172.21.15.150:49674) 2024-09-15T22:11:04.558 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc047e00640 1 -- 172.21.15.150:0/896560858 learned_addr learned my addr 172.21.15.150:0/896560858 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:04.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc055400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc050106f10 0x7fc05019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:04.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 -- 172.21.15.150:0/896560858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 msgr2=0x7fc050198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 0x7fc050198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 -- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc050106f10 msgr2=0x7fc05019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc050106f10 0x7fc05019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 -- 172.21.15.150:0/896560858 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05019d3e0 con 0x7fc050101de0 2024-09-15T22:11:04.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc047e00640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 0x7fc050198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:04.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.551+0000 7fc054a00640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc050198430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc03802a860 tx=0x7fc038033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:04.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.552+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038037040 con 0x7fc050101de0 2024-09-15T22:11:04.560 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.552+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc038033d50 con 0x7fc050101de0 2024-09-15T22:11:04.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.552+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05019d670 con 0x7fc050101de0 2024-09-15T22:11:04.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.552+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038003960 con 0x7fc050101de0 2024-09-15T22:11:04.561 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.552+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0501a4fb0 con 0x7fc050101de0 2024-09-15T22:11:04.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.553+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0501021c0 con 0x7fc050101de0 2024-09-15T22:11:04.562 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.555+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc038042020 con 0x7fc050101de0 2024-09-15T22:11:04.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.556+0000 7fc04e000640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0300a3350 0x7fc0300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:04.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.556+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fc0380eeef0 con 0x7fc050101de0 2024-09-15T22:11:04.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.556+0000 7fc047e00640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0300a3350 0x7fc0300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:04.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.557+0000 7fc047e00640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0300a3350 0x7fc0300a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0400096c0 tx=0x7fc040009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:04.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.560+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc038049020 con 0x7fc050101de0 2024-09-15T22:11:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:04 smithi169 ceph-mon[35850]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-15T22:11:04.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:04 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2173592389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:11:04.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.751+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc05010a0f0 con 0x7fc050101de0 2024-09-15T22:11:04.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.752+0000 7fc04e000640 1 -- 172.21.15.150:0/896560858 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0380bbb50 con 0x7fc050101de0 2024-09-15T22:11:04.754 INFO:teuthology.orchestra.run.smithi150.stdout:68719476809 2024-09-15T22:11:04.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0300a3350 msgr2=0x7fc0300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0300a3350 0x7fc0300a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0400096c0 tx=0x7fc040009260 comp rx=0 tx=0).stop 2024-09-15T22:11:04.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 msgr2=0x7fc050198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc050198430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc03802a860 tx=0x7fc038033b60 comp rx=0 tx=0).stop 2024-09-15T22:11:04.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 shutdown_connections 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0300a3350 0x7fc0300a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc050106f10 0x7fc05019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc050102790 0x7fc050198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 --2- 172.21.15.150:0/896560858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc050101de0 0x7fc050198430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 >> 172.21.15.150:0/896560858 conn(0x7fc0500fd8c0 msgr2=0x7fc0500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.754+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 shutdown_connections 2024-09-15T22:11:04.757 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:04.755+0000 7fc057400640 1 -- 172.21.15.150:0/896560858 wait complete. 2024-09-15T22:11:05.072 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888120 got 146028888123 for osd.5 2024-09-15T22:11:05.072 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:05.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:05 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/896560858' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:11:05.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:05.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:05 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:05.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:05 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/896560858' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:11:05.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:05.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:05 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:05.549 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037795 got 257698037797 for osd.9 2024-09-15T22:11:05.549 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:05 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/896560858' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:11:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:05 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:06.183 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476806 got 68719476809 for osd.2 2024-09-15T22:11:06.184 DEBUG:teuthology.parallel:result is None 2024-09-15T22:11:06.184 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:11:06.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:11:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:06 smithi150 ceph-mon[30886]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-15T22:11:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:06.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:06.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:06 smithi154 ceph-mon[34853]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-15T22:11:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:06.556 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:06 smithi169 ceph-mon[35850]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-15T22:11:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:11:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.154+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2725715851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 msgr2=0x7ffbf41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.154+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2725715851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf41021c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009900 tx=0x7ffbe402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2725715851 shutdown_connections 2024-09-15T22:11:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2725715851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbf4106f10 0x7ffbf410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2725715851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbf4102790 0x7ffbf41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2725715851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf41021c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2725715851 >> 172.21.15.150:0/2725715851 conn(0x7ffbf40fd8c0 msgr2=0x7ffbf40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:07.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2725715851 shutdown_connections 2024-09-15T22:11:07.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.155+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2725715851 wait complete. 2024-09-15T22:11:07.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 Processor -- start 2024-09-15T22:11:07.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 -- start start 2024-09-15T22:11:07.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:07.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbf4102790 0x7ffbf4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:07.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbf4106f10 0x7ffbf419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4111f30 con 0x7ffbf4101de0 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4111db0 con 0x7ffbf4102790 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf9c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf41120b0 con 0x7ffbf4106f10 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.156+0000 7ffbf2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf4198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55292/0 (socket says 172.21.15.150:55292) 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 -- 172.21.15.150:0/2812190303 learned_addr learned my addr 172.21.15.150:0/2812190303 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbea000640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbf4102790 0x7ffbf4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf3400640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbf4106f10 0x7ffbf419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 -- 172.21.15.150:0/2812190303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbf4106f10 msgr2=0x7ffbf419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbf4106f10 0x7ffbf419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 -- 172.21.15.150:0/2812190303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbf4102790 msgr2=0x7ffbf4198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:07.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbf4102790 0x7ffbf4198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 -- 172.21.15.150:0/2812190303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf419d3f0 con 0x7ffbf4101de0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.157+0000 7ffbf2a00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf4198440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4006010 tx=0x7ffbe4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.158+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe403f030 con 0x7ffbf4101de0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.158+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe4004440 con 0x7ffbf4101de0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.158+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4035070 con 0x7ffbf4101de0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.158+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf419d680 con 0x7ffbf4101de0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.158+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf41a4fc0 con 0x7ffbf4101de0 2024-09-15T22:11:07.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.159+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf41032c0 con 0x7ffbf4101de0 2024-09-15T22:11:07.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.161+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ffbe4042030 con 0x7ffbf4101de0 2024-09-15T22:11:07.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.162+0000 7ffbebe00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ffbd80a3350 0x7ffbd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:07.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.162+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7ffbe40efde0 con 0x7ffbf4101de0 2024-09-15T22:11:07.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.162+0000 7ffbea000640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ffbd80a3350 0x7ffbd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:07.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.163+0000 7ffbea000640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ffbd80a3350 0x7ffbd80a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0095f0 tx=0x7ffbdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:07.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.166+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffbe40bc2e0 con 0x7ffbf4101de0 2024-09-15T22:11:07.339 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.338+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbf410a160 con 0x7ffbd80a3350 2024-09-15T22:11:07.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.344+0000 7ffbebe00640 1 -- 172.21.15.150:0/2812190303 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7ffbdc01b3f0 con 0x7ffbd80a3350 2024-09-15T22:11:07.348 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:07.350 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ffbd80a3350 msgr2=0x7ffbd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ffbd80a3350 0x7ffbd80a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0095f0 tx=0x7ffbdc005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 msgr2=0x7ffbf4198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf4198440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4006010 tx=0x7ffbe4004040 comp rx=0 tx=0).stop 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 shutdown_connections 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbf4106f10 0x7ffbf419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbf4102790 0x7ffbf4198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ffbd80a3350 0x7ffbd80a5810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 --2- 172.21.15.150:0/2812190303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbf4101de0 0x7ffbf4198440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:07.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 >> 172.21.15.150:0/2812190303 conn(0x7ffbf40fd8c0 msgr2=0x7ffbf40fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:07.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 shutdown_connections 2024-09-15T22:11:07.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:07.348+0000 7ffbf9c00640 1 -- 172.21.15.150:0/2812190303 wait complete. 2024-09-15T22:11:08.002 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-15T22:11:07.154464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658107,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":705,"num_read_kb":472,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1180853,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366364,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575460,"statfs":{"total":1151940427776,"available":1151565271040,"internally_reserved":0,"allocated":13185024,"data_stored":7292421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003318"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225397+0000","last_change":"2024-09-15T22:09:56.697241+0000","last_active":"2024-09-15T22:10:44.225397+0000","last_peered":"2024-09-15T22:10:44.225397+0000","last_clean":"2024-09-15T22:10:44.225397+0000","last_became_active":"2024-09-15T22:09:56.696904+0000","last_became_peered":"2024-09-15T22:09:56.696904+0000","last_unstale":"2024-09-15T22:10:44.225397+0000","last_undegraded":"2024-09-15T22:10:44.225397+0000","last_fullsized":"2024-09-15T22:10:44.225397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.950386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336016+0000","last_change":"2024-09-15T22:09:56.693450+0000","last_active":"2024-09-15T22:10:44.336016+0000","last_peered":"2024-09-15T22:10:44.336016+0000","last_clean":"2024-09-15T22:10:44.336016+0000","last_became_active":"2024-09-15T22:09:56.693140+0000","last_became_peered":"2024-09-15T22:09:56.693140+0000","last_unstale":"2024-09-15T22:10:44.336016+0000","last_undegraded":"2024-09-15T22:10:44.336016+0000","last_fullsized":"2024-09-15T22:10:44.336016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.664485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.335981+0000","last_change":"2024-09-15T22:09:56.692816+0000","last_active":"2024-09-15T22:10:44.335981+0000","last_peered":"2024-09-15T22:10:44.335981+0000","last_clean":"2024-09-15T22:10:44.335981+0000","last_became_active":"2024-09-15T22:09:56.692367+0000","last_became_peered":"2024-09-15T22:09:56.692367+0000","last_unstale":"2024-09-15T22:10:44.335981+0000","last_undegraded":"2024-09-15T22:10:44.335981+0000","last_fullsized":"2024-09-15T22:10:44.335981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:36.412415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.337014+0000","last_change":"2024-09-15T22:09:56.704312+0000","last_active":"2024-09-15T22:10:44.337014+0000","last_peered":"2024-09-15T22:10:44.337014+0000","last_clean":"2024-09-15T22:10:44.337014+0000","last_became_active":"2024-09-15T22:09:56.703976+0000","last_became_peered":"2024-09-15T22:09:56.703976+0000","last_unstale":"2024-09-15T22:10:44.337014+0000","last_undegraded":"2024-09-15T22:10:44.337014+0000","last_fullsized":"2024-09-15T22:10:44.337014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:59.911956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222626+0000","last_change":"2024-09-15T22:09:56.697278+0000","last_active":"2024-09-15T22:10:44.222626+0000","last_peered":"2024-09-15T22:10:44.222626+0000","last_clean":"2024-09-15T22:10:44.222626+0000","last_became_active":"2024-09-15T22:09:56.696971+0000","last_became_peered":"2024-09-15T22:09:56.696971+0000","last_unstale":"2024-09-15T22:10:44.222626+0000","last_undegraded":"2024-09-15T22:10:44.222626+0000","last_fullsized":"2024-09-15T22:10:44.222626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:49.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226488+0000","last_change":"2024-09-15T22:09:56.701215+0000","last_active":"2024-09-15T22:10:44.226488+0000","last_peered":"2024-09-15T22:10:44.226488+0000","last_clean":"2024-09-15T22:10:44.226488+0000","last_became_active":"2024-09-15T22:09:56.695891+0000","last_became_peered":"2024-09-15T22:09:56.695891+0000","last_unstale":"2024-09-15T22:10:44.226488+0000","last_undegraded":"2024-09-15T22:10:44.226488+0000","last_fullsized":"2024-09-15T22:10:44.226488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:02.065909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223638+0000","last_change":"2024-09-15T22:09:56.697684+0000","last_active":"2024-09-15T22:10:44.223638+0000","last_peered":"2024-09-15T22:10:44.223638+0000","last_clean":"2024-09-15T22:10:44.223638+0000","last_became_active":"2024-09-15T22:09:56.697360+0000","last_became_peered":"2024-09-15T22:09:56.697360+0000","last_unstale":"2024-09-15T22:10:44.223638+0000","last_undegraded":"2024-09-15T22:10:44.223638+0000","last_fullsized":"2024-09-15T22:10:44.223638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:04.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226623+0000","last_change":"2024-09-15T22:09:56.700712+0000","last_active":"2024-09-15T22:10:44.226623+0000","last_peered":"2024-09-15T22:10:44.226623+0000","last_clean":"2024-09-15T22:10:44.226623+0000","last_became_active":"2024-09-15T22:09:56.700379+0000","last_became_peered":"2024-09-15T22:09:56.700379+0000","last_unstale":"2024-09-15T22:10:44.226623+0000","last_undegraded":"2024-09-15T22:10:44.226623+0000","last_fullsized":"2024-09-15T22:10:44.226623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:28.701496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227586+0000","last_change":"2024-09-15T22:10:44.226513+0000","last_active":"2024-09-15T22:10:44.227586+0000","last_peered":"2024-09-15T22:10:44.227586+0000","last_clean":"2024-09-15T22:10:44.227586+0000","last_became_active":"2024-09-15T22:10:44.226141+0000","last_became_peered":"2024-09-15T22:10:44.226141+0000","last_unstale":"2024-09-15T22:10:44.227586+0000","last_undegraded":"2024-09-15T22:10:44.227586+0000","last_fullsized":"2024-09-15T22:10:44.227586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:11.120364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227221+0000","last_change":"2024-09-15T22:09:56.700740+0000","last_active":"2024-09-15T22:10:44.227221+0000","last_peered":"2024-09-15T22:10:44.227221+0000","last_clean":"2024-09-15T22:10:44.227221+0000","last_became_active":"2024-09-15T22:09:56.700367+0000","last_became_peered":"2024-09-15T22:09:56.700367+0000","last_unstale":"2024-09-15T22:10:44.227221+0000","last_undegraded":"2024-09-15T22:10:44.227221+0000","last_fullsized":"2024-09-15T22:10:44.227221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:39.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223772+0000","last_change":"2024-09-15T22:09:56.693630+0000","last_active":"2024-09-15T22:10:44.223772+0000","last_peered":"2024-09-15T22:10:44.223772+0000","last_clean":"2024-09-15T22:10:44.223772+0000","last_became_active":"2024-09-15T22:09:56.693341+0000","last_became_peered":"2024-09-15T22:09:56.693341+0000","last_unstale":"2024-09-15T22:10:44.223772+0000","last_undegraded":"2024-09-15T22:10:44.223772+0000","last_fullsized":"2024-09-15T22:10:44.223772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:13.738884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.337019+0000","last_change":"2024-09-15T22:09:56.704364+0000","last_active":"2024-09-15T22:10:44.337019+0000","last_peered":"2024-09-15T22:10:44.337019+0000","last_clean":"2024-09-15T22:10:44.337019+0000","last_became_active":"2024-09-15T22:09:56.703807+0000","last_became_peered":"2024-09-15T22:09:56.703807+0000","last_unstale":"2024-09-15T22:10:44.337019+0000","last_undegraded":"2024-09-15T22:10:44.337019+0000","last_fullsized":"2024-09-15T22:10:44.337019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:11.054261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228796+0000","last_change":"2024-09-15T22:09:56.698001+0000","last_active":"2024-09-15T22:10:44.228796+0000","last_peered":"2024-09-15T22:10:44.228796+0000","last_clean":"2024-09-15T22:10:44.228796+0000","last_became_active":"2024-09-15T22:09:56.696188+0000","last_became_peered":"2024-09-15T22:09:56.696188+0000","last_unstale":"2024-09-15T22:10:44.228796+0000","last_undegraded":"2024-09-15T22:10:44.228796+0000","last_fullsized":"2024-09-15T22:10:44.228796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:00.113552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.335888+0000","last_change":"2024-09-15T22:09:56.693422+0000","last_active":"2024-09-15T22:10:44.335888+0000","last_peered":"2024-09-15T22:10:44.335888+0000","last_clean":"2024-09-15T22:10:44.335888+0000","last_became_active":"2024-09-15T22:09:56.693041+0000","last_became_peered":"2024-09-15T22:09:56.693041+0000","last_unstale":"2024-09-15T22:10:44.335888+0000","last_undegraded":"2024-09-15T22:10:44.335888+0000","last_fullsized":"2024-09-15T22:10:44.335888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:57.145008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.335964+0000","last_change":"2024-09-15T22:09:56.704449+0000","last_active":"2024-09-15T22:10:44.335964+0000","last_peered":"2024-09-15T22:10:44.335964+0000","last_clean":"2024-09-15T22:10:44.335964+0000","last_became_active":"2024-09-15T22:09:56.704021+0000","last_became_peered":"2024-09-15T22:09:56.704021+0000","last_unstale":"2024-09-15T22:10:44.335964+0000","last_undegraded":"2024-09-15T22:10:44.335964+0000","last_fullsized":"2024-09-15T22:10:44.335964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:56.149392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223497+0000","last_change":"2024-09-15T22:09:56.693385+0000","last_active":"2024-09-15T22:10:44.223497+0000","last_peered":"2024-09-15T22:10:44.223497+0000","last_clean":"2024-09-15T22:10:44.223497+0000","last_became_active":"2024-09-15T22:09:56.692744+0000","last_became_peered":"2024-09-15T22:09:56.692744+0000","last_unstale":"2024-09-15T22:10:44.223497+0000","last_undegraded":"2024-09-15T22:10:44.223497+0000","last_fullsized":"2024-09-15T22:10:44.223497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:38.996962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225472+0000","last_change":"2024-09-15T22:09:56.695902+0000","last_active":"2024-09-15T22:10:44.225472+0000","last_peered":"2024-09-15T22:10:44.225472+0000","last_clean":"2024-09-15T22:10:44.225472+0000","last_became_active":"2024-09-15T22:09:56.695534+0000","last_became_peered":"2024-09-15T22:09:56.695534+0000","last_unstale":"2024-09-15T22:10:44.225472+0000","last_undegraded":"2024-09-15T22:10:44.225472+0000","last_fullsized":"2024-09-15T22:10:44.225472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:47.052196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222733+0000","last_change":"2024-09-15T22:09:56.695057+0000","last_active":"2024-09-15T22:10:44.222733+0000","last_peered":"2024-09-15T22:10:44.222733+0000","last_clean":"2024-09-15T22:10:44.222733+0000","last_became_active":"2024-09-15T22:09:56.694577+0000","last_became_peered":"2024-09-15T22:09:56.694577+0000","last_unstale":"2024-09-15T22:10:44.222733+0000","last_undegraded":"2024-09-15T22:10:44.222733+0000","last_fullsized":"2024-09-15T22:10:44.222733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:34.572928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226761+0000","last_change":"2024-09-15T22:09:56.698918+0000","last_active":"2024-09-15T22:10:44.226761+0000","last_peered":"2024-09-15T22:10:44.226761+0000","last_clean":"2024-09-15T22:10:44.226761+0000","last_became_active":"2024-09-15T22:09:56.698600+0000","last_became_peered":"2024-09-15T22:09:56.698600+0000","last_unstale":"2024-09-15T22:10:44.226761+0000","last_undegraded":"2024-09-15T22:10:44.226761+0000","last_fullsized":"2024-09-15T22:10:44.226761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:41.350724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228768+0000","last_change":"2024-09-15T22:10:44.228768+0000","last_active":"2024-09-15T22:10:44.228768+0000","last_peered":"2024-09-15T22:10:44.228768+0000","last_clean":"2024-09-15T22:10:44.228768+0000","last_became_active":"2024-09-15T22:10:44.228305+0000","last_became_peered":"2024-09-15T22:10:44.228305+0000","last_unstale":"2024-09-15T22:10:44.228768+0000","last_undegraded":"2024-09-15T22:10:44.228768+0000","last_fullsized":"2024-09-15T22:10:44.228768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:38.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229089+0000","last_change":"2024-09-15T22:09:56.698638+0000","last_active":"2024-09-15T22:10:44.229089+0000","last_peered":"2024-09-15T22:10:44.229089+0000","last_clean":"2024-09-15T22:10:44.229089+0000","last_became_active":"2024-09-15T22:09:56.696666+0000","last_became_peered":"2024-09-15T22:09:56.696666+0000","last_unstale":"2024-09-15T22:10:44.229089+0000","last_undegraded":"2024-09-15T22:10:44.229089+0000","last_fullsized":"2024-09-15T22:10:44.229089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:55.272401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223475+0000","last_change":"2024-09-15T22:09:56.696020+0000","last_active":"2024-09-15T22:10:44.223475+0000","last_peered":"2024-09-15T22:10:44.223475+0000","last_clean":"2024-09-15T22:10:44.223475+0000","last_became_active":"2024-09-15T22:09:56.695648+0000","last_became_peered":"2024-09-15T22:09:56.695648+0000","last_unstale":"2024-09-15T22:10:44.223475+0000","last_undegraded":"2024-09-15T22:10:44.223475+0000","last_fullsized":"2024-09-15T22:10:44.223475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:12.413993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226831+0000","last_change":"2024-09-15T22:09:56.695593+0000","last_active":"2024-09-15T22:10:44.226831+0000","last_peered":"2024-09-15T22:10:44.226831+0000","last_clean":"2024-09-15T22:10:44.226831+0000","last_became_active":"2024-09-15T22:09:56.695227+0000","last_became_peered":"2024-09-15T22:09:56.695227+0000","last_unstale":"2024-09-15T22:10:44.226831+0000","last_undegraded":"2024-09-15T22:10:44.226831+0000","last_fullsized":"2024-09-15T22:10:44.226831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:08.685355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.231320+0000","last_change":"2024-09-15T22:10:44.231320+0000","last_active":"2024-09-15T22:10:44.231320+0000","last_peered":"2024-09-15T22:10:44.231320+0000","last_clean":"2024-09-15T22:10:44.231320+0000","last_became_active":"2024-09-15T22:10:44.230984+0000","last_became_peered":"2024-09-15T22:10:44.230984+0000","last_unstale":"2024-09-15T22:10:44.231320+0000","last_undegraded":"2024-09-15T22:10:44.231320+0000","last_fullsized":"2024-09-15T22:10:44.231320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:42.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227037+0000","last_change":"2024-09-15T22:09:56.708370+0000","last_active":"2024-09-15T22:10:44.227037+0000","last_peered":"2024-09-15T22:10:44.227037+0000","last_clean":"2024-09-15T22:10:44.227037+0000","last_became_active":"2024-09-15T22:09:56.707971+0000","last_became_peered":"2024-09-15T22:09:56.707971+0000","last_unstale":"2024-09-15T22:10:44.227037+0000","last_undegraded":"2024-09-15T22:10:44.227037+0000","last_fullsized":"2024-09-15T22:10:44.227037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:54.066532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226545+0000","last_change":"2024-09-15T22:09:56.690437+0000","last_active":"2024-09-15T22:10:44.226545+0000","last_peered":"2024-09-15T22:10:44.226545+0000","last_clean":"2024-09-15T22:10:44.226545+0000","last_became_active":"2024-09-15T22:09:56.690063+0000","last_became_peered":"2024-09-15T22:09:56.690063+0000","last_unstale":"2024-09-15T22:10:44.226545+0000","last_undegraded":"2024-09-15T22:10:44.226545+0000","last_fullsized":"2024-09-15T22:10:44.226545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:58.488119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225407+0000","last_change":"2024-09-15T22:09:56.692654+0000","last_active":"2024-09-15T22:10:44.225407+0000","last_peered":"2024-09-15T22:10:44.225407+0000","last_clean":"2024-09-15T22:10:44.225407+0000","last_became_active":"2024-09-15T22:09:56.692096+0000","last_became_peered":"2024-09-15T22:09:56.692096+0000","last_unstale":"2024-09-15T22:10:44.225407+0000","last_undegraded":"2024-09-15T22:10:44.225407+0000","last_fullsized":"2024-09-15T22:10:44.225407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:40.104024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229389+0000","last_change":"2024-09-15T22:09:56.705271+0000","last_active":"2024-09-15T22:10:44.229389+0000","last_peered":"2024-09-15T22:10:44.229389+0000","last_clean":"2024-09-15T22:10:44.229389+0000","last_became_active":"2024-09-15T22:09:56.703538+0000","last_became_peered":"2024-09-15T22:09:56.703538+0000","last_unstale":"2024-09-15T22:10:44.229389+0000","last_undegraded":"2024-09-15T22:10:44.229389+0000","last_fullsized":"2024-09-15T22:10:44.229389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:50.517516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336136+0000","last_change":"2024-09-15T22:09:56.706134+0000","last_active":"2024-09-15T22:10:44.336136+0000","last_peered":"2024-09-15T22:10:44.336136+0000","last_clean":"2024-09-15T22:10:44.336136+0000","last_became_active":"2024-09-15T22:09:56.705699+0000","last_became_peered":"2024-09-15T22:09:56.705699+0000","last_unstale":"2024-09-15T22:10:44.336136+0000","last_undegraded":"2024-09-15T22:10:44.336136+0000","last_fullsized":"2024-09-15T22:10:44.336136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:12:29.296607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226168+0000","last_change":"2024-09-15T22:09:56.698023+0000","last_active":"2024-09-15T22:10:44.226168+0000","last_peered":"2024-09-15T22:10:44.226168+0000","last_clean":"2024-09-15T22:10:44.226168+0000","last_became_active":"2024-09-15T22:09:56.697664+0000","last_became_peered":"2024-09-15T22:09:56.697664+0000","last_unstale":"2024-09-15T22:10:44.226168+0000","last_undegraded":"2024-09-15T22:10:44.226168+0000","last_fullsized":"2024-09-15T22:10:44.226168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:47.387380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226030+0000","last_change":"2024-09-15T22:09:56.702073+0000","last_active":"2024-09-15T22:10:44.226030+0000","last_peered":"2024-09-15T22:10:44.226030+0000","last_clean":"2024-09-15T22:10:44.226030+0000","last_became_active":"2024-09-15T22:09:56.701663+0000","last_became_peered":"2024-09-15T22:09:56.701663+0000","last_unstale":"2024-09-15T22:10:44.226030+0000","last_undegraded":"2024-09-15T22:10:44.226030+0000","last_fullsized":"2024-09-15T22:10:44.226030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:20.095392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225583+0000","last_change":"2024-09-15T22:09:56.692430+0000","last_active":"2024-09-15T22:10:44.225583+0000","last_peered":"2024-09-15T22:10:44.225583+0000","last_clean":"2024-09-15T22:10:44.225583+0000","last_became_active":"2024-09-15T22:09:56.692068+0000","last_became_peered":"2024-09-15T22:09:56.692068+0000","last_unstale":"2024-09-15T22:10:44.225583+0000","last_undegraded":"2024-09-15T22:10:44.225583+0000","last_fullsized":"2024-09-15T22:10:44.225583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.694497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222557+0000","last_change":"2024-09-15T22:09:56.690234+0000","last_active":"2024-09-15T22:10:44.222557+0000","last_peered":"2024-09-15T22:10:44.222557+0000","last_clean":"2024-09-15T22:10:44.222557+0000","last_became_active":"2024-09-15T22:09:56.689845+0000","last_became_peered":"2024-09-15T22:09:56.689845+0000","last_unstale":"2024-09-15T22:10:44.222557+0000","last_undegraded":"2024-09-15T22:10:44.222557+0000","last_fullsized":"2024-09-15T22:10:44.222557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:32.997578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:03.877244+0000","last_change":"2024-09-15T22:09:54.219344+0000","last_active":"2024-09-15T22:11:03.877244+0000","last_peered":"2024-09-15T22:11:03.877244+0000","last_clean":"2024-09-15T22:11:03.877244+0000","last_became_active":"2024-09-15T22:09:54.218592+0000","last_became_peered":"2024-09-15T22:09:54.218592+0000","last_unstale":"2024-09-15T22:11:03.877244+0000","last_undegraded":"2024-09-15T22:11:03.877244+0000","last_fullsized":"2024-09-15T22:11:03.877244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:44.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220887+0000","last_change":"2024-09-15T22:09:56.703045+0000","last_active":"2024-09-15T22:10:44.220887+0000","last_peered":"2024-09-15T22:10:44.220887+0000","last_clean":"2024-09-15T22:10:44.220887+0000","last_became_active":"2024-09-15T22:09:56.702724+0000","last_became_peered":"2024-09-15T22:09:56.702724+0000","last_unstale":"2024-09-15T22:10:44.220887+0000","last_undegraded":"2024-09-15T22:10:44.220887+0000","last_fullsized":"2024-09-15T22:10:44.220887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.440559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.236756+0000","last_change":"2024-09-15T22:10:44.236756+0000","last_active":"2024-09-15T22:10:44.236756+0000","last_peered":"2024-09-15T22:10:44.236756+0000","last_clean":"2024-09-15T22:10:44.236756+0000","last_became_active":"2024-09-15T22:10:44.230466+0000","last_became_peered":"2024-09-15T22:10:44.230466+0000","last_unstale":"2024-09-15T22:10:44.236756+0000","last_undegraded":"2024-09-15T22:10:44.236756+0000","last_fullsized":"2024-09-15T22:10:44.236756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:32.604042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228871+0000","last_change":"2024-09-15T22:09:54.214589+0000","last_active":"2024-09-15T22:10:44.228871+0000","last_peered":"2024-09-15T22:10:44.228871+0000","last_clean":"2024-09-15T22:10:44.228871+0000","last_became_active":"2024-09-15T22:09:54.214115+0000","last_became_peered":"2024-09-15T22:09:54.214115+0000","last_unstale":"2024-09-15T22:10:44.228871+0000","last_undegraded":"2024-09-15T22:10:44.228871+0000","last_fullsized":"2024-09-15T22:10:44.228871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:05.452310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226724+0000","last_change":"2024-09-15T22:09:56.700414+0000","last_active":"2024-09-15T22:10:44.226724+0000","last_peered":"2024-09-15T22:10:44.226724+0000","last_clean":"2024-09-15T22:10:44.226724+0000","last_became_active":"2024-09-15T22:09:56.700041+0000","last_became_peered":"2024-09-15T22:09:56.700041+0000","last_unstale":"2024-09-15T22:10:44.226724+0000","last_undegraded":"2024-09-15T22:10:44.226724+0000","last_fullsized":"2024-09-15T22:10:44.226724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:08.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220905+0000","last_change":"2024-09-15T22:09:54.219547+0000","last_active":"2024-09-15T22:10:44.220905+0000","last_peered":"2024-09-15T22:10:44.220905+0000","last_clean":"2024-09-15T22:10:44.220905+0000","last_became_active":"2024-09-15T22:09:54.218554+0000","last_became_peered":"2024-09-15T22:09:54.218554+0000","last_unstale":"2024-09-15T22:10:44.220905+0000","last_undegraded":"2024-09-15T22:10:44.220905+0000","last_fullsized":"2024-09-15T22:10:44.220905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:09.478853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222541+0000","last_change":"2024-09-15T22:09:56.694749+0000","last_active":"2024-09-15T22:10:44.222541+0000","last_peered":"2024-09-15T22:10:44.222541+0000","last_clean":"2024-09-15T22:10:44.222541+0000","last_became_active":"2024-09-15T22:09:56.694450+0000","last_became_peered":"2024-09-15T22:09:56.694450+0000","last_unstale":"2024-09-15T22:10:44.222541+0000","last_undegraded":"2024-09-15T22:10:44.222541+0000","last_fullsized":"2024-09-15T22:10:44.222541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:39:19.565705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:03.876529+0000","last_change":"2024-09-15T22:09:54.220137+0000","last_active":"2024-09-15T22:11:03.876529+0000","last_peered":"2024-09-15T22:11:03.876529+0000","last_clean":"2024-09-15T22:11:03.876529+0000","last_became_active":"2024-09-15T22:09:54.219738+0000","last_became_peered":"2024-09-15T22:09:54.219738+0000","last_unstale":"2024-09-15T22:11:03.876529+0000","last_undegraded":"2024-09-15T22:11:03.876529+0000","last_fullsized":"2024-09-15T22:11:03.876529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:56.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223849+0000","last_change":"2024-09-15T22:09:56.694869+0000","last_active":"2024-09-15T22:10:44.223849+0000","last_peered":"2024-09-15T22:10:44.223849+0000","last_clean":"2024-09-15T22:10:44.223849+0000","last_became_active":"2024-09-15T22:09:56.694522+0000","last_became_peered":"2024-09-15T22:09:56.694522+0000","last_unstale":"2024-09-15T22:10:44.223849+0000","last_undegraded":"2024-09-15T22:10:44.223849+0000","last_fullsized":"2024-09-15T22:10:44.223849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:33.633471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.342337+0000","last_change":"2024-09-15T22:10:44.342337+0000","last_active":"2024-09-15T22:10:44.342337+0000","last_peered":"2024-09-15T22:10:44.342337+0000","last_clean":"2024-09-15T22:10:44.342337+0000","last_became_active":"2024-09-15T22:10:44.337736+0000","last_became_peered":"2024-09-15T22:10:44.337736+0000","last_unstale":"2024-09-15T22:10:44.342337+0000","last_undegraded":"2024-09-15T22:10:44.342337+0000","last_fullsized":"2024-09-15T22:10:44.342337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:34.747879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336183+0000","last_change":"2024-09-15T22:09:56.706449+0000","last_active":"2024-09-15T22:10:44.336183+0000","last_peered":"2024-09-15T22:10:44.336183+0000","last_clean":"2024-09-15T22:10:44.336183+0000","last_became_active":"2024-09-15T22:09:56.705380+0000","last_became_peered":"2024-09-15T22:09:56.705380+0000","last_unstale":"2024-09-15T22:10:44.336183+0000","last_undegraded":"2024-09-15T22:10:44.336183+0000","last_fullsized":"2024-09-15T22:10:44.336183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:24.422911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.221306+0000","last_change":"2024-09-15T22:09:54.478189+0000","last_active":"2024-09-15T22:10:44.221306+0000","last_peered":"2024-09-15T22:10:44.221306+0000","last_clean":"2024-09-15T22:10:44.221306+0000","last_became_active":"2024-09-15T22:09:54.477846+0000","last_became_peered":"2024-09-15T22:09:54.477846+0000","last_unstale":"2024-09-15T22:10:44.221306+0000","last_undegraded":"2024-09-15T22:10:44.221306+0000","last_fullsized":"2024-09-15T22:10:44.221306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:00.944061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.231738+0000","last_change":"2024-09-15T22:10:44.231738+0000","last_active":"2024-09-15T22:10:44.231738+0000","last_peered":"2024-09-15T22:10:44.231738+0000","last_clean":"2024-09-15T22:10:44.231738+0000","last_became_active":"2024-09-15T22:10:44.231326+0000","last_became_peered":"2024-09-15T22:10:44.231326+0000","last_unstale":"2024-09-15T22:10:44.231738+0000","last_undegraded":"2024-09-15T22:10:44.231738+0000","last_fullsized":"2024-09-15T22:10:44.231738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:02.695099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:03.876446+0000","last_change":"2024-09-15T22:09:54.216447+0000","last_active":"2024-09-15T22:11:03.876446+0000","last_peered":"2024-09-15T22:11:03.876446+0000","last_clean":"2024-09-15T22:11:03.876446+0000","last_became_active":"2024-09-15T22:09:54.216102+0000","last_became_peered":"2024-09-15T22:09:54.216102+0000","last_unstale":"2024-09-15T22:11:03.876446+0000","last_undegraded":"2024-09-15T22:11:03.876446+0000","last_fullsized":"2024-09-15T22:11:03.876446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:55.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60690,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223096+0000","last_change":"2024-09-15T22:09:56.694011+0000","last_active":"2024-09-15T22:10:44.223096+0000","last_peered":"2024-09-15T22:10:44.223096+0000","last_clean":"2024-09-15T22:10:44.223096+0000","last_became_active":"2024-09-15T22:09:56.693447+0000","last_became_peered":"2024-09-15T22:09:56.693447+0000","last_unstale":"2024-09-15T22:10:44.223096+0000","last_undegraded":"2024-09-15T22:10:44.223096+0000","last_fullsized":"2024-09-15T22:10:44.223096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226099+0000","last_change":"2024-09-15T22:09:54.221406+0000","last_active":"2024-09-15T22:10:44.226099+0000","last_peered":"2024-09-15T22:10:44.226099+0000","last_clean":"2024-09-15T22:10:44.226099+0000","last_became_active":"2024-09-15T22:09:54.220752+0000","last_became_peered":"2024-09-15T22:09:54.220752+0000","last_unstale":"2024-09-15T22:10:44.226099+0000","last_undegraded":"2024-09-15T22:10:44.226099+0000","last_fullsized":"2024-09-15T22:10:44.226099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.198214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228871+0000","last_change":"2024-09-15T22:09:56.697991+0000","last_active":"2024-09-15T22:10:44.228871+0000","last_peered":"2024-09-15T22:10:44.228871+0000","last_clean":"2024-09-15T22:10:44.228871+0000","last_became_active":"2024-09-15T22:09:56.695867+0000","last_became_peered":"2024-09-15T22:09:56.695867+0000","last_unstale":"2024-09-15T22:10:44.228871+0000","last_undegraded":"2024-09-15T22:10:44.228871+0000","last_fullsized":"2024-09-15T22:10:44.228871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:05.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220877+0000","last_change":"2024-09-15T22:09:54.219276+0000","last_active":"2024-09-15T22:10:44.220877+0000","last_peered":"2024-09-15T22:10:44.220877+0000","last_clean":"2024-09-15T22:10:44.220877+0000","last_became_active":"2024-09-15T22:09:54.218940+0000","last_became_peered":"2024-09-15T22:09:54.218940+0000","last_unstale":"2024-09-15T22:10:44.220877+0000","last_undegraded":"2024-09-15T22:10:44.220877+0000","last_fullsized":"2024-09-15T22:10:44.220877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:38.511671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224613+0000","last_change":"2024-09-15T22:09:56.703202+0000","last_active":"2024-09-15T22:10:44.224613+0000","last_peered":"2024-09-15T22:10:44.224613+0000","last_clean":"2024-09-15T22:10:44.224613+0000","last_became_active":"2024-09-15T22:09:56.702871+0000","last_became_peered":"2024-09-15T22:09:56.702871+0000","last_unstale":"2024-09-15T22:10:44.224613+0000","last_undegraded":"2024-09-15T22:10:44.224613+0000","last_fullsized":"2024-09-15T22:10:44.224613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:08.404847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:02.875155+0000","last_change":"2024-09-15T22:09:54.219948+0000","last_active":"2024-09-15T22:11:02.875155+0000","last_peered":"2024-09-15T22:11:02.875155+0000","last_clean":"2024-09-15T22:11:02.875155+0000","last_became_active":"2024-09-15T22:09:54.219603+0000","last_became_peered":"2024-09-15T22:09:54.219603+0000","last_unstale":"2024-09-15T22:11:02.875155+0000","last_undegraded":"2024-09-15T22:11:02.875155+0000","last_fullsized":"2024-09-15T22:11:02.875155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:07.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223753+0000","last_change":"2024-09-15T22:09:56.698203+0000","last_active":"2024-09-15T22:10:44.223753+0000","last_peered":"2024-09-15T22:10:44.223753+0000","last_clean":"2024-09-15T22:10:44.223753+0000","last_became_active":"2024-09-15T22:09:56.697882+0000","last_became_peered":"2024-09-15T22:09:56.697882+0000","last_unstale":"2024-09-15T22:10:44.223753+0000","last_undegraded":"2024-09-15T22:10:44.223753+0000","last_fullsized":"2024-09-15T22:10:44.223753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:29.865810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223113+0000","last_change":"2024-09-15T22:09:54.477287+0000","last_active":"2024-09-15T22:10:44.223113+0000","last_peered":"2024-09-15T22:10:44.223113+0000","last_clean":"2024-09-15T22:10:44.223113+0000","last_became_active":"2024-09-15T22:09:54.476895+0000","last_became_peered":"2024-09-15T22:09:54.476895+0000","last_unstale":"2024-09-15T22:10:44.223113+0000","last_undegraded":"2024-09-15T22:10:44.223113+0000","last_fullsized":"2024-09-15T22:10:44.223113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:22.940445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220750+0000","last_change":"2024-09-15T22:09:56.703388+0000","last_active":"2024-09-15T22:10:44.220750+0000","last_peered":"2024-09-15T22:10:44.220750+0000","last_clean":"2024-09-15T22:10:44.220750+0000","last_became_active":"2024-09-15T22:09:56.703053+0000","last_became_peered":"2024-09-15T22:09:56.703053+0000","last_unstale":"2024-09-15T22:10:44.220750+0000","last_undegraded":"2024-09-15T22:10:44.220750+0000","last_fullsized":"2024-09-15T22:10:44.220750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:22.700159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223142+0000","last_change":"2024-09-15T22:09:54.217269+0000","last_active":"2024-09-15T22:10:44.223142+0000","last_peered":"2024-09-15T22:10:44.223142+0000","last_clean":"2024-09-15T22:10:44.223142+0000","last_became_active":"2024-09-15T22:09:54.216887+0000","last_became_peered":"2024-09-15T22:09:54.216887+0000","last_unstale":"2024-09-15T22:10:44.223142+0000","last_undegraded":"2024-09-15T22:10:44.223142+0000","last_fullsized":"2024-09-15T22:10:44.223142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:35.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225469+0000","last_change":"2024-09-15T22:09:56.696293+0000","last_active":"2024-09-15T22:10:44.225469+0000","last_peered":"2024-09-15T22:10:44.225469+0000","last_clean":"2024-09-15T22:10:44.225469+0000","last_became_active":"2024-09-15T22:09:56.695954+0000","last_became_peered":"2024-09-15T22:09:56.695954+0000","last_unstale":"2024-09-15T22:10:44.225469+0000","last_undegraded":"2024-09-15T22:10:44.225469+0000","last_fullsized":"2024-09-15T22:10:44.225469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:23.933813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229378+0000","last_change":"2024-09-15T22:09:54.219608+0000","last_active":"2024-09-15T22:10:44.229378+0000","last_peered":"2024-09-15T22:10:44.229378+0000","last_clean":"2024-09-15T22:10:44.229378+0000","last_became_active":"2024-09-15T22:09:54.218700+0000","last_became_peered":"2024-09-15T22:09:54.218700+0000","last_unstale":"2024-09-15T22:10:44.229378+0000","last_undegraded":"2024-09-15T22:10:44.229378+0000","last_fullsized":"2024-09-15T22:10:44.229378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:55.941217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224937+0000","last_change":"2024-09-15T22:09:56.693898+0000","last_active":"2024-09-15T22:10:44.224937+0000","last_peered":"2024-09-15T22:10:44.224937+0000","last_clean":"2024-09-15T22:10:44.224937+0000","last_became_active":"2024-09-15T22:09:56.692960+0000","last_became_peered":"2024-09-15T22:09:56.692960+0000","last_unstale":"2024-09-15T22:10:44.224937+0000","last_undegraded":"2024-09-15T22:10:44.224937+0000","last_fullsized":"2024-09-15T22:10:44.224937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:50.150574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.221413+0000","last_change":"2024-09-15T22:09:54.220757+0000","last_active":"2024-09-15T22:10:44.221413+0000","last_peered":"2024-09-15T22:10:44.221413+0000","last_clean":"2024-09-15T22:10:44.221413+0000","last_became_active":"2024-09-15T22:09:54.220371+0000","last_became_peered":"2024-09-15T22:09:54.220371+0000","last_unstale":"2024-09-15T22:10:44.221413+0000","last_undegraded":"2024-09-15T22:10:44.221413+0000","last_fullsized":"2024-09-15T22:10:44.221413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:07.234474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.233473+0000","last_change":"2024-09-15T22:10:44.233473+0000","last_active":"2024-09-15T22:10:44.233473+0000","last_peered":"2024-09-15T22:10:44.233473+0000","last_clean":"2024-09-15T22:10:44.233473+0000","last_became_active":"2024-09-15T22:10:44.227961+0000","last_became_peered":"2024-09-15T22:10:44.227961+0000","last_unstale":"2024-09-15T22:10:44.233473+0000","last_undegraded":"2024-09-15T22:10:44.233473+0000","last_fullsized":"2024-09-15T22:10:44.233473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:17.119043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:02.875785+0000","last_change":"2024-09-15T22:09:55.000482+0000","last_active":"2024-09-15T22:11:02.875785+0000","last_peered":"2024-09-15T22:11:02.875785+0000","last_clean":"2024-09-15T22:11:02.875785+0000","last_became_active":"2024-09-15T22:09:55.000088+0000","last_became_peered":"2024-09-15T22:09:55.000088+0000","last_unstale":"2024-09-15T22:11:02.875785+0000","last_undegraded":"2024-09-15T22:11:02.875785+0000","last_fullsized":"2024-09-15T22:11:02.875785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:48.309582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223901+0000","last_change":"2024-09-15T22:09:56.699129+0000","last_active":"2024-09-15T22:10:44.223901+0000","last_peered":"2024-09-15T22:10:44.223901+0000","last_clean":"2024-09-15T22:10:44.223901+0000","last_became_active":"2024-09-15T22:09:56.698107+0000","last_became_peered":"2024-09-15T22:09:56.698107+0000","last_unstale":"2024-09-15T22:10:44.223901+0000","last_undegraded":"2024-09-15T22:10:44.223901+0000","last_fullsized":"2024-09-15T22:10:44.223901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:35.436908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224039+0000","last_change":"2024-09-15T22:08:41.556517+0000","last_active":"2024-09-15T22:10:44.224039+0000","last_peered":"2024-09-15T22:10:44.224039+0000","last_clean":"2024-09-15T22:10:44.224039+0000","last_became_active":"2024-09-15T22:08:41.555887+0000","last_became_peered":"2024-09-15T22:08:41.555887+0000","last_unstale":"2024-09-15T22:10:44.224039+0000","last_undegraded":"2024-09-15T22:10:44.224039+0000","last_fullsized":"2024-09-15T22:10:44.224039+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_clean_scrub_stamp":"2024-09-15T22:05:05.654738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:29.105403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336748+0000","last_change":"2024-09-15T22:09:54.220522+0000","last_active":"2024-09-15T22:10:44.336748+0000","last_peered":"2024-09-15T22:10:44.336748+0000","last_clean":"2024-09-15T22:10:44.336748+0000","last_became_active":"2024-09-15T22:09:54.220174+0000","last_became_peered":"2024-09-15T22:09:54.220174+0000","last_unstale":"2024-09-15T22:10:44.336748+0000","last_undegraded":"2024-09-15T22:10:44.336748+0000","last_fullsized":"2024-09-15T22:10:44.336748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:33.909055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226905+0000","last_change":"2024-09-15T22:09:56.703268+0000","last_active":"2024-09-15T22:10:44.226905+0000","last_peered":"2024-09-15T22:10:44.226905+0000","last_clean":"2024-09-15T22:10:44.226905+0000","last_became_active":"2024-09-15T22:09:56.701096+0000","last_became_peered":"2024-09-15T22:09:56.701096+0000","last_unstale":"2024-09-15T22:10:44.226905+0000","last_undegraded":"2024-09-15T22:10:44.226905+0000","last_fullsized":"2024-09-15T22:10:44.226905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:30.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223937+0000","last_change":"2024-09-15T22:09:54.220913+0000","last_active":"2024-09-15T22:10:44.223937+0000","last_peered":"2024-09-15T22:10:44.223937+0000","last_clean":"2024-09-15T22:10:44.223937+0000","last_became_active":"2024-09-15T22:09:54.220476+0000","last_became_peered":"2024-09-15T22:09:54.220476+0000","last_unstale":"2024-09-15T22:10:44.223937+0000","last_undegraded":"2024-09-15T22:10:44.223937+0000","last_fullsized":"2024-09-15T22:10:44.223937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:27.087931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228509+0000","last_change":"2024-09-15T22:09:56.704428+0000","last_active":"2024-09-15T22:10:44.228509+0000","last_peered":"2024-09-15T22:10:44.228509+0000","last_clean":"2024-09-15T22:10:44.228509+0000","last_became_active":"2024-09-15T22:09:56.703856+0000","last_became_peered":"2024-09-15T22:09:56.703856+0000","last_unstale":"2024-09-15T22:10:44.228509+0000","last_undegraded":"2024-09-15T22:10:44.228509+0000","last_fullsized":"2024-09-15T22:10:44.228509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:56.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:02.874394+0000","last_change":"2024-09-15T22:09:54.476737+0000","last_active":"2024-09-15T22:11:02.874394+0000","last_peered":"2024-09-15T22:11:02.874394+0000","last_clean":"2024-09-15T22:11:02.874394+0000","last_became_active":"2024-09-15T22:09:54.476256+0000","last_became_peered":"2024-09-15T22:09:54.476256+0000","last_unstale":"2024-09-15T22:11:02.874394+0000","last_undegraded":"2024-09-15T22:11:02.874394+0000","last_fullsized":"2024-09-15T22:11:02.874394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:26.775968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220760+0000","last_change":"2024-09-15T22:09:56.703160+0000","last_active":"2024-09-15T22:10:44.220760+0000","last_peered":"2024-09-15T22:10:44.220760+0000","last_clean":"2024-09-15T22:10:44.220760+0000","last_became_active":"2024-09-15T22:09:56.702822+0000","last_became_peered":"2024-09-15T22:09:56.702822+0000","last_unstale":"2024-09-15T22:10:44.220760+0000","last_undegraded":"2024-09-15T22:10:44.220760+0000","last_fullsized":"2024-09-15T22:10:44.220760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:41.188636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:01.873562+0000","last_change":"2024-09-15T22:09:54.219289+0000","last_active":"2024-09-15T22:11:01.873562+0000","last_peered":"2024-09-15T22:11:01.873562+0000","last_clean":"2024-09-15T22:11:01.873562+0000","last_became_active":"2024-09-15T22:09:54.218572+0000","last_became_peered":"2024-09-15T22:09:54.218572+0000","last_unstale":"2024-09-15T22:11:01.873562+0000","last_undegraded":"2024-09-15T22:11:01.873562+0000","last_fullsized":"2024-09-15T22:11:01.873562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:02.294569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227224+0000","last_change":"2024-09-15T22:09:56.698458+0000","last_active":"2024-09-15T22:10:44.227224+0000","last_peered":"2024-09-15T22:10:44.227224+0000","last_clean":"2024-09-15T22:10:44.227224+0000","last_became_active":"2024-09-15T22:09:56.698135+0000","last_became_peered":"2024-09-15T22:09:56.698135+0000","last_unstale":"2024-09-15T22:10:44.227224+0000","last_undegraded":"2024-09-15T22:10:44.227224+0000","last_fullsized":"2024-09-15T22:10:44.227224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:40.002319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222950+0000","last_change":"2024-09-15T22:09:54.478546+0000","last_active":"2024-09-15T22:10:44.222950+0000","last_peered":"2024-09-15T22:10:44.222950+0000","last_clean":"2024-09-15T22:10:44.222950+0000","last_became_active":"2024-09-15T22:09:54.478106+0000","last_became_peered":"2024-09-15T22:09:54.478106+0000","last_unstale":"2024-09-15T22:10:44.222950+0000","last_undegraded":"2024-09-15T22:10:44.222950+0000","last_fullsized":"2024-09-15T22:10:44.222950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:57.687752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226846+0000","last_change":"2024-09-15T22:09:56.697014+0000","last_active":"2024-09-15T22:10:44.226846+0000","last_peered":"2024-09-15T22:10:44.226846+0000","last_clean":"2024-09-15T22:10:44.226846+0000","last_became_active":"2024-09-15T22:09:56.696702+0000","last_became_peered":"2024-09-15T22:09:56.696702+0000","last_unstale":"2024-09-15T22:10:44.226846+0000","last_undegraded":"2024-09-15T22:10:44.226846+0000","last_fullsized":"2024-09-15T22:10:44.226846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:08.687166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223471+0000","last_change":"2024-09-15T22:09:54.477243+0000","last_active":"2024-09-15T22:10:44.223471+0000","last_peered":"2024-09-15T22:10:44.223471+0000","last_clean":"2024-09-15T22:10:44.223471+0000","last_became_active":"2024-09-15T22:09:54.476879+0000","last_became_peered":"2024-09-15T22:09:54.476879+0000","last_unstale":"2024-09-15T22:10:44.223471+0000","last_undegraded":"2024-09-15T22:10:44.223471+0000","last_fullsized":"2024-09-15T22:10:44.223471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:31.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229489+0000","last_change":"2024-09-15T22:09:56.689341+0000","last_active":"2024-09-15T22:10:44.229489+0000","last_peered":"2024-09-15T22:10:44.229489+0000","last_clean":"2024-09-15T22:10:44.229489+0000","last_became_active":"2024-09-15T22:09:56.688925+0000","last_became_peered":"2024-09-15T22:09:56.688925+0000","last_unstale":"2024-09-15T22:10:44.229489+0000","last_undegraded":"2024-09-15T22:10:44.229489+0000","last_fullsized":"2024-09-15T22:10:44.229489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:20.552548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222835+0000","last_change":"2024-09-15T22:09:54.219690+0000","last_active":"2024-09-15T22:10:44.222835+0000","last_peered":"2024-09-15T22:10:44.222835+0000","last_clean":"2024-09-15T22:10:44.222835+0000","last_became_active":"2024-09-15T22:09:54.218962+0000","last_became_peered":"2024-09-15T22:09:54.218962+0000","last_unstale":"2024-09-15T22:10:44.222835+0000","last_undegraded":"2024-09-15T22:10:44.222835+0000","last_fullsized":"2024-09-15T22:10:44.222835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:44.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227315+0000","last_change":"2024-09-15T22:09:56.702350+0000","last_active":"2024-09-15T22:10:44.227315+0000","last_peered":"2024-09-15T22:10:44.227315+0000","last_clean":"2024-09-15T22:10:44.227315+0000","last_became_active":"2024-09-15T22:09:56.699387+0000","last_became_peered":"2024-09-15T22:09:56.699387+0000","last_unstale":"2024-09-15T22:10:44.227315+0000","last_undegraded":"2024-09-15T22:10:44.227315+0000","last_fullsized":"2024-09-15T22:10:44.227315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:47.005526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.337357+0000","last_change":"2024-09-15T22:09:55.000416+0000","last_active":"2024-09-15T22:10:44.337357+0000","last_peered":"2024-09-15T22:10:44.337357+0000","last_clean":"2024-09-15T22:10:44.337357+0000","last_became_active":"2024-09-15T22:09:55.000108+0000","last_became_peered":"2024-09-15T22:09:55.000108+0000","last_unstale":"2024-09-15T22:10:44.337357+0000","last_undegraded":"2024-09-15T22:10:44.337357+0000","last_fullsized":"2024-09-15T22:10:44.337357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:15.005148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336155+0000","last_change":"2024-09-15T22:09:56.707107+0000","last_active":"2024-09-15T22:10:44.336155+0000","last_peered":"2024-09-15T22:10:44.336155+0000","last_clean":"2024-09-15T22:10:44.336155+0000","last_became_active":"2024-09-15T22:09:56.706442+0000","last_became_peered":"2024-09-15T22:09:56.706442+0000","last_unstale":"2024-09-15T22:10:44.336155+0000","last_undegraded":"2024-09-15T22:10:44.336155+0000","last_fullsized":"2024-09-15T22:10:44.336155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:51.381492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223602+0000","last_change":"2024-09-15T22:09:54.477365+0000","last_active":"2024-09-15T22:10:44.223602+0000","last_peered":"2024-09-15T22:10:44.223602+0000","last_clean":"2024-09-15T22:10:44.223602+0000","last_became_active":"2024-09-15T22:09:54.477033+0000","last_became_peered":"2024-09-15T22:09:54.477033+0000","last_unstale":"2024-09-15T22:10:44.223602+0000","last_undegraded":"2024-09-15T22:10:44.223602+0000","last_fullsized":"2024-09-15T22:10:44.223602+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:10.634767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222528+0000","last_change":"2024-09-15T22:09:56.693547+0000","last_active":"2024-09-15T22:10:44.222528+0000","last_peered":"2024-09-15T22:10:44.222528+0000","last_clean":"2024-09-15T22:10:44.222528+0000","last_became_active":"2024-09-15T22:09:56.692923+0000","last_became_peered":"2024-09-15T22:09:56.692923+0000","last_unstale":"2024-09-15T22:10:44.222528+0000","last_undegraded":"2024-09-15T22:10:44.222528+0000","last_fullsized":"2024-09-15T22:10:44.222528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.462232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227400+0000","last_change":"2024-09-15T22:09:54.221737+0000","last_active":"2024-09-15T22:10:44.227400+0000","last_peered":"2024-09-15T22:10:44.227400+0000","last_clean":"2024-09-15T22:10:44.227400+0000","last_became_active":"2024-09-15T22:09:54.221418+0000","last_became_peered":"2024-09-15T22:09:54.221418+0000","last_unstale":"2024-09-15T22:10:44.227400+0000","last_undegraded":"2024-09-15T22:10:44.227400+0000","last_fullsized":"2024-09-15T22:10:44.227400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:35.636403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225088+0000","last_change":"2024-09-15T22:09:56.690290+0000","last_active":"2024-09-15T22:10:44.225088+0000","last_peered":"2024-09-15T22:10:44.225088+0000","last_clean":"2024-09-15T22:10:44.225088+0000","last_became_active":"2024-09-15T22:09:56.689986+0000","last_became_peered":"2024-09-15T22:09:56.689986+0000","last_unstale":"2024-09-15T22:10:44.225088+0000","last_undegraded":"2024-09-15T22:10:44.225088+0000","last_fullsized":"2024-09-15T22:10:44.225088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:53.860697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226295+0000","last_change":"2024-09-15T22:09:54.219569+0000","last_active":"2024-09-15T22:10:44.226295+0000","last_peered":"2024-09-15T22:10:44.226295+0000","last_clean":"2024-09-15T22:10:44.226295+0000","last_became_active":"2024-09-15T22:09:54.219203+0000","last_became_peered":"2024-09-15T22:09:54.219203+0000","last_unstale":"2024-09-15T22:10:44.226295+0000","last_undegraded":"2024-09-15T22:10:44.226295+0000","last_fullsized":"2024-09-15T22:10:44.226295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:21:02.719849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227089+0000","last_change":"2024-09-15T22:09:56.696608+0000","last_active":"2024-09-15T22:10:44.227089+0000","last_peered":"2024-09-15T22:10:44.227089+0000","last_clean":"2024-09-15T22:10:44.227089+0000","last_became_active":"2024-09-15T22:09:56.696301+0000","last_became_peered":"2024-09-15T22:09:56.696301+0000","last_unstale":"2024-09-15T22:10:44.227089+0000","last_undegraded":"2024-09-15T22:10:44.227089+0000","last_fullsized":"2024-09-15T22:10:44.227089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:48.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222801+0000","last_change":"2024-09-15T22:09:54.218426+0000","last_active":"2024-09-15T22:10:44.222801+0000","last_peered":"2024-09-15T22:10:44.222801+0000","last_clean":"2024-09-15T22:10:44.222801+0000","last_became_active":"2024-09-15T22:09:54.218084+0000","last_became_peered":"2024-09-15T22:09:54.218084+0000","last_unstale":"2024-09-15T22:10:44.222801+0000","last_undegraded":"2024-09-15T22:10:44.222801+0000","last_fullsized":"2024-09-15T22:10:44.222801+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:46.067886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224256+0000","last_change":"2024-09-15T22:09:56.696993+0000","last_active":"2024-09-15T22:10:44.224256+0000","last_peered":"2024-09-15T22:10:44.224256+0000","last_clean":"2024-09-15T22:10:44.224256+0000","last_became_active":"2024-09-15T22:09:56.696532+0000","last_became_peered":"2024-09-15T22:09:56.696532+0000","last_unstale":"2024-09-15T22:10:44.224256+0000","last_undegraded":"2024-09-15T22:10:44.224256+0000","last_fullsized":"2024-09-15T22:10:44.224256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:56.385349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226547+0000","last_change":"2024-09-15T22:10:44.226547+0000","last_active":"2024-09-15T22:10:44.226547+0000","last_peered":"2024-09-15T22:10:44.226547+0000","last_clean":"2024-09-15T22:10:44.226547+0000","last_became_active":"2024-09-15T22:10:44.226162+0000","last_became_peered":"2024-09-15T22:10:44.226162+0000","last_unstale":"2024-09-15T22:10:44.226547+0000","last_undegraded":"2024-09-15T22:10:44.226547+0000","last_fullsized":"2024-09-15T22:10:44.226547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:49:06.054719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223241+0000","last_change":"2024-09-15T22:09:54.220621+0000","last_active":"2024-09-15T22:10:44.223241+0000","last_peered":"2024-09-15T22:10:44.223241+0000","last_clean":"2024-09-15T22:10:44.223241+0000","last_became_active":"2024-09-15T22:09:54.220280+0000","last_became_peered":"2024-09-15T22:09:54.220280+0000","last_unstale":"2024-09-15T22:10:44.223241+0000","last_undegraded":"2024-09-15T22:10:44.223241+0000","last_fullsized":"2024-09-15T22:10:44.223241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:33.037698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225459+0000","last_change":"2024-09-15T22:09:56.693653+0000","last_active":"2024-09-15T22:10:44.225459+0000","last_peered":"2024-09-15T22:10:44.225459+0000","last_clean":"2024-09-15T22:10:44.225459+0000","last_became_active":"2024-09-15T22:09:56.692756+0000","last_became_peered":"2024-09-15T22:09:56.692756+0000","last_unstale":"2024-09-15T22:10:44.225459+0000","last_undegraded":"2024-09-15T22:10:44.225459+0000","last_fullsized":"2024-09-15T22:10:44.225459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:19.607542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.352544+0000","last_change":"2024-09-15T22:10:44.352544+0000","last_active":"2024-09-15T22:10:44.352544+0000","last_peered":"2024-09-15T22:10:44.352544+0000","last_clean":"2024-09-15T22:10:44.352544+0000","last_became_active":"2024-09-15T22:10:44.338701+0000","last_became_peered":"2024-09-15T22:10:44.338701+0000","last_unstale":"2024-09-15T22:10:44.352544+0000","last_undegraded":"2024-09-15T22:10:44.352544+0000","last_fullsized":"2024-09-15T22:10:44.352544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:20.791350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336174+0000","last_change":"2024-09-15T22:09:56.692795+0000","last_active":"2024-09-15T22:10:44.336174+0000","last_peered":"2024-09-15T22:10:44.336174+0000","last_clean":"2024-09-15T22:10:44.336174+0000","last_became_active":"2024-09-15T22:09:56.692425+0000","last_became_peered":"2024-09-15T22:09:56.692425+0000","last_unstale":"2024-09-15T22:10:44.336174+0000","last_undegraded":"2024-09-15T22:10:44.336174+0000","last_fullsized":"2024-09-15T22:10:44.336174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:45.920502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227390+0000","last_change":"2024-09-15T22:09:54.476726+0000","last_active":"2024-09-15T22:10:44.227390+0000","last_peered":"2024-09-15T22:10:44.227390+0000","last_clean":"2024-09-15T22:10:44.227390+0000","last_became_active":"2024-09-15T22:09:54.476317+0000","last_became_peered":"2024-09-15T22:09:54.476317+0000","last_unstale":"2024-09-15T22:10:44.227390+0000","last_undegraded":"2024-09-15T22:10:44.227390+0000","last_fullsized":"2024-09-15T22:10:44.227390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:48.361958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227206+0000","last_change":"2024-09-15T22:09:56.701501+0000","last_active":"2024-09-15T22:10:44.227206+0000","last_peered":"2024-09-15T22:10:44.227206+0000","last_clean":"2024-09-15T22:10:44.227206+0000","last_became_active":"2024-09-15T22:09:56.701166+0000","last_became_peered":"2024-09-15T22:09:56.701166+0000","last_unstale":"2024-09-15T22:10:44.227206+0000","last_undegraded":"2024-09-15T22:10:44.227206+0000","last_fullsized":"2024-09-15T22:10:44.227206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:20.698770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:01.872730+0000","last_change":"2024-09-15T22:09:54.216841+0000","last_active":"2024-09-15T22:11:01.872730+0000","last_peered":"2024-09-15T22:11:01.872730+0000","last_clean":"2024-09-15T22:11:01.872730+0000","last_became_active":"2024-09-15T22:09:54.216458+0000","last_became_peered":"2024-09-15T22:09:54.216458+0000","last_unstale":"2024-09-15T22:11:01.872730+0000","last_undegraded":"2024-09-15T22:11:01.872730+0000","last_fullsized":"2024-09-15T22:11:01.872730+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.116014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67505,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":579,"num_read_kb":363,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612636,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":444367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841568,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32768,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712384,"statfs":{"total":95995035648,"available":95961481216,"internally_reserved":0,"allocated":1613824,"data_stored":1096479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037798,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":444414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":444675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1531904,"data_stored":1037195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659190,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":444014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888124,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1544192,"data_stored":1036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":444268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":443722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476810,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":505837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607632,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":505617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":445353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:11:08.008 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:11:08.377 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:08.504 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:08 smithi150 ceph-mon[30886]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:08 smithi154 ceph-mon[34853]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:08 smithi169 ceph-mon[35850]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:08.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.888+0000 7f1172200640 1 -- 172.21.15.150:0/3461898762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c074620 msgr2=0x7f116c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:08.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.888+0000 7f1172200640 1 --2- 172.21.15.150:0/3461898762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c074620 0x7f116c074a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1160009900 tx=0x7f116002a480 comp rx=0 tx=0).stop 2024-09-15T22:11:08.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 -- 172.21.15.150:0/3461898762 shutdown_connections 2024-09-15T22:11:08.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 --2- 172.21.15.150:0/3461898762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c10e210 0x7f116c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 --2- 172.21.15.150:0/3461898762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074f40 0x7f116c10dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 --2- 172.21.15.150:0/3461898762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c074620 0x7f116c074a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 -- 172.21.15.150:0/3461898762 >> 172.21.15.150:0/3461898762 conn(0x7f116c0fd710 msgr2=0x7f116c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:08.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 -- 172.21.15.150:0/3461898762 shutdown_connections 2024-09-15T22:11:08.892 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.889+0000 7f1172200640 1 -- 172.21.15.150:0/3461898762 wait complete. 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 Processor -- start 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 -- start start 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074620 0x7f116c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c074f40 0x7f116c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c10e210 0x7f116c19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f116c113fc0 con 0x7f116c10e210 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f116c113e40 con 0x7f116c074f40 2024-09-15T22:11:08.894 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.890+0000 7f1172200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f116c114140 con 0x7f116c074620 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1171800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c10e210 0x7f116c19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f116be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c074f40 0x7f116c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f116be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c074f40 0x7f116c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60914/0 (socket says 172.21.15.150:60914) 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f116be00640 1 -- 172.21.15.150:0/2578656900 learned_addr learned my addr 172.21.15.150:0/2578656900 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074620 0x7f116c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 -- 172.21.15.150:0/2578656900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c074f40 msgr2=0x7f116c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c074f40 0x7f116c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 -- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c10e210 msgr2=0x7f116c19ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c10e210 0x7f116c19ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 -- 172.21.15.150:0/2578656900 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c19f500 con 0x7f116c074620 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1171800640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c10e210 0x7f116c19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.891+0000 7f1170e00640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074620 0x7f116c19a550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1160009850 tx=0x7f11600040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.892+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116003f070 con 0x7f116c074620 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.892+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c19f790 con 0x7f116c074620 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.892+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1160003cd0 con 0x7f116c074620 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.892+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160035070 con 0x7f116c074620 2024-09-15T22:11:08.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.892+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c1a70d0 con 0x7f116c074620 2024-09-15T22:11:08.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.893+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c075cd0 con 0x7f116c074620 2024-09-15T22:11:08.897 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.895+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f116003b4f0 con 0x7f116c074620 2024-09-15T22:11:08.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.896+0000 7f1169600640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f11540a3350 0x7f11540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.896+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f11600f0070 con 0x7f116c074620 2024-09-15T22:11:08.898 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.897+0000 7f116be00640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f11540a3350 0x7f11540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.897+0000 7f116be00640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f11540a3350 0x7f11540a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f116c0ffda0 tx=0x7f1158005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:08.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:08.899+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1160048070 con 0x7f116c074620 2024-09-15T22:11:09.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.073+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f116c062630 con 0x7f11540a3350 2024-09-15T22:11:09.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.081+0000 7f1169600640 1 -- 172.21.15.150:0/2578656900 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7f116c062630 con 0x7f11540a3350 2024-09-15T22:11:09.085 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:09.086 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2024-09-15T22:11:09.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f11540a3350 msgr2=0x7f11540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:09.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f11540a3350 0x7f11540a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f116c0ffda0 tx=0x7f1158005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074620 msgr2=0x7f116c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074620 0x7f116c19a550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1160009850 tx=0x7f11600040c0 comp rx=0 tx=0).stop 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 shutdown_connections 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f11540a3350 0x7f11540a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f116c10e210 0x7f116c19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116c074f40 0x7f116c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 --2- 172.21.15.150:0/2578656900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c074620 0x7f116c19a550 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.085+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 >> 172.21.15.150:0/2578656900 conn(0x7f116c0fd710 msgr2=0x7f116c0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.086+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 shutdown_connections 2024-09-15T22:11:09.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:09.086+0000 7f1172200640 1 -- 172.21.15.150:0/2578656900 wait complete. 2024-09-15T22:11:09.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:09 smithi150 ceph-mon[30886]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:11:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:09 smithi154 ceph-mon[34853]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:11:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:09 smithi169 ceph-mon[35850]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:11:09.912 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-15T22:11:07.154464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658107,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":705,"num_read_kb":472,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1180853,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366364,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575460,"statfs":{"total":1151940427776,"available":1151565271040,"internally_reserved":0,"allocated":13185024,"data_stored":7292421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003318"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225397+0000","last_change":"2024-09-15T22:09:56.697241+0000","last_active":"2024-09-15T22:10:44.225397+0000","last_peered":"2024-09-15T22:10:44.225397+0000","last_clean":"2024-09-15T22:10:44.225397+0000","last_became_active":"2024-09-15T22:09:56.696904+0000","last_became_peered":"2024-09-15T22:09:56.696904+0000","last_unstale":"2024-09-15T22:10:44.225397+0000","last_undegraded":"2024-09-15T22:10:44.225397+0000","last_fullsized":"2024-09-15T22:10:44.225397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:22.950386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336016+0000","last_change":"2024-09-15T22:09:56.693450+0000","last_active":"2024-09-15T22:10:44.336016+0000","last_peered":"2024-09-15T22:10:44.336016+0000","last_clean":"2024-09-15T22:10:44.336016+0000","last_became_active":"2024-09-15T22:09:56.693140+0000","last_became_peered":"2024-09-15T22:09:56.693140+0000","last_unstale":"2024-09-15T22:10:44.336016+0000","last_undegraded":"2024-09-15T22:10:44.336016+0000","last_fullsized":"2024-09-15T22:10:44.336016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.664485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.335981+0000","last_change":"2024-09-15T22:09:56.692816+0000","last_active":"2024-09-15T22:10:44.335981+0000","last_peered":"2024-09-15T22:10:44.335981+0000","last_clean":"2024-09-15T22:10:44.335981+0000","last_became_active":"2024-09-15T22:09:56.692367+0000","last_became_peered":"2024-09-15T22:09:56.692367+0000","last_unstale":"2024-09-15T22:10:44.335981+0000","last_undegraded":"2024-09-15T22:10:44.335981+0000","last_fullsized":"2024-09-15T22:10:44.335981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:36.412415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.337014+0000","last_change":"2024-09-15T22:09:56.704312+0000","last_active":"2024-09-15T22:10:44.337014+0000","last_peered":"2024-09-15T22:10:44.337014+0000","last_clean":"2024-09-15T22:10:44.337014+0000","last_became_active":"2024-09-15T22:09:56.703976+0000","last_became_peered":"2024-09-15T22:09:56.703976+0000","last_unstale":"2024-09-15T22:10:44.337014+0000","last_undegraded":"2024-09-15T22:10:44.337014+0000","last_fullsized":"2024-09-15T22:10:44.337014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:59.911956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222626+0000","last_change":"2024-09-15T22:09:56.697278+0000","last_active":"2024-09-15T22:10:44.222626+0000","last_peered":"2024-09-15T22:10:44.222626+0000","last_clean":"2024-09-15T22:10:44.222626+0000","last_became_active":"2024-09-15T22:09:56.696971+0000","last_became_peered":"2024-09-15T22:09:56.696971+0000","last_unstale":"2024-09-15T22:10:44.222626+0000","last_undegraded":"2024-09-15T22:10:44.222626+0000","last_fullsized":"2024-09-15T22:10:44.222626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:49.361718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226488+0000","last_change":"2024-09-15T22:09:56.701215+0000","last_active":"2024-09-15T22:10:44.226488+0000","last_peered":"2024-09-15T22:10:44.226488+0000","last_clean":"2024-09-15T22:10:44.226488+0000","last_became_active":"2024-09-15T22:09:56.695891+0000","last_became_peered":"2024-09-15T22:09:56.695891+0000","last_unstale":"2024-09-15T22:10:44.226488+0000","last_undegraded":"2024-09-15T22:10:44.226488+0000","last_fullsized":"2024-09-15T22:10:44.226488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:02.065909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223638+0000","last_change":"2024-09-15T22:09:56.697684+0000","last_active":"2024-09-15T22:10:44.223638+0000","last_peered":"2024-09-15T22:10:44.223638+0000","last_clean":"2024-09-15T22:10:44.223638+0000","last_became_active":"2024-09-15T22:09:56.697360+0000","last_became_peered":"2024-09-15T22:09:56.697360+0000","last_unstale":"2024-09-15T22:10:44.223638+0000","last_undegraded":"2024-09-15T22:10:44.223638+0000","last_fullsized":"2024-09-15T22:10:44.223638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:04.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226623+0000","last_change":"2024-09-15T22:09:56.700712+0000","last_active":"2024-09-15T22:10:44.226623+0000","last_peered":"2024-09-15T22:10:44.226623+0000","last_clean":"2024-09-15T22:10:44.226623+0000","last_became_active":"2024-09-15T22:09:56.700379+0000","last_became_peered":"2024-09-15T22:09:56.700379+0000","last_unstale":"2024-09-15T22:10:44.226623+0000","last_undegraded":"2024-09-15T22:10:44.226623+0000","last_fullsized":"2024-09-15T22:10:44.226623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:28.701496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227586+0000","last_change":"2024-09-15T22:10:44.226513+0000","last_active":"2024-09-15T22:10:44.227586+0000","last_peered":"2024-09-15T22:10:44.227586+0000","last_clean":"2024-09-15T22:10:44.227586+0000","last_became_active":"2024-09-15T22:10:44.226141+0000","last_became_peered":"2024-09-15T22:10:44.226141+0000","last_unstale":"2024-09-15T22:10:44.227586+0000","last_undegraded":"2024-09-15T22:10:44.227586+0000","last_fullsized":"2024-09-15T22:10:44.227586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:11.120364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227221+0000","last_change":"2024-09-15T22:09:56.700740+0000","last_active":"2024-09-15T22:10:44.227221+0000","last_peered":"2024-09-15T22:10:44.227221+0000","last_clean":"2024-09-15T22:10:44.227221+0000","last_became_active":"2024-09-15T22:09:56.700367+0000","last_became_peered":"2024-09-15T22:09:56.700367+0000","last_unstale":"2024-09-15T22:10:44.227221+0000","last_undegraded":"2024-09-15T22:10:44.227221+0000","last_fullsized":"2024-09-15T22:10:44.227221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:39.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223772+0000","last_change":"2024-09-15T22:09:56.693630+0000","last_active":"2024-09-15T22:10:44.223772+0000","last_peered":"2024-09-15T22:10:44.223772+0000","last_clean":"2024-09-15T22:10:44.223772+0000","last_became_active":"2024-09-15T22:09:56.693341+0000","last_became_peered":"2024-09-15T22:09:56.693341+0000","last_unstale":"2024-09-15T22:10:44.223772+0000","last_undegraded":"2024-09-15T22:10:44.223772+0000","last_fullsized":"2024-09-15T22:10:44.223772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:13.738884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.337019+0000","last_change":"2024-09-15T22:09:56.704364+0000","last_active":"2024-09-15T22:10:44.337019+0000","last_peered":"2024-09-15T22:10:44.337019+0000","last_clean":"2024-09-15T22:10:44.337019+0000","last_became_active":"2024-09-15T22:09:56.703807+0000","last_became_peered":"2024-09-15T22:09:56.703807+0000","last_unstale":"2024-09-15T22:10:44.337019+0000","last_undegraded":"2024-09-15T22:10:44.337019+0000","last_fullsized":"2024-09-15T22:10:44.337019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:11.054261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228796+0000","last_change":"2024-09-15T22:09:56.698001+0000","last_active":"2024-09-15T22:10:44.228796+0000","last_peered":"2024-09-15T22:10:44.228796+0000","last_clean":"2024-09-15T22:10:44.228796+0000","last_became_active":"2024-09-15T22:09:56.696188+0000","last_became_peered":"2024-09-15T22:09:56.696188+0000","last_unstale":"2024-09-15T22:10:44.228796+0000","last_undegraded":"2024-09-15T22:10:44.228796+0000","last_fullsized":"2024-09-15T22:10:44.228796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:00.113552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.335888+0000","last_change":"2024-09-15T22:09:56.693422+0000","last_active":"2024-09-15T22:10:44.335888+0000","last_peered":"2024-09-15T22:10:44.335888+0000","last_clean":"2024-09-15T22:10:44.335888+0000","last_became_active":"2024-09-15T22:09:56.693041+0000","last_became_peered":"2024-09-15T22:09:56.693041+0000","last_unstale":"2024-09-15T22:10:44.335888+0000","last_undegraded":"2024-09-15T22:10:44.335888+0000","last_fullsized":"2024-09-15T22:10:44.335888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:57.145008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.335964+0000","last_change":"2024-09-15T22:09:56.704449+0000","last_active":"2024-09-15T22:10:44.335964+0000","last_peered":"2024-09-15T22:10:44.335964+0000","last_clean":"2024-09-15T22:10:44.335964+0000","last_became_active":"2024-09-15T22:09:56.704021+0000","last_became_peered":"2024-09-15T22:09:56.704021+0000","last_unstale":"2024-09-15T22:10:44.335964+0000","last_undegraded":"2024-09-15T22:10:44.335964+0000","last_fullsized":"2024-09-15T22:10:44.335964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:56.149392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223497+0000","last_change":"2024-09-15T22:09:56.693385+0000","last_active":"2024-09-15T22:10:44.223497+0000","last_peered":"2024-09-15T22:10:44.223497+0000","last_clean":"2024-09-15T22:10:44.223497+0000","last_became_active":"2024-09-15T22:09:56.692744+0000","last_became_peered":"2024-09-15T22:09:56.692744+0000","last_unstale":"2024-09-15T22:10:44.223497+0000","last_undegraded":"2024-09-15T22:10:44.223497+0000","last_fullsized":"2024-09-15T22:10:44.223497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:38.996962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225472+0000","last_change":"2024-09-15T22:09:56.695902+0000","last_active":"2024-09-15T22:10:44.225472+0000","last_peered":"2024-09-15T22:10:44.225472+0000","last_clean":"2024-09-15T22:10:44.225472+0000","last_became_active":"2024-09-15T22:09:56.695534+0000","last_became_peered":"2024-09-15T22:09:56.695534+0000","last_unstale":"2024-09-15T22:10:44.225472+0000","last_undegraded":"2024-09-15T22:10:44.225472+0000","last_fullsized":"2024-09-15T22:10:44.225472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:47.052196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222733+0000","last_change":"2024-09-15T22:09:56.695057+0000","last_active":"2024-09-15T22:10:44.222733+0000","last_peered":"2024-09-15T22:10:44.222733+0000","last_clean":"2024-09-15T22:10:44.222733+0000","last_became_active":"2024-09-15T22:09:56.694577+0000","last_became_peered":"2024-09-15T22:09:56.694577+0000","last_unstale":"2024-09-15T22:10:44.222733+0000","last_undegraded":"2024-09-15T22:10:44.222733+0000","last_fullsized":"2024-09-15T22:10:44.222733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:34.572928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226761+0000","last_change":"2024-09-15T22:09:56.698918+0000","last_active":"2024-09-15T22:10:44.226761+0000","last_peered":"2024-09-15T22:10:44.226761+0000","last_clean":"2024-09-15T22:10:44.226761+0000","last_became_active":"2024-09-15T22:09:56.698600+0000","last_became_peered":"2024-09-15T22:09:56.698600+0000","last_unstale":"2024-09-15T22:10:44.226761+0000","last_undegraded":"2024-09-15T22:10:44.226761+0000","last_fullsized":"2024-09-15T22:10:44.226761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:41.350724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228768+0000","last_change":"2024-09-15T22:10:44.228768+0000","last_active":"2024-09-15T22:10:44.228768+0000","last_peered":"2024-09-15T22:10:44.228768+0000","last_clean":"2024-09-15T22:10:44.228768+0000","last_became_active":"2024-09-15T22:10:44.228305+0000","last_became_peered":"2024-09-15T22:10:44.228305+0000","last_unstale":"2024-09-15T22:10:44.228768+0000","last_undegraded":"2024-09-15T22:10:44.228768+0000","last_fullsized":"2024-09-15T22:10:44.228768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:38.083465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229089+0000","last_change":"2024-09-15T22:09:56.698638+0000","last_active":"2024-09-15T22:10:44.229089+0000","last_peered":"2024-09-15T22:10:44.229089+0000","last_clean":"2024-09-15T22:10:44.229089+0000","last_became_active":"2024-09-15T22:09:56.696666+0000","last_became_peered":"2024-09-15T22:09:56.696666+0000","last_unstale":"2024-09-15T22:10:44.229089+0000","last_undegraded":"2024-09-15T22:10:44.229089+0000","last_fullsized":"2024-09-15T22:10:44.229089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:55.272401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223475+0000","last_change":"2024-09-15T22:09:56.696020+0000","last_active":"2024-09-15T22:10:44.223475+0000","last_peered":"2024-09-15T22:10:44.223475+0000","last_clean":"2024-09-15T22:10:44.223475+0000","last_became_active":"2024-09-15T22:09:56.695648+0000","last_became_peered":"2024-09-15T22:09:56.695648+0000","last_unstale":"2024-09-15T22:10:44.223475+0000","last_undegraded":"2024-09-15T22:10:44.223475+0000","last_fullsized":"2024-09-15T22:10:44.223475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:12.413993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226831+0000","last_change":"2024-09-15T22:09:56.695593+0000","last_active":"2024-09-15T22:10:44.226831+0000","last_peered":"2024-09-15T22:10:44.226831+0000","last_clean":"2024-09-15T22:10:44.226831+0000","last_became_active":"2024-09-15T22:09:56.695227+0000","last_became_peered":"2024-09-15T22:09:56.695227+0000","last_unstale":"2024-09-15T22:10:44.226831+0000","last_undegraded":"2024-09-15T22:10:44.226831+0000","last_fullsized":"2024-09-15T22:10:44.226831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:08.685355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.231320+0000","last_change":"2024-09-15T22:10:44.231320+0000","last_active":"2024-09-15T22:10:44.231320+0000","last_peered":"2024-09-15T22:10:44.231320+0000","last_clean":"2024-09-15T22:10:44.231320+0000","last_became_active":"2024-09-15T22:10:44.230984+0000","last_became_peered":"2024-09-15T22:10:44.230984+0000","last_unstale":"2024-09-15T22:10:44.231320+0000","last_undegraded":"2024-09-15T22:10:44.231320+0000","last_fullsized":"2024-09-15T22:10:44.231320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:42.703545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227037+0000","last_change":"2024-09-15T22:09:56.708370+0000","last_active":"2024-09-15T22:10:44.227037+0000","last_peered":"2024-09-15T22:10:44.227037+0000","last_clean":"2024-09-15T22:10:44.227037+0000","last_became_active":"2024-09-15T22:09:56.707971+0000","last_became_peered":"2024-09-15T22:09:56.707971+0000","last_unstale":"2024-09-15T22:10:44.227037+0000","last_undegraded":"2024-09-15T22:10:44.227037+0000","last_fullsized":"2024-09-15T22:10:44.227037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:54.066532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226545+0000","last_change":"2024-09-15T22:09:56.690437+0000","last_active":"2024-09-15T22:10:44.226545+0000","last_peered":"2024-09-15T22:10:44.226545+0000","last_clean":"2024-09-15T22:10:44.226545+0000","last_became_active":"2024-09-15T22:09:56.690063+0000","last_became_peered":"2024-09-15T22:09:56.690063+0000","last_unstale":"2024-09-15T22:10:44.226545+0000","last_undegraded":"2024-09-15T22:10:44.226545+0000","last_fullsized":"2024-09-15T22:10:44.226545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:58.488119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225407+0000","last_change":"2024-09-15T22:09:56.692654+0000","last_active":"2024-09-15T22:10:44.225407+0000","last_peered":"2024-09-15T22:10:44.225407+0000","last_clean":"2024-09-15T22:10:44.225407+0000","last_became_active":"2024-09-15T22:09:56.692096+0000","last_became_peered":"2024-09-15T22:09:56.692096+0000","last_unstale":"2024-09-15T22:10:44.225407+0000","last_undegraded":"2024-09-15T22:10:44.225407+0000","last_fullsized":"2024-09-15T22:10:44.225407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:40.104024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229389+0000","last_change":"2024-09-15T22:09:56.705271+0000","last_active":"2024-09-15T22:10:44.229389+0000","last_peered":"2024-09-15T22:10:44.229389+0000","last_clean":"2024-09-15T22:10:44.229389+0000","last_became_active":"2024-09-15T22:09:56.703538+0000","last_became_peered":"2024-09-15T22:09:56.703538+0000","last_unstale":"2024-09-15T22:10:44.229389+0000","last_undegraded":"2024-09-15T22:10:44.229389+0000","last_fullsized":"2024-09-15T22:10:44.229389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:50.517516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336136+0000","last_change":"2024-09-15T22:09:56.706134+0000","last_active":"2024-09-15T22:10:44.336136+0000","last_peered":"2024-09-15T22:10:44.336136+0000","last_clean":"2024-09-15T22:10:44.336136+0000","last_became_active":"2024-09-15T22:09:56.705699+0000","last_became_peered":"2024-09-15T22:09:56.705699+0000","last_unstale":"2024-09-15T22:10:44.336136+0000","last_undegraded":"2024-09-15T22:10:44.336136+0000","last_fullsized":"2024-09-15T22:10:44.336136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:12:29.296607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226168+0000","last_change":"2024-09-15T22:09:56.698023+0000","last_active":"2024-09-15T22:10:44.226168+0000","last_peered":"2024-09-15T22:10:44.226168+0000","last_clean":"2024-09-15T22:10:44.226168+0000","last_became_active":"2024-09-15T22:09:56.697664+0000","last_became_peered":"2024-09-15T22:09:56.697664+0000","last_unstale":"2024-09-15T22:10:44.226168+0000","last_undegraded":"2024-09-15T22:10:44.226168+0000","last_fullsized":"2024-09-15T22:10:44.226168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:47.387380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226030+0000","last_change":"2024-09-15T22:09:56.702073+0000","last_active":"2024-09-15T22:10:44.226030+0000","last_peered":"2024-09-15T22:10:44.226030+0000","last_clean":"2024-09-15T22:10:44.226030+0000","last_became_active":"2024-09-15T22:09:56.701663+0000","last_became_peered":"2024-09-15T22:09:56.701663+0000","last_unstale":"2024-09-15T22:10:44.226030+0000","last_undegraded":"2024-09-15T22:10:44.226030+0000","last_fullsized":"2024-09-15T22:10:44.226030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:17:20.095392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225583+0000","last_change":"2024-09-15T22:09:56.692430+0000","last_active":"2024-09-15T22:10:44.225583+0000","last_peered":"2024-09-15T22:10:44.225583+0000","last_clean":"2024-09-15T22:10:44.225583+0000","last_became_active":"2024-09-15T22:09:56.692068+0000","last_became_peered":"2024-09-15T22:09:56.692068+0000","last_unstale":"2024-09-15T22:10:44.225583+0000","last_undegraded":"2024-09-15T22:10:44.225583+0000","last_fullsized":"2024-09-15T22:10:44.225583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.694497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222557+0000","last_change":"2024-09-15T22:09:56.690234+0000","last_active":"2024-09-15T22:10:44.222557+0000","last_peered":"2024-09-15T22:10:44.222557+0000","last_clean":"2024-09-15T22:10:44.222557+0000","last_became_active":"2024-09-15T22:09:56.689845+0000","last_became_peered":"2024-09-15T22:09:56.689845+0000","last_unstale":"2024-09-15T22:10:44.222557+0000","last_undegraded":"2024-09-15T22:10:44.222557+0000","last_fullsized":"2024-09-15T22:10:44.222557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:32.997578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:03.877244+0000","last_change":"2024-09-15T22:09:54.219344+0000","last_active":"2024-09-15T22:11:03.877244+0000","last_peered":"2024-09-15T22:11:03.877244+0000","last_clean":"2024-09-15T22:11:03.877244+0000","last_became_active":"2024-09-15T22:09:54.218592+0000","last_became_peered":"2024-09-15T22:09:54.218592+0000","last_unstale":"2024-09-15T22:11:03.877244+0000","last_undegraded":"2024-09-15T22:11:03.877244+0000","last_fullsized":"2024-09-15T22:11:03.877244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:44.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220887+0000","last_change":"2024-09-15T22:09:56.703045+0000","last_active":"2024-09-15T22:10:44.220887+0000","last_peered":"2024-09-15T22:10:44.220887+0000","last_clean":"2024-09-15T22:10:44.220887+0000","last_became_active":"2024-09-15T22:09:56.702724+0000","last_became_peered":"2024-09-15T22:09:56.702724+0000","last_unstale":"2024-09-15T22:10:44.220887+0000","last_undegraded":"2024-09-15T22:10:44.220887+0000","last_fullsized":"2024-09-15T22:10:44.220887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.440559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.236756+0000","last_change":"2024-09-15T22:10:44.236756+0000","last_active":"2024-09-15T22:10:44.236756+0000","last_peered":"2024-09-15T22:10:44.236756+0000","last_clean":"2024-09-15T22:10:44.236756+0000","last_became_active":"2024-09-15T22:10:44.230466+0000","last_became_peered":"2024-09-15T22:10:44.230466+0000","last_unstale":"2024-09-15T22:10:44.236756+0000","last_undegraded":"2024-09-15T22:10:44.236756+0000","last_fullsized":"2024-09-15T22:10:44.236756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:32.604042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228871+0000","last_change":"2024-09-15T22:09:54.214589+0000","last_active":"2024-09-15T22:10:44.228871+0000","last_peered":"2024-09-15T22:10:44.228871+0000","last_clean":"2024-09-15T22:10:44.228871+0000","last_became_active":"2024-09-15T22:09:54.214115+0000","last_became_peered":"2024-09-15T22:09:54.214115+0000","last_unstale":"2024-09-15T22:10:44.228871+0000","last_undegraded":"2024-09-15T22:10:44.228871+0000","last_fullsized":"2024-09-15T22:10:44.228871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:05.452310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226724+0000","last_change":"2024-09-15T22:09:56.700414+0000","last_active":"2024-09-15T22:10:44.226724+0000","last_peered":"2024-09-15T22:10:44.226724+0000","last_clean":"2024-09-15T22:10:44.226724+0000","last_became_active":"2024-09-15T22:09:56.700041+0000","last_became_peered":"2024-09-15T22:09:56.700041+0000","last_unstale":"2024-09-15T22:10:44.226724+0000","last_undegraded":"2024-09-15T22:10:44.226724+0000","last_fullsized":"2024-09-15T22:10:44.226724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:08.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220905+0000","last_change":"2024-09-15T22:09:54.219547+0000","last_active":"2024-09-15T22:10:44.220905+0000","last_peered":"2024-09-15T22:10:44.220905+0000","last_clean":"2024-09-15T22:10:44.220905+0000","last_became_active":"2024-09-15T22:09:54.218554+0000","last_became_peered":"2024-09-15T22:09:54.218554+0000","last_unstale":"2024-09-15T22:10:44.220905+0000","last_undegraded":"2024-09-15T22:10:44.220905+0000","last_fullsized":"2024-09-15T22:10:44.220905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:09.478853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222541+0000","last_change":"2024-09-15T22:09:56.694749+0000","last_active":"2024-09-15T22:10:44.222541+0000","last_peered":"2024-09-15T22:10:44.222541+0000","last_clean":"2024-09-15T22:10:44.222541+0000","last_became_active":"2024-09-15T22:09:56.694450+0000","last_became_peered":"2024-09-15T22:09:56.694450+0000","last_unstale":"2024-09-15T22:10:44.222541+0000","last_undegraded":"2024-09-15T22:10:44.222541+0000","last_fullsized":"2024-09-15T22:10:44.222541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:39:19.565705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:03.876529+0000","last_change":"2024-09-15T22:09:54.220137+0000","last_active":"2024-09-15T22:11:03.876529+0000","last_peered":"2024-09-15T22:11:03.876529+0000","last_clean":"2024-09-15T22:11:03.876529+0000","last_became_active":"2024-09-15T22:09:54.219738+0000","last_became_peered":"2024-09-15T22:09:54.219738+0000","last_unstale":"2024-09-15T22:11:03.876529+0000","last_undegraded":"2024-09-15T22:11:03.876529+0000","last_fullsized":"2024-09-15T22:11:03.876529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:56.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223849+0000","last_change":"2024-09-15T22:09:56.694869+0000","last_active":"2024-09-15T22:10:44.223849+0000","last_peered":"2024-09-15T22:10:44.223849+0000","last_clean":"2024-09-15T22:10:44.223849+0000","last_became_active":"2024-09-15T22:09:56.694522+0000","last_became_peered":"2024-09-15T22:09:56.694522+0000","last_unstale":"2024-09-15T22:10:44.223849+0000","last_undegraded":"2024-09-15T22:10:44.223849+0000","last_fullsized":"2024-09-15T22:10:44.223849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:33.633471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.342337+0000","last_change":"2024-09-15T22:10:44.342337+0000","last_active":"2024-09-15T22:10:44.342337+0000","last_peered":"2024-09-15T22:10:44.342337+0000","last_clean":"2024-09-15T22:10:44.342337+0000","last_became_active":"2024-09-15T22:10:44.337736+0000","last_became_peered":"2024-09-15T22:10:44.337736+0000","last_unstale":"2024-09-15T22:10:44.342337+0000","last_undegraded":"2024-09-15T22:10:44.342337+0000","last_fullsized":"2024-09-15T22:10:44.342337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:34.747879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336183+0000","last_change":"2024-09-15T22:09:56.706449+0000","last_active":"2024-09-15T22:10:44.336183+0000","last_peered":"2024-09-15T22:10:44.336183+0000","last_clean":"2024-09-15T22:10:44.336183+0000","last_became_active":"2024-09-15T22:09:56.705380+0000","last_became_peered":"2024-09-15T22:09:56.705380+0000","last_unstale":"2024-09-15T22:10:44.336183+0000","last_undegraded":"2024-09-15T22:10:44.336183+0000","last_fullsized":"2024-09-15T22:10:44.336183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:24.422911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.221306+0000","last_change":"2024-09-15T22:09:54.478189+0000","last_active":"2024-09-15T22:10:44.221306+0000","last_peered":"2024-09-15T22:10:44.221306+0000","last_clean":"2024-09-15T22:10:44.221306+0000","last_became_active":"2024-09-15T22:09:54.477846+0000","last_became_peered":"2024-09-15T22:09:54.477846+0000","last_unstale":"2024-09-15T22:10:44.221306+0000","last_undegraded":"2024-09-15T22:10:44.221306+0000","last_fullsized":"2024-09-15T22:10:44.221306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:00.944061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.231738+0000","last_change":"2024-09-15T22:10:44.231738+0000","last_active":"2024-09-15T22:10:44.231738+0000","last_peered":"2024-09-15T22:10:44.231738+0000","last_clean":"2024-09-15T22:10:44.231738+0000","last_became_active":"2024-09-15T22:10:44.231326+0000","last_became_peered":"2024-09-15T22:10:44.231326+0000","last_unstale":"2024-09-15T22:10:44.231738+0000","last_undegraded":"2024-09-15T22:10:44.231738+0000","last_fullsized":"2024-09-15T22:10:44.231738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:02.695099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:03.876446+0000","last_change":"2024-09-15T22:09:54.216447+0000","last_active":"2024-09-15T22:11:03.876446+0000","last_peered":"2024-09-15T22:11:03.876446+0000","last_clean":"2024-09-15T22:11:03.876446+0000","last_became_active":"2024-09-15T22:09:54.216102+0000","last_became_peered":"2024-09-15T22:09:54.216102+0000","last_unstale":"2024-09-15T22:11:03.876446+0000","last_undegraded":"2024-09-15T22:11:03.876446+0000","last_fullsized":"2024-09-15T22:11:03.876446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:55.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60690,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223096+0000","last_change":"2024-09-15T22:09:56.694011+0000","last_active":"2024-09-15T22:10:44.223096+0000","last_peered":"2024-09-15T22:10:44.223096+0000","last_clean":"2024-09-15T22:10:44.223096+0000","last_became_active":"2024-09-15T22:09:56.693447+0000","last_became_peered":"2024-09-15T22:09:56.693447+0000","last_unstale":"2024-09-15T22:10:44.223096+0000","last_undegraded":"2024-09-15T22:10:44.223096+0000","last_fullsized":"2024-09-15T22:10:44.223096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.126486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226099+0000","last_change":"2024-09-15T22:09:54.221406+0000","last_active":"2024-09-15T22:10:44.226099+0000","last_peered":"2024-09-15T22:10:44.226099+0000","last_clean":"2024-09-15T22:10:44.226099+0000","last_became_active":"2024-09-15T22:09:54.220752+0000","last_became_peered":"2024-09-15T22:09:54.220752+0000","last_unstale":"2024-09-15T22:10:44.226099+0000","last_undegraded":"2024-09-15T22:10:44.226099+0000","last_fullsized":"2024-09-15T22:10:44.226099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.198214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228871+0000","last_change":"2024-09-15T22:09:56.697991+0000","last_active":"2024-09-15T22:10:44.228871+0000","last_peered":"2024-09-15T22:10:44.228871+0000","last_clean":"2024-09-15T22:10:44.228871+0000","last_became_active":"2024-09-15T22:09:56.695867+0000","last_became_peered":"2024-09-15T22:09:56.695867+0000","last_unstale":"2024-09-15T22:10:44.228871+0000","last_undegraded":"2024-09-15T22:10:44.228871+0000","last_fullsized":"2024-09-15T22:10:44.228871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:05.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220877+0000","last_change":"2024-09-15T22:09:54.219276+0000","last_active":"2024-09-15T22:10:44.220877+0000","last_peered":"2024-09-15T22:10:44.220877+0000","last_clean":"2024-09-15T22:10:44.220877+0000","last_became_active":"2024-09-15T22:09:54.218940+0000","last_became_peered":"2024-09-15T22:09:54.218940+0000","last_unstale":"2024-09-15T22:10:44.220877+0000","last_undegraded":"2024-09-15T22:10:44.220877+0000","last_fullsized":"2024-09-15T22:10:44.220877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:38.511671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224613+0000","last_change":"2024-09-15T22:09:56.703202+0000","last_active":"2024-09-15T22:10:44.224613+0000","last_peered":"2024-09-15T22:10:44.224613+0000","last_clean":"2024-09-15T22:10:44.224613+0000","last_became_active":"2024-09-15T22:09:56.702871+0000","last_became_peered":"2024-09-15T22:09:56.702871+0000","last_unstale":"2024-09-15T22:10:44.224613+0000","last_undegraded":"2024-09-15T22:10:44.224613+0000","last_fullsized":"2024-09-15T22:10:44.224613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:08.404847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:02.875155+0000","last_change":"2024-09-15T22:09:54.219948+0000","last_active":"2024-09-15T22:11:02.875155+0000","last_peered":"2024-09-15T22:11:02.875155+0000","last_clean":"2024-09-15T22:11:02.875155+0000","last_became_active":"2024-09-15T22:09:54.219603+0000","last_became_peered":"2024-09-15T22:09:54.219603+0000","last_unstale":"2024-09-15T22:11:02.875155+0000","last_undegraded":"2024-09-15T22:11:02.875155+0000","last_fullsized":"2024-09-15T22:11:02.875155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:07.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223753+0000","last_change":"2024-09-15T22:09:56.698203+0000","last_active":"2024-09-15T22:10:44.223753+0000","last_peered":"2024-09-15T22:10:44.223753+0000","last_clean":"2024-09-15T22:10:44.223753+0000","last_became_active":"2024-09-15T22:09:56.697882+0000","last_became_peered":"2024-09-15T22:09:56.697882+0000","last_unstale":"2024-09-15T22:10:44.223753+0000","last_undegraded":"2024-09-15T22:10:44.223753+0000","last_fullsized":"2024-09-15T22:10:44.223753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:29.865810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223113+0000","last_change":"2024-09-15T22:09:54.477287+0000","last_active":"2024-09-15T22:10:44.223113+0000","last_peered":"2024-09-15T22:10:44.223113+0000","last_clean":"2024-09-15T22:10:44.223113+0000","last_became_active":"2024-09-15T22:09:54.476895+0000","last_became_peered":"2024-09-15T22:09:54.476895+0000","last_unstale":"2024-09-15T22:10:44.223113+0000","last_undegraded":"2024-09-15T22:10:44.223113+0000","last_fullsized":"2024-09-15T22:10:44.223113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:22.940445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220750+0000","last_change":"2024-09-15T22:09:56.703388+0000","last_active":"2024-09-15T22:10:44.220750+0000","last_peered":"2024-09-15T22:10:44.220750+0000","last_clean":"2024-09-15T22:10:44.220750+0000","last_became_active":"2024-09-15T22:09:56.703053+0000","last_became_peered":"2024-09-15T22:09:56.703053+0000","last_unstale":"2024-09-15T22:10:44.220750+0000","last_undegraded":"2024-09-15T22:10:44.220750+0000","last_fullsized":"2024-09-15T22:10:44.220750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:22.700159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223142+0000","last_change":"2024-09-15T22:09:54.217269+0000","last_active":"2024-09-15T22:10:44.223142+0000","last_peered":"2024-09-15T22:10:44.223142+0000","last_clean":"2024-09-15T22:10:44.223142+0000","last_became_active":"2024-09-15T22:09:54.216887+0000","last_became_peered":"2024-09-15T22:09:54.216887+0000","last_unstale":"2024-09-15T22:10:44.223142+0000","last_undegraded":"2024-09-15T22:10:44.223142+0000","last_fullsized":"2024-09-15T22:10:44.223142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:35.989801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225469+0000","last_change":"2024-09-15T22:09:56.696293+0000","last_active":"2024-09-15T22:10:44.225469+0000","last_peered":"2024-09-15T22:10:44.225469+0000","last_clean":"2024-09-15T22:10:44.225469+0000","last_became_active":"2024-09-15T22:09:56.695954+0000","last_became_peered":"2024-09-15T22:09:56.695954+0000","last_unstale":"2024-09-15T22:10:44.225469+0000","last_undegraded":"2024-09-15T22:10:44.225469+0000","last_fullsized":"2024-09-15T22:10:44.225469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:23.933813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229378+0000","last_change":"2024-09-15T22:09:54.219608+0000","last_active":"2024-09-15T22:10:44.229378+0000","last_peered":"2024-09-15T22:10:44.229378+0000","last_clean":"2024-09-15T22:10:44.229378+0000","last_became_active":"2024-09-15T22:09:54.218700+0000","last_became_peered":"2024-09-15T22:09:54.218700+0000","last_unstale":"2024-09-15T22:10:44.229378+0000","last_undegraded":"2024-09-15T22:10:44.229378+0000","last_fullsized":"2024-09-15T22:10:44.229378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:55.941217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224937+0000","last_change":"2024-09-15T22:09:56.693898+0000","last_active":"2024-09-15T22:10:44.224937+0000","last_peered":"2024-09-15T22:10:44.224937+0000","last_clean":"2024-09-15T22:10:44.224937+0000","last_became_active":"2024-09-15T22:09:56.692960+0000","last_became_peered":"2024-09-15T22:09:56.692960+0000","last_unstale":"2024-09-15T22:10:44.224937+0000","last_undegraded":"2024-09-15T22:10:44.224937+0000","last_fullsized":"2024-09-15T22:10:44.224937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:50.150574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.221413+0000","last_change":"2024-09-15T22:09:54.220757+0000","last_active":"2024-09-15T22:10:44.221413+0000","last_peered":"2024-09-15T22:10:44.221413+0000","last_clean":"2024-09-15T22:10:44.221413+0000","last_became_active":"2024-09-15T22:09:54.220371+0000","last_became_peered":"2024-09-15T22:09:54.220371+0000","last_unstale":"2024-09-15T22:10:44.221413+0000","last_undegraded":"2024-09-15T22:10:44.221413+0000","last_fullsized":"2024-09-15T22:10:44.221413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:07.234474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.233473+0000","last_change":"2024-09-15T22:10:44.233473+0000","last_active":"2024-09-15T22:10:44.233473+0000","last_peered":"2024-09-15T22:10:44.233473+0000","last_clean":"2024-09-15T22:10:44.233473+0000","last_became_active":"2024-09-15T22:10:44.227961+0000","last_became_peered":"2024-09-15T22:10:44.227961+0000","last_unstale":"2024-09-15T22:10:44.233473+0000","last_undegraded":"2024-09-15T22:10:44.233473+0000","last_fullsized":"2024-09-15T22:10:44.233473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:17.119043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:02.875785+0000","last_change":"2024-09-15T22:09:55.000482+0000","last_active":"2024-09-15T22:11:02.875785+0000","last_peered":"2024-09-15T22:11:02.875785+0000","last_clean":"2024-09-15T22:11:02.875785+0000","last_became_active":"2024-09-15T22:09:55.000088+0000","last_became_peered":"2024-09-15T22:09:55.000088+0000","last_unstale":"2024-09-15T22:11:02.875785+0000","last_undegraded":"2024-09-15T22:11:02.875785+0000","last_fullsized":"2024-09-15T22:11:02.875785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:48.309582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223901+0000","last_change":"2024-09-15T22:09:56.699129+0000","last_active":"2024-09-15T22:10:44.223901+0000","last_peered":"2024-09-15T22:10:44.223901+0000","last_clean":"2024-09-15T22:10:44.223901+0000","last_became_active":"2024-09-15T22:09:56.698107+0000","last_became_peered":"2024-09-15T22:09:56.698107+0000","last_unstale":"2024-09-15T22:10:44.223901+0000","last_undegraded":"2024-09-15T22:10:44.223901+0000","last_fullsized":"2024-09-15T22:10:44.223901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:35.436908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224039+0000","last_change":"2024-09-15T22:08:41.556517+0000","last_active":"2024-09-15T22:10:44.224039+0000","last_peered":"2024-09-15T22:10:44.224039+0000","last_clean":"2024-09-15T22:10:44.224039+0000","last_became_active":"2024-09-15T22:08:41.555887+0000","last_became_peered":"2024-09-15T22:08:41.555887+0000","last_unstale":"2024-09-15T22:10:44.224039+0000","last_undegraded":"2024-09-15T22:10:44.224039+0000","last_fullsized":"2024-09-15T22:10:44.224039+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:05:05.654738+0000","last_clean_scrub_stamp":"2024-09-15T22:05:05.654738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:29.105403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336748+0000","last_change":"2024-09-15T22:09:54.220522+0000","last_active":"2024-09-15T22:10:44.336748+0000","last_peered":"2024-09-15T22:10:44.336748+0000","last_clean":"2024-09-15T22:10:44.336748+0000","last_became_active":"2024-09-15T22:09:54.220174+0000","last_became_peered":"2024-09-15T22:09:54.220174+0000","last_unstale":"2024-09-15T22:10:44.336748+0000","last_undegraded":"2024-09-15T22:10:44.336748+0000","last_fullsized":"2024-09-15T22:10:44.336748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:33.909055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226905+0000","last_change":"2024-09-15T22:09:56.703268+0000","last_active":"2024-09-15T22:10:44.226905+0000","last_peered":"2024-09-15T22:10:44.226905+0000","last_clean":"2024-09-15T22:10:44.226905+0000","last_became_active":"2024-09-15T22:09:56.701096+0000","last_became_peered":"2024-09-15T22:09:56.701096+0000","last_unstale":"2024-09-15T22:10:44.226905+0000","last_undegraded":"2024-09-15T22:10:44.226905+0000","last_fullsized":"2024-09-15T22:10:44.226905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:30.689461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223937+0000","last_change":"2024-09-15T22:09:54.220913+0000","last_active":"2024-09-15T22:10:44.223937+0000","last_peered":"2024-09-15T22:10:44.223937+0000","last_clean":"2024-09-15T22:10:44.223937+0000","last_became_active":"2024-09-15T22:09:54.220476+0000","last_became_peered":"2024-09-15T22:09:54.220476+0000","last_unstale":"2024-09-15T22:10:44.223937+0000","last_undegraded":"2024-09-15T22:10:44.223937+0000","last_fullsized":"2024-09-15T22:10:44.223937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:27.087931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.228509+0000","last_change":"2024-09-15T22:09:56.704428+0000","last_active":"2024-09-15T22:10:44.228509+0000","last_peered":"2024-09-15T22:10:44.228509+0000","last_clean":"2024-09-15T22:10:44.228509+0000","last_became_active":"2024-09-15T22:09:56.703856+0000","last_became_peered":"2024-09-15T22:09:56.703856+0000","last_unstale":"2024-09-15T22:10:44.228509+0000","last_undegraded":"2024-09-15T22:10:44.228509+0000","last_fullsized":"2024-09-15T22:10:44.228509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:56.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:02.874394+0000","last_change":"2024-09-15T22:09:54.476737+0000","last_active":"2024-09-15T22:11:02.874394+0000","last_peered":"2024-09-15T22:11:02.874394+0000","last_clean":"2024-09-15T22:11:02.874394+0000","last_became_active":"2024-09-15T22:09:54.476256+0000","last_became_peered":"2024-09-15T22:09:54.476256+0000","last_unstale":"2024-09-15T22:11:02.874394+0000","last_undegraded":"2024-09-15T22:11:02.874394+0000","last_fullsized":"2024-09-15T22:11:02.874394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:26.775968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.220760+0000","last_change":"2024-09-15T22:09:56.703160+0000","last_active":"2024-09-15T22:10:44.220760+0000","last_peered":"2024-09-15T22:10:44.220760+0000","last_clean":"2024-09-15T22:10:44.220760+0000","last_became_active":"2024-09-15T22:09:56.702822+0000","last_became_peered":"2024-09-15T22:09:56.702822+0000","last_unstale":"2024-09-15T22:10:44.220760+0000","last_undegraded":"2024-09-15T22:10:44.220760+0000","last_fullsized":"2024-09-15T22:10:44.220760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:41.188636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:01.873562+0000","last_change":"2024-09-15T22:09:54.219289+0000","last_active":"2024-09-15T22:11:01.873562+0000","last_peered":"2024-09-15T22:11:01.873562+0000","last_clean":"2024-09-15T22:11:01.873562+0000","last_became_active":"2024-09-15T22:09:54.218572+0000","last_became_peered":"2024-09-15T22:09:54.218572+0000","last_unstale":"2024-09-15T22:11:01.873562+0000","last_undegraded":"2024-09-15T22:11:01.873562+0000","last_fullsized":"2024-09-15T22:11:01.873562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:02.294569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227224+0000","last_change":"2024-09-15T22:09:56.698458+0000","last_active":"2024-09-15T22:10:44.227224+0000","last_peered":"2024-09-15T22:10:44.227224+0000","last_clean":"2024-09-15T22:10:44.227224+0000","last_became_active":"2024-09-15T22:09:56.698135+0000","last_became_peered":"2024-09-15T22:09:56.698135+0000","last_unstale":"2024-09-15T22:10:44.227224+0000","last_undegraded":"2024-09-15T22:10:44.227224+0000","last_fullsized":"2024-09-15T22:10:44.227224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:40.002319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222950+0000","last_change":"2024-09-15T22:09:54.478546+0000","last_active":"2024-09-15T22:10:44.222950+0000","last_peered":"2024-09-15T22:10:44.222950+0000","last_clean":"2024-09-15T22:10:44.222950+0000","last_became_active":"2024-09-15T22:09:54.478106+0000","last_became_peered":"2024-09-15T22:09:54.478106+0000","last_unstale":"2024-09-15T22:10:44.222950+0000","last_undegraded":"2024-09-15T22:10:44.222950+0000","last_fullsized":"2024-09-15T22:10:44.222950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:57.687752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226846+0000","last_change":"2024-09-15T22:09:56.697014+0000","last_active":"2024-09-15T22:10:44.226846+0000","last_peered":"2024-09-15T22:10:44.226846+0000","last_clean":"2024-09-15T22:10:44.226846+0000","last_became_active":"2024-09-15T22:09:56.696702+0000","last_became_peered":"2024-09-15T22:09:56.696702+0000","last_unstale":"2024-09-15T22:10:44.226846+0000","last_undegraded":"2024-09-15T22:10:44.226846+0000","last_fullsized":"2024-09-15T22:10:44.226846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:08.687166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223471+0000","last_change":"2024-09-15T22:09:54.477243+0000","last_active":"2024-09-15T22:10:44.223471+0000","last_peered":"2024-09-15T22:10:44.223471+0000","last_clean":"2024-09-15T22:10:44.223471+0000","last_became_active":"2024-09-15T22:09:54.476879+0000","last_became_peered":"2024-09-15T22:09:54.476879+0000","last_unstale":"2024-09-15T22:10:44.223471+0000","last_undegraded":"2024-09-15T22:10:44.223471+0000","last_fullsized":"2024-09-15T22:10:44.223471+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:31.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.229489+0000","last_change":"2024-09-15T22:09:56.689341+0000","last_active":"2024-09-15T22:10:44.229489+0000","last_peered":"2024-09-15T22:10:44.229489+0000","last_clean":"2024-09-15T22:10:44.229489+0000","last_became_active":"2024-09-15T22:09:56.688925+0000","last_became_peered":"2024-09-15T22:09:56.688925+0000","last_unstale":"2024-09-15T22:10:44.229489+0000","last_undegraded":"2024-09-15T22:10:44.229489+0000","last_fullsized":"2024-09-15T22:10:44.229489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:20.552548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222835+0000","last_change":"2024-09-15T22:09:54.219690+0000","last_active":"2024-09-15T22:10:44.222835+0000","last_peered":"2024-09-15T22:10:44.222835+0000","last_clean":"2024-09-15T22:10:44.222835+0000","last_became_active":"2024-09-15T22:09:54.218962+0000","last_became_peered":"2024-09-15T22:09:54.218962+0000","last_unstale":"2024-09-15T22:10:44.222835+0000","last_undegraded":"2024-09-15T22:10:44.222835+0000","last_fullsized":"2024-09-15T22:10:44.222835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:44.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227315+0000","last_change":"2024-09-15T22:09:56.702350+0000","last_active":"2024-09-15T22:10:44.227315+0000","last_peered":"2024-09-15T22:10:44.227315+0000","last_clean":"2024-09-15T22:10:44.227315+0000","last_became_active":"2024-09-15T22:09:56.699387+0000","last_became_peered":"2024-09-15T22:09:56.699387+0000","last_unstale":"2024-09-15T22:10:44.227315+0000","last_undegraded":"2024-09-15T22:10:44.227315+0000","last_fullsized":"2024-09-15T22:10:44.227315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:47.005526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.337357+0000","last_change":"2024-09-15T22:09:55.000416+0000","last_active":"2024-09-15T22:10:44.337357+0000","last_peered":"2024-09-15T22:10:44.337357+0000","last_clean":"2024-09-15T22:10:44.337357+0000","last_became_active":"2024-09-15T22:09:55.000108+0000","last_became_peered":"2024-09-15T22:09:55.000108+0000","last_unstale":"2024-09-15T22:10:44.337357+0000","last_undegraded":"2024-09-15T22:10:44.337357+0000","last_fullsized":"2024-09-15T22:10:44.337357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:15.005148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336155+0000","last_change":"2024-09-15T22:09:56.707107+0000","last_active":"2024-09-15T22:10:44.336155+0000","last_peered":"2024-09-15T22:10:44.336155+0000","last_clean":"2024-09-15T22:10:44.336155+0000","last_became_active":"2024-09-15T22:09:56.706442+0000","last_became_peered":"2024-09-15T22:09:56.706442+0000","last_unstale":"2024-09-15T22:10:44.336155+0000","last_undegraded":"2024-09-15T22:10:44.336155+0000","last_fullsized":"2024-09-15T22:10:44.336155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:51.381492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223602+0000","last_change":"2024-09-15T22:09:54.477365+0000","last_active":"2024-09-15T22:10:44.223602+0000","last_peered":"2024-09-15T22:10:44.223602+0000","last_clean":"2024-09-15T22:10:44.223602+0000","last_became_active":"2024-09-15T22:09:54.477033+0000","last_became_peered":"2024-09-15T22:09:54.477033+0000","last_unstale":"2024-09-15T22:10:44.223602+0000","last_undegraded":"2024-09-15T22:10:44.223602+0000","last_fullsized":"2024-09-15T22:10:44.223602+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:10.634767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222528+0000","last_change":"2024-09-15T22:09:56.693547+0000","last_active":"2024-09-15T22:10:44.222528+0000","last_peered":"2024-09-15T22:10:44.222528+0000","last_clean":"2024-09-15T22:10:44.222528+0000","last_became_active":"2024-09-15T22:09:56.692923+0000","last_became_peered":"2024-09-15T22:09:56.692923+0000","last_unstale":"2024-09-15T22:10:44.222528+0000","last_undegraded":"2024-09-15T22:10:44.222528+0000","last_fullsized":"2024-09-15T22:10:44.222528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.462232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227400+0000","last_change":"2024-09-15T22:09:54.221737+0000","last_active":"2024-09-15T22:10:44.227400+0000","last_peered":"2024-09-15T22:10:44.227400+0000","last_clean":"2024-09-15T22:10:44.227400+0000","last_became_active":"2024-09-15T22:09:54.221418+0000","last_became_peered":"2024-09-15T22:09:54.221418+0000","last_unstale":"2024-09-15T22:10:44.227400+0000","last_undegraded":"2024-09-15T22:10:44.227400+0000","last_fullsized":"2024-09-15T22:10:44.227400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:35.636403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225088+0000","last_change":"2024-09-15T22:09:56.690290+0000","last_active":"2024-09-15T22:10:44.225088+0000","last_peered":"2024-09-15T22:10:44.225088+0000","last_clean":"2024-09-15T22:10:44.225088+0000","last_became_active":"2024-09-15T22:09:56.689986+0000","last_became_peered":"2024-09-15T22:09:56.689986+0000","last_unstale":"2024-09-15T22:10:44.225088+0000","last_undegraded":"2024-09-15T22:10:44.225088+0000","last_fullsized":"2024-09-15T22:10:44.225088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:53.860697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226295+0000","last_change":"2024-09-15T22:09:54.219569+0000","last_active":"2024-09-15T22:10:44.226295+0000","last_peered":"2024-09-15T22:10:44.226295+0000","last_clean":"2024-09-15T22:10:44.226295+0000","last_became_active":"2024-09-15T22:09:54.219203+0000","last_became_peered":"2024-09-15T22:09:54.219203+0000","last_unstale":"2024-09-15T22:10:44.226295+0000","last_undegraded":"2024-09-15T22:10:44.226295+0000","last_fullsized":"2024-09-15T22:10:44.226295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:21:02.719849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227089+0000","last_change":"2024-09-15T22:09:56.696608+0000","last_active":"2024-09-15T22:10:44.227089+0000","last_peered":"2024-09-15T22:10:44.227089+0000","last_clean":"2024-09-15T22:10:44.227089+0000","last_became_active":"2024-09-15T22:09:56.696301+0000","last_became_peered":"2024-09-15T22:09:56.696301+0000","last_unstale":"2024-09-15T22:10:44.227089+0000","last_undegraded":"2024-09-15T22:10:44.227089+0000","last_fullsized":"2024-09-15T22:10:44.227089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:48.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.222801+0000","last_change":"2024-09-15T22:09:54.218426+0000","last_active":"2024-09-15T22:10:44.222801+0000","last_peered":"2024-09-15T22:10:44.222801+0000","last_clean":"2024-09-15T22:10:44.222801+0000","last_became_active":"2024-09-15T22:09:54.218084+0000","last_became_peered":"2024-09-15T22:09:54.218084+0000","last_unstale":"2024-09-15T22:10:44.222801+0000","last_undegraded":"2024-09-15T22:10:44.222801+0000","last_fullsized":"2024-09-15T22:10:44.222801+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:46.067886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.224256+0000","last_change":"2024-09-15T22:09:56.696993+0000","last_active":"2024-09-15T22:10:44.224256+0000","last_peered":"2024-09-15T22:10:44.224256+0000","last_clean":"2024-09-15T22:10:44.224256+0000","last_became_active":"2024-09-15T22:09:56.696532+0000","last_became_peered":"2024-09-15T22:09:56.696532+0000","last_unstale":"2024-09-15T22:10:44.224256+0000","last_undegraded":"2024-09-15T22:10:44.224256+0000","last_fullsized":"2024-09-15T22:10:44.224256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:56.385349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.226547+0000","last_change":"2024-09-15T22:10:44.226547+0000","last_active":"2024-09-15T22:10:44.226547+0000","last_peered":"2024-09-15T22:10:44.226547+0000","last_clean":"2024-09-15T22:10:44.226547+0000","last_became_active":"2024-09-15T22:10:44.226162+0000","last_became_peered":"2024-09-15T22:10:44.226162+0000","last_unstale":"2024-09-15T22:10:44.226547+0000","last_undegraded":"2024-09-15T22:10:44.226547+0000","last_fullsized":"2024-09-15T22:10:44.226547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:49:06.054719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.223241+0000","last_change":"2024-09-15T22:09:54.220621+0000","last_active":"2024-09-15T22:10:44.223241+0000","last_peered":"2024-09-15T22:10:44.223241+0000","last_clean":"2024-09-15T22:10:44.223241+0000","last_became_active":"2024-09-15T22:09:54.220280+0000","last_became_peered":"2024-09-15T22:09:54.220280+0000","last_unstale":"2024-09-15T22:10:44.223241+0000","last_undegraded":"2024-09-15T22:10:44.223241+0000","last_fullsized":"2024-09-15T22:10:44.223241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:33.037698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.225459+0000","last_change":"2024-09-15T22:09:56.693653+0000","last_active":"2024-09-15T22:10:44.225459+0000","last_peered":"2024-09-15T22:10:44.225459+0000","last_clean":"2024-09-15T22:10:44.225459+0000","last_became_active":"2024-09-15T22:09:56.692756+0000","last_became_peered":"2024-09-15T22:09:56.692756+0000","last_unstale":"2024-09-15T22:10:44.225459+0000","last_undegraded":"2024-09-15T22:10:44.225459+0000","last_fullsized":"2024-09-15T22:10:44.225459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:19.607542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.352544+0000","last_change":"2024-09-15T22:10:44.352544+0000","last_active":"2024-09-15T22:10:44.352544+0000","last_peered":"2024-09-15T22:10:44.352544+0000","last_clean":"2024-09-15T22:10:44.352544+0000","last_became_active":"2024-09-15T22:10:44.338701+0000","last_became_peered":"2024-09-15T22:10:44.338701+0000","last_unstale":"2024-09-15T22:10:44.352544+0000","last_undegraded":"2024-09-15T22:10:44.352544+0000","last_fullsized":"2024-09-15T22:10:44.352544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:20.791350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.336174+0000","last_change":"2024-09-15T22:09:56.692795+0000","last_active":"2024-09-15T22:10:44.336174+0000","last_peered":"2024-09-15T22:10:44.336174+0000","last_clean":"2024-09-15T22:10:44.336174+0000","last_became_active":"2024-09-15T22:09:56.692425+0000","last_became_peered":"2024-09-15T22:09:56.692425+0000","last_unstale":"2024-09-15T22:10:44.336174+0000","last_undegraded":"2024-09-15T22:10:44.336174+0000","last_fullsized":"2024-09-15T22:10:44.336174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:45.920502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227390+0000","last_change":"2024-09-15T22:09:54.476726+0000","last_active":"2024-09-15T22:10:44.227390+0000","last_peered":"2024-09-15T22:10:44.227390+0000","last_clean":"2024-09-15T22:10:44.227390+0000","last_became_active":"2024-09-15T22:09:54.476317+0000","last_became_peered":"2024-09-15T22:09:54.476317+0000","last_unstale":"2024-09-15T22:10:44.227390+0000","last_undegraded":"2024-09-15T22:10:44.227390+0000","last_fullsized":"2024-09-15T22:10:44.227390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:48.361958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:10:44.227206+0000","last_change":"2024-09-15T22:09:56.701501+0000","last_active":"2024-09-15T22:10:44.227206+0000","last_peered":"2024-09-15T22:10:44.227206+0000","last_clean":"2024-09-15T22:10:44.227206+0000","last_became_active":"2024-09-15T22:09:56.701166+0000","last_became_peered":"2024-09-15T22:09:56.701166+0000","last_unstale":"2024-09-15T22:10:44.227206+0000","last_undegraded":"2024-09-15T22:10:44.227206+0000","last_fullsized":"2024-09-15T22:10:44.227206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:55.665394+0000","last_clean_scrub_stamp":"2024-09-15T22:09:55.665394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:20.698770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T22:11:01.872730+0000","last_change":"2024-09-15T22:09:54.216841+0000","last_active":"2024-09-15T22:11:01.872730+0000","last_peered":"2024-09-15T22:11:01.872730+0000","last_clean":"2024-09-15T22:11:01.872730+0000","last_became_active":"2024-09-15T22:09:54.216458+0000","last_became_peered":"2024-09-15T22:09:54.216458+0000","last_unstale":"2024-09-15T22:11:01.872730+0000","last_undegraded":"2024-09-15T22:11:01.872730+0000","last_fullsized":"2024-09-15T22:11:01.872730+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:53.196182+0000","last_clean_scrub_stamp":"2024-09-15T22:09:53.196182+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:03.116014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67505,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":579,"num_read_kb":363,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612636,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":444367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841568,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32768,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712384,"statfs":{"total":95995035648,"available":95961481216,"internally_reserved":0,"allocated":1613824,"data_stored":1096479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037798,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":444414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":444675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1531904,"data_stored":1037195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659190,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":444014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888124,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1544192,"data_stored":1036480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":444268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":443722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476810,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":505837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607632,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":505617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":445353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:11:09.916 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:11:09.917 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:11:09.917 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:11:09.917 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T22:11:10.291 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:10 smithi154 ceph-mon[34853]: from='client.24856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:11:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:10 smithi154 ceph-mon[34853]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:10.538 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:10 smithi150 ceph-mon[30886]: from='client.24856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:11:10.538 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:10 smithi150 ceph-mon[30886]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:10 smithi169 ceph-mon[35850]: from='client.24856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:11:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:10 smithi169 ceph-mon[35850]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 -- 172.21.15.150:0/1485028835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 msgr2=0x7fb4f810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1485028835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f810b9a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009900 tx=0x7fb4e402a480 comp rx=0 tx=0).stop 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 -- 172.21.15.150:0/1485028835 shutdown_connections 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1485028835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 0x7fb4f810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1485028835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f810b9a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1485028835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 -- 172.21.15.150:0/1485028835 >> 172.21.15.150:0/1485028835 conn(0x7fb4f80fc610 msgr2=0x7fb4f80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 -- 172.21.15.150:0/1485028835 shutdown_connections 2024-09-15T22:11:10.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.786+0000 7fb4fe200640 1 -- 172.21.15.150:0/1485028835 wait complete. 2024-09-15T22:11:10.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 Processor -- start 2024-09-15T22:11:10.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 -- start start 2024-09-15T22:11:10.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:10.790 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f81007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 0x7fb4f8100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f8111e10 con 0x7fb4f81034b0 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f8111c90 con 0x7fb4f810bfc0 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.788+0000 7fb4fe200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f8111f90 con 0x7fb4f8102b90 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f81007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4fce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f81007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35132/0 (socket says 172.21.15.150:35132) 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 -- 172.21.15.150:0/1511310190 learned_addr learned my addr 172.21.15.150:0/1511310190 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4fce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:38162/0 (socket says 172.21.15.150:38162) 2024-09-15T22:11:10.791 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4fd800640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 0x7fb4f8100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:10.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 -- 172.21.15.150:0/1511310190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 msgr2=0x7fb4f8102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:10.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:10.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 -- 172.21.15.150:0/1511310190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 msgr2=0x7fb4f8100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:10.792 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 0x7fb4f8100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 -- 172.21.15.150:0/1511310190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f81013e0 con 0x7fb4f81034b0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4fce00640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4fd800640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 0x7fb4f8100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.789+0000 7fb4f7e00640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f81007a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4004770 tx=0x7fb4e4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.790+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e403f070 con 0x7fb4f81034b0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.790+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4e4031ca0 con 0x7fb4f81034b0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.790+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f81af310 con 0x7fb4f81034b0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.790+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4035030 con 0x7fb4f81034b0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.790+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f81af700 con 0x7fb4f81034b0 2024-09-15T22:11:10.793 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.791+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f806a850 con 0x7fb4f81034b0 2024-09-15T22:11:10.795 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.793+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb4e4042070 con 0x7fb4f81034b0 2024-09-15T22:11:10.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.795+0000 7fb4f5600640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb4e00a3350 0x7fb4e00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:10.796 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.795+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fb4e40effe0 con 0x7fb4f81034b0 2024-09-15T22:11:10.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.795+0000 7fb4fce00640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb4e00a3350 0x7fb4e00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:10.797 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.796+0000 7fb4fce00640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb4e00a3350 0x7fb4e00a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec005fd0 tx=0x7fb4ec009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:10.800 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:10.799+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4e40bc5e0 con 0x7fb4f81034b0 2024-09-15T22:11:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.013+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb4f802d7c0 con 0x7fb4f81034b0 2024-09-15T22:11:11.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.013+0000 7fb4f5600640 1 -- 172.21.15.150:0/1511310190 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb4e40c08e0 con 0x7fb4f81034b0 2024-09-15T22:11:11.016 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:11.016 INFO:teuthology.orchestra.run.smithi150.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:11:11.018 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb4e00a3350 msgr2=0x7fb4e00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb4e00a3350 0x7fb4e00a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec005fd0 tx=0x7fb4ec009500 comp rx=0 tx=0).stop 2024-09-15T22:11:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 msgr2=0x7fb4f81007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f81007a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4004770 tx=0x7fb4e4003c10 comp rx=0 tx=0).stop 2024-09-15T22:11:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 shutdown_connections 2024-09-15T22:11:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4f810bfc0 0x7fb4f8100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:11.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb4e00a3350 0x7fb4e00a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:11.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4f81034b0 0x7fb4f81007a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:11.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 --2- 172.21.15.150:0/1511310190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4f8102b90 0x7fb4f8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:11.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 >> 172.21.15.150:0/1511310190 conn(0x7fb4f80fc610 msgr2=0x7fb4f80fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:11.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.016+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 shutdown_connections 2024-09-15T22:11:11.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:11.017+0000 7fb4fe200640 1 -- 172.21.15.150:0/1511310190 wait complete. 2024-09-15T22:11:11.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:11 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1511310190' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:11:11.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:11 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1511310190' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:11:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:11 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1511310190' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:11:11.762 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:11:11.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:11:12.132 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:12 smithi154 ceph-mon[34853]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:12.544 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:12 smithi150 ceph-mon[30886]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 -- 172.21.15.150:0/2545550661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8109090 msgr2=0x7ff5d8110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:12.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 --2- 172.21.15.150:0/2545550661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8109090 0x7ff5d8110c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009ca0 tx=0x7ff5d002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 -- 172.21.15.150:0/2545550661 shutdown_connections 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 --2- 172.21.15.150:0/2545550661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8109090 0x7ff5d8110c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 --2- 172.21.15.150:0/2545550661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8104800 0x7ff5d8108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 --2- 172.21.15.150:0/2545550661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d8104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 -- 172.21.15.150:0/2545550661 >> 172.21.15.150:0/2545550661 conn(0x7ff5d80ff8b0 msgr2=0x7ff5d8101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 -- 172.21.15.150:0/2545550661 shutdown_connections 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.651+0000 7ff5de600640 1 -- 172.21.15.150:0/2545550661 wait complete. 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 Processor -- start 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 -- start start 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:12.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8104800 0x7ff5d819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8109090 0x7ff5d819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81140b0 con 0x7ff5d8103e50 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d8113f30 con 0x7ff5d8104800 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5de600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d8114230 con 0x7ff5d8109090 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.653+0000 7ff5dd200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35152/0 (socket says 172.21.15.150:35152) 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 -- 172.21.15.150:0/1059249914 learned_addr learned my addr 172.21.15.150:0/1059249914 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5d7e00640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8104800 0x7ff5d819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5ddc00640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8109090 0x7ff5d819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 -- 172.21.15.150:0/1059249914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8109090 msgr2=0x7ff5d819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:12.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8109090 0x7ff5d819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 -- 172.21.15.150:0/1059249914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8104800 msgr2=0x7ff5d819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8104800 0x7ff5d819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 -- 172.21.15.150:0/1059249914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d819f540 con 0x7ff5d8103e50 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5ddc00640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8109090 0x7ff5d819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5d7e00640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8104800 0x7ff5d819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.654+0000 7ff5dd200640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d819a590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00ea60 tx=0x7ff5cc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.655+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00cde0 con 0x7ff5d8103e50 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.655+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5cc0035f0 con 0x7ff5d8103e50 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.655+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d819f830 con 0x7ff5d8103e50 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.655+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc010670 con 0x7ff5d8103e50 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.655+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d81a7110 con 0x7ff5d8103e50 2024-09-15T22:11:12.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.656+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d8105330 con 0x7ff5d8103e50 2024-09-15T22:11:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.658+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff5cc0037a0 con 0x7ff5d8103e50 2024-09-15T22:11:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.659+0000 7ff5d5600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff5c00a32d0 0x7ff5c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.659+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7ff5cc0cfd90 con 0x7ff5d8103e50 2024-09-15T22:11:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.659+0000 7ff5d7e00640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff5c00a32d0 0x7ff5c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.660+0000 7ff5d7e00640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff5c00a32d0 0x7ff5c00a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80ffcd0 tx=0x7ff5c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:12.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.663+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5cc09c8e0 con 0x7ff5d8103e50 2024-09-15T22:11:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:12 smithi169 ceph-mon[35850]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:12.873 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.871+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5d810c320 con 0x7ff5d8103e50 2024-09-15T22:11:12.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.872+0000 7ff5d5600640 1 -- 172.21.15.150:0/1059249914 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11997 (secure 0 0 0) 0x7ff5d810c320 con 0x7ff5d8103e50 2024-09-15T22:11:12.875 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:12.875 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"btime":"2024-09-15T22:10:10:787282+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:10:10.787262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:11:12.875 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff5c00a32d0 msgr2=0x7ff5c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff5c00a32d0 0x7ff5c00a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80ffcd0 tx=0x7ff5c4005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 msgr2=0x7ff5d819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d819a590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00ea60 tx=0x7ff5cc00ef20 comp rx=0 tx=0).stop 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 shutdown_connections 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5d8109090 0x7ff5d819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5d8104800 0x7ff5d819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff5c00a32d0 0x7ff5c00a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 --2- 172.21.15.150:0/1059249914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5d8103e50 0x7ff5d819a590 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:12.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 >> 172.21.15.150:0/1059249914 conn(0x7ff5d80ff8b0 msgr2=0x7ff5d8100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:12.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 shutdown_connections 2024-09-15T22:11:12.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:12.875+0000 7ff5de600640 1 -- 172.21.15.150:0/1059249914 wait complete. 2024-09-15T22:11:13.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:13 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1059249914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:13.549 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:13 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1059249914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:13.586 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:11:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:13 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1059249914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:13.954 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:14.360 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:14 smithi150 ceph-mon[30886]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:14.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 -- 172.21.15.150:0/4166848162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400112b90 msgr2=0x7f5400114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:14.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 --2- 172.21.15.150:0/4166848162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400112b90 0x7f5400114f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009ca0 tx=0x7f53f802a950 comp rx=0 tx=0).stop 2024-09-15T22:11:14.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 -- 172.21.15.150:0/4166848162 shutdown_connections 2024-09-15T22:11:14.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 --2- 172.21.15.150:0/4166848162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400112b90 0x7f5400114f80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 --2- 172.21.15.150:0/4166848162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5400074eb0 0x7f5400112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 --2- 172.21.15.150:0/4166848162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400074590 0x7f5400074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 -- 172.21.15.150:0/4166848162 >> 172.21.15.150:0/4166848162 conn(0x7f54000fd8c0 msgr2=0x7f54000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 -- 172.21.15.150:0/4166848162 shutdown_connections 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.467+0000 7f5407800640 1 -- 172.21.15.150:0/4166848162 wait complete. 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.468+0000 7f5407800640 1 Processor -- start 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.468+0000 7f5407800640 1 -- start start 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5407800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5400074590 0x7f540019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5407800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 0x7f540019f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5407800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400112b90 0x7f54001a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5407800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f54001185a0 con 0x7f5400074eb0 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5407800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5400118420 con 0x7f5400112b90 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5407800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5400118720 con 0x7f5400074590 2024-09-15T22:11:14.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 0x7f540019f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 0x7f540019f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35174/0 (socket says 172.21.15.150:35174) 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 -- 172.21.15.150:0/1447690592 learned_addr learned my addr 172.21.15.150:0/1447690592 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5404e00640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5400074590 0x7f540019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f5405800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400112b90 0x7f54001a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 -- 172.21.15.150:0/1447690592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5400074590 msgr2=0x7f540019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5400074590 0x7f540019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 -- 172.21.15.150:0/1447690592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400112b90 msgr2=0x7f54001a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400112b90 0x7f54001a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.469+0000 7f53f7e00640 1 -- 172.21.15.150:0/1447690592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54001a3b20 con 0x7f5400074eb0 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.470+0000 7f53f7e00640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 0x7f540019f030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53e800e9f0 tx=0x7f53e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:14.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.470+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e800cd80 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.470+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e8010910 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.470+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54001a3e10 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.470+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8018990 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.470+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54001ab6a0 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.471+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5400074970 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.473+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f53e8010ac0 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.475+0000 7f53fe000640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f53e40a32d0 0x7f53e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.475+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f53e80cfd40 con 0x7f5400074eb0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.475+0000 7f5404e00640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f53e40a32d0 0x7f53e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.475+0000 7f5404e00640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f53e40a32d0 0x7f53e40a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f53f00095f0 tx=0x7f53f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:14.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.479+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53e809c2a0 con 0x7f5400074eb0 2024-09-15T22:11:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:14 smithi154 ceph-mon[34853]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:14.692 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.690+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5400104fd0 con 0x7f5400074eb0 2024-09-15T22:11:14.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.690+0000 7f53fe000640 1 -- 172.21.15.150:0/1447690592 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11997 (secure 0 0 0) 0x7f53e80a05a0 con 0x7f5400074eb0 2024-09-15T22:11:14.693 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:14.694 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"btime":"2024-09-15T22:10:10:787282+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:10:10.787262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:11:14.694 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:11:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f53e40a32d0 msgr2=0x7f53e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f53e40a32d0 0x7f53e40a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f53f00095f0 tx=0x7f53f0005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:14.695 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 msgr2=0x7f540019f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 0x7f540019f030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53e800e9f0 tx=0x7f53e800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 shutdown_connections 2024-09-15T22:11:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400112b90 0x7f54001a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f53e40a32d0 0x7f53e40a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5400074eb0 0x7f540019f030 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 --2- 172.21.15.150:0/1447690592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5400074590 0x7f540019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:14.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 >> 172.21.15.150:0/1447690592 conn(0x7f54000fd8c0 msgr2=0x7f54000ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:14.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 shutdown_connections 2024-09-15T22:11:14.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:14.693+0000 7f5407800640 1 -- 172.21.15.150:0/1447690592 wait complete. 2024-09-15T22:11:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:14 smithi169 ceph-mon[35850]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:15.364 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:15 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1447690592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:15.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:11:15.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:15 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1447690592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:15.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:15 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1447690592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:15.772 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:16.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 -- 172.21.15.150:0/514663081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087810e3c0 msgr2=0x7f0878110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:16.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 --2- 172.21.15.150:0/514663081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087810e3c0 0x7f0878110810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0870009ca0 tx=0x7f087002a950 comp rx=0 tx=0).stop 2024-09-15T22:11:16.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 -- 172.21.15.150:0/514663081 shutdown_connections 2024-09-15T22:11:16.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 --2- 172.21.15.150:0/514663081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f087810e3c0 0x7f0878110810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 --2- 172.21.15.150:0/514663081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 --2- 172.21.15.150:0/514663081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0878074620 0x7f0878074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.286+0000 7f087f800640 1 -- 172.21.15.150:0/514663081 >> 172.21.15.150:0/514663081 conn(0x7f08780fd8c0 msgr2=0x7f08780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:16.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.287+0000 7f087f800640 1 -- 172.21.15.150:0/514663081 shutdown_connections 2024-09-15T22:11:16.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.287+0000 7f087f800640 1 -- 172.21.15.150:0/514663081 wait complete. 2024-09-15T22:11:16.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.287+0000 7f087f800640 1 Processor -- start 2024-09-15T22:11:16.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 -- start start 2024-09-15T22:11:16.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0878074620 0x7f087819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087810e3c0 0x7f087819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0878114170 con 0x7f0878074620 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0878113ff0 con 0x7f087810e3c0 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087f800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08781142f0 con 0x7f0878074f40 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087ce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0878074620 0x7f087819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f086fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f086fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:38232/0 (socket says 172.21.15.150:38232) 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f086fe00640 1 -- 172.21.15.150:0/1304084262 learned_addr learned my addr 172.21.15.150:0/1304084262 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.288+0000 7f087d800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087810e3c0 0x7f087819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:16.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f086fe00640 1 -- 172.21.15.150:0/1304084262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087810e3c0 msgr2=0x7f087819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f086fe00640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087810e3c0 0x7f087819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f086fe00640 1 -- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0878074620 msgr2=0x7f087819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f086fe00640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0878074620 0x7f087819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f086fe00640 1 -- 172.21.15.150:0/1304084262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087819f620 con 0x7f0878074f40 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f087d800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087810e3c0 0x7f087819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f087ce00640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0878074620 0x7f087819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f086fe00640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087819abb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f086000e9f0 tx=0x7f086000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086000cd80 con 0x7f0878074f40 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860005500 con 0x7f0878074f40 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087819f910 con 0x7f0878074f40 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860010690 con 0x7f0878074f40 2024-09-15T22:11:16.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.289+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08781a71f0 con 0x7f0878074f40 2024-09-15T22:11:16.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.290+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0878074a00 con 0x7f0878074f40 2024-09-15T22:11:16.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.292+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f08600046c0 con 0x7f0878074f40 2024-09-15T22:11:16.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.294+0000 7f0876000640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f085c0a32d0 0x7f085c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:16.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.294+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f08600cff60 con 0x7f0878074f40 2024-09-15T22:11:16.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.294+0000 7f087ce00640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f085c0a32d0 0x7f085c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:16.296 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.294+0000 7f087ce00640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f085c0a32d0 0x7f085c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0868005d00 tx=0x7f086800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:16.299 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.298+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f086009cab0 con 0x7f0878074f40 2024-09-15T22:11:16.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.471+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0878108fb0 con 0x7f0878074f40 2024-09-15T22:11:16.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:16 smithi150 ceph-mon[30886]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:16.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.473+0000 7f0876000640 1 -- 172.21.15.150:0/1304084262 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22790 (secure 0 0 0) 0x7f086009c3b0 con 0x7f0878074f40 2024-09-15T22:11:16.475 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:16.475 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":82,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:10:44.216028+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8},{"from":3,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f085c0a32d0 msgr2=0x7f085c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f085c0a32d0 0x7f085c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0868005d00 tx=0x7f086800b410 comp rx=0 tx=0).stop 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 msgr2=0x7f087819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087819abb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f086000e9f0 tx=0x7f086000edf0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 shutdown_connections 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087810e3c0 0x7f087819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0878074f40 0x7f087819abb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f085c0a32d0 0x7f085c0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 --2- 172.21.15.150:0/1304084262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0878074620 0x7f087819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:16.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 >> 172.21.15.150:0/1304084262 conn(0x7f08780fd8c0 msgr2=0x7f08780fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:16.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 shutdown_connections 2024-09-15T22:11:16.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:16.475+0000 7f087f800640 1 -- 172.21.15.150:0/1304084262 wait complete. 2024-09-15T22:11:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:16 smithi154 ceph-mon[34853]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:16 smithi169 ceph-mon[35850]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:17.185 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:11:17.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:17 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1304084262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:11:17.553 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:17.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:17 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1304084262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:11:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:17 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1304084262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:11:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 -- 172.21.15.150:0/3464208149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc102360 msgr2=0x7f32cc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 --2- 172.21.15.150:0/3464208149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc102360 0x7f32cc10e890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009cd0 tx=0x7f32c402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 -- 172.21.15.150:0/3464208149 shutdown_connections 2024-09-15T22:11:18.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 --2- 172.21.15.150:0/3464208149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc102360 0x7f32cc10e890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 --2- 172.21.15.150:0/3464208149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc1019c0 0x7f32cc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 --2- 172.21.15.150:0/3464208149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32cc1079c0 0x7f32cc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 -- 172.21.15.150:0/3464208149 >> 172.21.15.150:0/3464208149 conn(0x7f32cc0fd740 msgr2=0x7f32cc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 -- 172.21.15.150:0/3464208149 shutdown_connections 2024-09-15T22:11:18.103 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.100+0000 7f32d2000640 1 -- 172.21.15.150:0/3464208149 wait complete. 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.101+0000 7f32d2000640 1 Processor -- start 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 -- start start 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc1019c0 0x7f32cc19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc102360 0x7f32cc19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32cc1079c0 0x7f32cc19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc111dc0 con 0x7f32cc1019c0 2024-09-15T22:11:18.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc111c40 con 0x7f32cc102360 2024-09-15T22:11:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d2000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc111f40 con 0x7f32cc1079c0 2024-09-15T22:11:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d0c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc1019c0 0x7f32cc19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32cbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc102360 0x7f32cc19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d0c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc1019c0 0x7f32cc19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35212/0 (socket says 172.21.15.150:35212) 2024-09-15T22:11:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d0c00640 1 -- 172.21.15.150:0/425579168 learned_addr learned my addr 172.21.15.150:0/425579168 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:18.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.102+0000 7f32d1600640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32cc1079c0 0x7f32cc19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32cbe00640 1 -- 172.21.15.150:0/425579168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32cc1079c0 msgr2=0x7f32cc19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32cbe00640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32cc1079c0 0x7f32cc19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32cbe00640 1 -- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc1019c0 msgr2=0x7f32cc19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32cbe00640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc1019c0 0x7f32cc19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32cbe00640 1 -- 172.21.15.150:0/425579168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc19f480 con 0x7f32cc102360 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32cbe00640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc102360 0x7f32cc19aa10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32b800e9f0 tx=0x7f32b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b800ccc0 con 0x7f32cc102360 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc19f770 con 0x7f32cc102360 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8010910 con 0x7f32cc102360 2024-09-15T22:11:18.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8018960 con 0x7f32cc102360 2024-09-15T22:11:18.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.103+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc1a7050 con 0x7f32cc102360 2024-09-15T22:11:18.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.104+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32cc101e20 con 0x7f32cc102360 2024-09-15T22:11:18.108 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.106+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f32b8010ac0 con 0x7f32cc102360 2024-09-15T22:11:18.109 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.108+0000 7f32c9600640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32b40a32d0 0x7f32b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:18.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.108+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f32b80d0360 con 0x7f32cc102360 2024-09-15T22:11:18.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.108+0000 7f32d0c00640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32b40a32d0 0x7f32b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:18.110 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.109+0000 7f32d0c00640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32b40a32d0 0x7f32b40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f32c0005fd0 tx=0x7f32c000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:18.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.110+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32b809c860 con 0x7f32cc102360 2024-09-15T22:11:18.321 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.319+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32cc1a7280 con 0x7f32cc102360 2024-09-15T22:11:18.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.320+0000 7f32c9600640 1 -- 172.21.15.150:0/425579168 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11997 (secure 0 0 0) 0x7f32b80a0b60 con 0x7f32cc102360 2024-09-15T22:11:18.322 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:18.322 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"btime":"2024-09-15T22:10:10:787282+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:10:10.787262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:11:18.323 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32b40a32d0 msgr2=0x7f32b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32b40a32d0 0x7f32b40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f32c0005fd0 tx=0x7f32c000b4a0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc102360 msgr2=0x7f32cc19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc102360 0x7f32cc19aa10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32b800e9f0 tx=0x7f32b800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 shutdown_connections 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32cc1079c0 0x7f32cc19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32cc102360 0x7f32cc19aa10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.325 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32b40a32d0 0x7f32b40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 --2- 172.21.15.150:0/425579168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32cc1019c0 0x7f32cc19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:18.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 >> 172.21.15.150:0/425579168 conn(0x7f32cc0fd740 msgr2=0x7f32cc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:18.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 shutdown_connections 2024-09-15T22:11:18.326 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:18.323+0000 7f32d2000640 1 -- 172.21.15.150:0/425579168 wait complete. 2024-09-15T22:11:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:18 smithi150 ceph-mon[30886]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:18 smithi169 ceph-mon[35850]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:18 smithi154 ceph-mon[34853]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:19.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:09:57.693830+0000', 'modified': '2024-09-15T22:10:10.787262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24578, 'mds_1': 24539, 'mds_2': 24523, 'mds_3': 24512, 'mds_4': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14535': {'gid': 14535, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.150:6841/1726301246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6840', 'nonce': 1726301246}, {'type': 'v1', 'addr': '172.21.15.150:6841', 'nonce': 1726301246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6833/2170086704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 2170086704}, {'type': 'v1', 'addr': '172.21.15.169:6833', 'nonce': 2170086704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/1449001850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 1449001850}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 1449001850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.150:6835/3135790520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 3135790520}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 3135790520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/721825855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 721825855}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 721825855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.169:6837/2204560239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2204560239}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2204560239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.154:6835/2752652039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2752652039}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2752652039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.169:6839/2442112974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 2442112974}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 2442112974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.154:6837/1010193359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 1010193359}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1010193359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/2093141507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 2093141507}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 2093141507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24578, 'qdb_cluster': [24578, 24539, 24523, 24512, 24508]} 2024-09-15T22:11:19.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-15T22:11:19.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:11:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:19 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/425579168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:19.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:19 smithi150 ceph-mon[30886]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:19.456 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:19.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:19 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/425579168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:19.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:19 smithi169 ceph-mon[35850]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:19 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/425579168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:19 smithi154 ceph-mon[34853]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:19.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 -- 172.21.15.150:0/3820211408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 msgr2=0x7f5e901021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:19.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 --2- 172.21.15.150:0/3820211408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e901021b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009ca0 tx=0x7f5e8002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:19.994 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 -- 172.21.15.150:0/3820211408 shutdown_connections 2024-09-15T22:11:19.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 --2- 172.21.15.150:0/3820211408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90106f00 0x7f5e9010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:19.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 --2- 172.21.15.150:0/3820211408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90102780 0x7f5e901067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:19.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 --2- 172.21.15.150:0/3820211408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e901021b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:19.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 -- 172.21.15.150:0/3820211408 >> 172.21.15.150:0/3820211408 conn(0x7f5e900fd8b0 msgr2=0x7f5e900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:19.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 -- 172.21.15.150:0/3820211408 shutdown_connections 2024-09-15T22:11:19.995 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.992+0000 7f5e97800640 1 -- 172.21.15.150:0/3820211408 wait complete. 2024-09-15T22:11:19.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 Processor -- start 2024-09-15T22:11:19.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 -- start start 2024-09-15T22:11:19.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e90198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90102780 0x7f5e90198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90106f00 0x7f5e9019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90111f60 con 0x7f5e90101dd0 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90111de0 con 0x7f5e90102780 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.993+0000 7f5e97800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901120e0 con 0x7f5e90106f00 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e90198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90102780 0x7f5e90198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e95800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90106f00 0x7f5e9019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e90198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39132/0 (socket says 172.21.15.150:39132) 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 -- 172.21.15.150:0/989778875 learned_addr learned my addr 172.21.15.150:0/989778875 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 -- 172.21.15.150:0/989778875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90106f00 msgr2=0x7f5e9019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:19.997 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90106f00 0x7f5e9019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 -- 172.21.15.150:0/989778875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90102780 msgr2=0x7f5e90198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90102780 0x7f5e90198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e94e00640 1 -- 172.21.15.150:0/989778875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9019d3d0 con 0x7f5e90101dd0 2024-09-15T22:11:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.994+0000 7f5e95800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90106f00 0x7f5e9019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.995+0000 7f5e94e00640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e90198420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5e8002ade0 tx=0x7f5e800319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:19.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.995+0000 7f5e8e000640 1 -- 172.21.15.150:0/989778875 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8002fa20 con 0x7f5e90101dd0 2024-09-15T22:11:19.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.995+0000 7f5e8e000640 1 -- 172.21.15.150:0/989778875 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8002fbc0 con 0x7f5e90101dd0 2024-09-15T22:11:19.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.995+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9019d660 con 0x7f5e90101dd0 2024-09-15T22:11:19.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.995+0000 7f5e8e000640 1 -- 172.21.15.150:0/989778875 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800466e0 con 0x7f5e90101dd0 2024-09-15T22:11:19.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.995+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e90074420 con 0x7f5e90101dd0 2024-09-15T22:11:20.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.998+0000 7f5e8e000640 1 -- 172.21.15.150:0/989778875 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5e80046940 con 0x7f5e90101dd0 2024-09-15T22:11:20.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.998+0000 7f5e9a430740 1 Processor -- start 2024-09-15T22:11:20.000 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.998+0000 7f5e9a430740 1 -- start start 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a06f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a079fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a07c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e9a430740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563819fd50b0 con 0x56381a07a510 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e9a430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563819f7cab0 con 0x56381a06fc50 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e9a430740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563819fd1070 con 0x56381a06f330 2024-09-15T22:11:20.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a07c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a07c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39136/0 (socket says 172.21.15.150:39136) 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e95800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e87e00640 1 -- 172.21.15.150:0/789538725 learned_addr learned my addr 172.21.15.150:0/789538725 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:19.999+0000 7f5e94e00640 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a079fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e95800640 1 -- 172.21.15.150:0/789538725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 msgr2=0x56381a079fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e95800640 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a079fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e95800640 1 -- 172.21.15.150:0/789538725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 msgr2=0x56381a07c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e95800640 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a07c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e95800640 1 -- 172.21.15.150:0/789538725 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563819f894a0 con 0x56381a06f330 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e8e000640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5e740a32d0 0x7f5e740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.003 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e95800640 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a06f710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800bef0 tx=0x7f5e880107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=529dc8771f3232bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:20.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e8e000640 1 -- 172.21.15.150:0/989778875 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f5e800f0da0 con 0x7f5e90101dd0 2024-09-15T22:11:20.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e94e00640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5e740a32d0 0x7f5e740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e86000640 1 -- 172.21.15.150:0/789538725 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8801c680 con 0x56381a06f330 2024-09-15T22:11:20.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e86000640 1 -- 172.21.15.150:0/789538725 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8801cd00 con 0x56381a06f330 2024-09-15T22:11:20.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.000+0000 7f5e86000640 1 -- 172.21.15.150:0/789538725 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8801a380 con 0x56381a06f330 2024-09-15T22:11:20.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 -- 172.21.15.150:0/789538725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 msgr2=0x56381a06f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:20.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e94e00640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5e740a32d0 0x7f5e740a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e800bd290 tx=0x7f5e800f4850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:20.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a06f710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800bef0 tx=0x7f5e880107a0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 -- 172.21.15.150:0/789538725 shutdown_connections 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a07c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a079fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 --2- 172.21.15.150:0/789538725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a06f710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 -- 172.21.15.150:0/789538725 >> 172.21.15.150:0/789538725 conn(0x56381a06b8c0 msgr2=0x56381a06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 -- 172.21.15.150:0/789538725 shutdown_connections 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.001+0000 7f5e9a430740 1 -- 172.21.15.150:0/789538725 wait complete. 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.002+0000 7f5e9a430740 1 -- start start 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.002+0000 7f5e9a430740 1 Processor -- start 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a077570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56381a07d060 con 0x56381a07a510 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563819f5d920 con 0x56381a06f330 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56381a07d1e0 con 0x56381a06fc50 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e9a430740 10 client.0 _ll_register_callbacks cb 0x563819f818a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e95800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e95800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39150/0 (socket says 172.21.15.150:39150) 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e95800640 1 -- 172.21.15.150:0/237525061 learned_addr learned my addr 172.21.15.150:0/237525061 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e95800640 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a077570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.003+0000 7f5e87e00640 1 -- 172.21.15.150:0/237525061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 msgr2=0x56381a077570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e87e00640 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a077570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e87e00640 1 -- 172.21.15.150:0/237525061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 msgr2=0x56381a077ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e87e00640 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e87e00640 1 -- 172.21.15.150:0/237525061 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563819d462b0 con 0x56381a06fc50 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e87e00640 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a077ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x56381a06cc40 tx=0x7f5e78009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3137a36532b29ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e7ea00640 1 -- 172.21.15.150:0/237525061 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7801f020 con 0x56381a06fc50 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e8801cd00 con 0x56381a06fc50 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e7ea00640 1 -- 172.21.15.150:0/237525061 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f5e78004460 con 0x56381a06fc50 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e7ea00640 1 -- 172.21.15.150:0/237525061 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e7802a050 con 0x56381a06fc50 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.004+0000 7f5e9a430740 10 client.24898 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56381a088ea0 con 0x56381a06fc50 2024-09-15T22:11:20.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e7ea00640 1 -- 172.21.15.150:0/237525061 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8801cd00 con 0x56381a06fc50 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e7ea00640 1 -- 172.21.15.150:0/237525061 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5e78003ca0 con 0x56381a06fc50 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 10 client.24898 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 10 client.24898 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 20 client.24898 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a08b4d0 0x56381a08c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 4 client.24898 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.005+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 --> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563819fe2620 con 0x56381a08b4d0 2024-09-15T22:11:20.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.006+0000 7f5e95800640 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a08b4d0 0x56381a08c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.006+0000 7f5e95800640 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a08b4d0 0x56381a08c940 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b8fde0c7636bdb1d server_cookie=3c4954ba738eae8c in_seq=0 out_seq=0 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.006+0000 7f5e7ea00640 10 client.24898 ms_handle_connect on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.007+0000 7f5e7ea00640 1 -- 172.21.15.150:0/237525061 <== mds.4 v2:172.21.15.169:6836/2204560239 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563819fe2620 con 0x56381a08b4d0 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.007+0000 7f5e7ea00640 10 client.24898 handle_command_reply: tid=0 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 client.24898 shutdown 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 msgr2=0x56381a077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a077ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x56381a06cc40 tx=0x7f5e78009cb0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 shutdown_connections 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a08b4d0 0x56381a08c940 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a077ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 --2- 172.21.15.150:0/237525061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a077570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e7ea00640 0 client.24898 ms_handle_reset on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:20.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 >> 172.21.15.150:0/237525061 conn(0x56381a06b8c0 msgr2=0x56381a0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:20.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 shutdown_connections 2024-09-15T22:11:20.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 1 -- 172.21.15.150:0/237525061 wait complete. 2024-09-15T22:11:20.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.008+0000 7f5e9a430740 20 client.24898 trim_cache size 0 max 16384 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.026+0000 7f5e9a430740 1 Processor -- start 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 -- start start 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a0794e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56381a08ac80 con 0x56381a07a510 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56381a08b350 con 0x56381a06f330 2024-09-15T22:11:20.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e9a430740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56381a08ba20 con 0x56381a06fc50 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e95800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e95800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55694/0 (socket says 172.21.15.150:55694) 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e95800640 1 -- 172.21.15.150:0/2667127824 learned_addr learned my addr 172.21.15.150:0/2667127824 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e87e00640 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a0794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.027+0000 7f5e95800640 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e95800640 1 -- 172.21.15.150:0/2667127824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 msgr2=0x56381a0794e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e95800640 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a0794e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e95800640 1 -- 172.21.15.150:0/2667127824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 msgr2=0x56381a077e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e95800640 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e95800640 1 -- 172.21.15.150:0/2667127824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56381a06c970 con 0x56381a06f330 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e95800640 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a071d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e88011980 tx=0x7f5e880107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28bbb0cbd1ecf28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e85600640 1 -- 172.21.15.150:0/2667127824 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880050c0 con 0x56381a06f330 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e85600640 1 -- 172.21.15.150:0/2667127824 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8801c480 con 0x56381a06f330 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.028+0000 7f5e85600640 1 -- 172.21.15.150:0/2667127824 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8802e5d0 con 0x56381a06f330 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 -- 172.21.15.150:0/2667127824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 msgr2=0x56381a071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a071d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e88011980 tx=0x7f5e880107a0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 -- 172.21.15.150:0/2667127824 shutdown_connections 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a077e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06fc50 0x56381a0794e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 --2- 172.21.15.150:0/2667127824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06f330 0x56381a071d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 -- 172.21.15.150:0/2667127824 >> 172.21.15.150:0/2667127824 conn(0x56381a06b8c0 msgr2=0x56381a078dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:20.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 -- 172.21.15.150:0/2667127824 shutdown_connections 2024-09-15T22:11:20.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 -- 172.21.15.150:0/2667127824 wait complete. 2024-09-15T22:11:20.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 -- start start 2024-09-15T22:11:20.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.029+0000 7f5e9a430740 1 Processor -- start 2024-09-15T22:11:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a094df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.035 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a095330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a08fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56381a08c7c0 con 0x56381a07a510 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56381a08c0f0 con 0x56381a06fc50 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56381a08ce90 con 0x56381a06f330 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e9a430740 10 client.0 _ll_register_callbacks cb 0x7f5e78010f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e95800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a08fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a095330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e95800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a08fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39180/0 (socket says 172.21.15.150:39180) 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e95800640 1 -- 172.21.15.150:0/3051589010 learned_addr learned my addr 172.21.15.150:0/3051589010 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.030+0000 7f5e95800640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a094df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e87e00640 1 -- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 msgr2=0x56381a094df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e87e00640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a094df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e87e00640 1 -- 172.21.15.150:0/3051589010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 msgr2=0x56381a08fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e87e00640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a08fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e87e00640 1 -- 172.21.15.150:0/3051589010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56381a090280 con 0x56381a06fc50 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e95800640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a08fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e87e00640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a095330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009230 tx=0x7f5e7801b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4de64a055caa2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e7ea00640 1 -- 172.21.15.150:0/3051589010 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78032070 con 0x56381a06fc50 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e8801c480 con 0x56381a06fc50 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.031+0000 7f5e7ea00640 1 -- 172.21.15.150:0/3051589010 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f5e7801bd50 con 0x56381a06fc50 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e7ea00640 1 -- 172.21.15.150:0/3051589010 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e7801f030 con 0x56381a06fc50 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 10 client.24932 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:20.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56381a0fedb0 con 0x56381a06fc50 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e7ea00640 1 -- 172.21.15.150:0/3051589010 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8801c480 con 0x56381a06fc50 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e7ea00640 1 -- 172.21.15.150:0/3051589010 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5e78035030 con 0x56381a06fc50 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 10 client.24932 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 10 client.24932 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 20 client.24932 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a103950 0x56381a102660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 4 client.24932 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 --> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] -- command(tid 0: {"prefix": "status"}) -- 0x563819fdcb30 con 0x56381a103950 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.032+0000 7f5e95800640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a103950 0x56381a102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e95800640 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a103950 0x56381a102660 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c8ae2ad92248cc10 server_cookie=eeacceb4ebbe2647 in_seq=0 out_seq=0 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e7ea00640 10 client.24932 ms_handle_connect on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e7ea00640 1 -- 172.21.15.150:0/3051589010 <== mds.4 v2:172.21.15.169:6836/2204560239 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563819fdcb30 con 0x56381a103950 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e7ea00640 10 client.24932 handle_command_reply: tid=0 2024-09-15T22:11:20.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 client.24932 shutdown 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 msgr2=0x56381a095330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a095330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009230 tx=0x7f5e7801b8e0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 shutdown_connections 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x56381a103950 0x56381a102660 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56381a07a510 0x56381a08fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381a06fc50 0x56381a095330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 --2- 172.21.15.150:0/3051589010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56381a06f330 0x56381a094df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e7ea00640 0 client.24932 ms_handle_reset on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.033+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 >> 172.21.15.150:0/3051589010 conn(0x56381a06b8c0 msgr2=0x56381a085c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 shutdown_connections 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e9a430740 1 -- 172.21.15.150:0/3051589010 wait complete. 2024-09-15T22:11:20.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e9a430740 20 client.24932 trim_cache size 0 max 16384 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 4, 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24508, 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 70.254396013999994, 2024-09-15T22:11:20.040 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 82, 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 111.017749634 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5e740a32d0 msgr2=0x7f5e740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e97800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5e740a32d0 0x7f5e740a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e800bd290 tx=0x7f5e800f4850 comp rx=0 tx=0).stop 2024-09-15T22:11:20.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 msgr2=0x7f5e90198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.034+0000 7f5e97800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e90198420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5e8002ade0 tx=0x7f5e800319f0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 shutdown_connections 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e90106f00 0x7f5e9019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90102780 0x7f5e90198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5e740a32d0 0x7f5e740a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 --2- 172.21.15.150:0/989778875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e90101dd0 0x7f5e90198420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 >> 172.21.15.150:0/989778875 conn(0x7f5e900fd8b0 msgr2=0x7f5e900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 shutdown_connections 2024-09-15T22:11:20.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:20.035+0000 7f5e97800640 1 -- 172.21.15.150:0/989778875 wait complete. 2024-09-15T22:11:20.860 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-15T22:11:21.230 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:21.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 -- 172.21.15.150:0/702293631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 msgr2=0x7f449010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 --2- 172.21.15.150:0/702293631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449010de80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f447c009900 tx=0x7f447c02a480 comp rx=0 tx=0).stop 2024-09-15T22:11:21.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 -- 172.21.15.150:0/702293631 shutdown_connections 2024-09-15T22:11:21.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 --2- 172.21.15.150:0/702293631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f449010e3c0 0x7f4490110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.835 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 --2- 172.21.15.150:0/702293631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449010de80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 --2- 172.21.15.150:0/702293631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 0x7f4490074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 -- 172.21.15.150:0/702293631 >> 172.21.15.150:0/702293631 conn(0x7f44900fd8c0 msgr2=0x7f44900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:21.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 -- 172.21.15.150:0/702293631 shutdown_connections 2024-09-15T22:11:21.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.832+0000 7f4495600640 1 -- 172.21.15.150:0/702293631 wait complete. 2024-09-15T22:11:21.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.833+0000 7f4495600640 1 Processor -- start 2024-09-15T22:11:21.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.833+0000 7f4495600640 1 -- start start 2024-09-15T22:11:21.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f4495600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 0x7f449019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f4495600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f4495600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f449010e3c0 0x7f449019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f4495600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f44901141b0 con 0x7f4490074f40 2024-09-15T22:11:21.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f4495600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4490114030 con 0x7f449010e3c0 2024-09-15T22:11:21.840 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f4495600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4490114330 con 0x7f4490074620 2024-09-15T22:11:21.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f448e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f448e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39200/0 (socket says 172.21.15.150:39200) 2024-09-15T22:11:21.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f448e000640 1 -- 172.21.15.150:0/1227650803 learned_addr learned my addr 172.21.15.150:0/1227650803 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:21.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f448ea00640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 0x7f449019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.834+0000 7f448f400640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f449010e3c0 0x7f449019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.841 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448ea00640 1 -- 172.21.15.150:0/1227650803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f449010e3c0 msgr2=0x7f449019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448ea00640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f449010e3c0 0x7f449019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448ea00640 1 -- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 msgr2=0x7f449019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448ea00640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448ea00640 1 -- 172.21.15.150:0/1227650803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449019f660 con 0x7f4490074620 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448e000640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f448ea00640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 0x7f449019a6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f448000e9f0 tx=0x7f448000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:21.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f4487400640 1 -- 172.21.15.150:0/1227650803 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448000ccc0 con 0x7f4490074620 2024-09-15T22:11:21.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449019f950 con 0x7f4490074620 2024-09-15T22:11:21.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f4487400640 1 -- 172.21.15.150:0/1227650803 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4480005020 con 0x7f4490074620 2024-09-15T22:11:21.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f4487400640 1 -- 172.21.15.150:0/1227650803 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44800049e0 con 0x7f4490074620 2024-09-15T22:11:21.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.835+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44901a7230 con 0x7f4490074620 2024-09-15T22:11:21.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.838+0000 7f4497ffe740 1 Processor -- start 2024-09-15T22:11:21.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.838+0000 7f4497ffe740 1 -- start start 2024-09-15T22:11:21.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4487400640 1 -- 172.21.15.150:0/1227650803 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4480005560 con 0x7f4490074620 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x56362296d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622977fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x56362297a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4497ffe740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5636228d30b0 con 0x56362296dc50 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4497ffe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56362287aab0 con 0x563622978510 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f4497ffe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5636228cf070 con 0x56362296d330 2024-09-15T22:11:21.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f448ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622977fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f448f400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x56362296d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f448f400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x56362296d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60042/0 (socket says 172.21.15.150:60042) 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f448f400640 1 -- 172.21.15.150:0/1826348757 learned_addr learned my addr 172.21.15.150:0/1826348757 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.839+0000 7f448e000640 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x56362297a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448f400640 1 -- 172.21.15.150:0/1826348757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 msgr2=0x56362297a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448f400640 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x56362297a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448f400640 1 -- 172.21.15.150:0/1826348757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 msgr2=0x563622977fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448f400640 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622977fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448f400640 1 -- 172.21.15.150:0/1826348757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636228874a0 con 0x56362296d330 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448ea00640 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622977fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f448f400640 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x56362296d710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4488009f50 tx=0x7f44880118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e8e7c185ed5442 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f4487400640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f44740a3350 0x7f44740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.840+0000 7f447b400640 1 -- 172.21.15.150:0/1826348757 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488004d20 con 0x56362296d330 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f447b400640 1 -- 172.21.15.150:0/1826348757 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4488004050 con 0x56362296d330 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f447b400640 1 -- 172.21.15.150:0/1826348757 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488005280 con 0x56362296d330 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4487400640 1 -- 172.21.15.150:0/1227650803 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f44800cf9e0 con 0x7f4490074620 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f448ea00640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f44740a3350 0x7f44740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 -- 172.21.15.150:0/1826348757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 msgr2=0x56362296d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x56362296d710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4488009f50 tx=0x7f44880118d0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f448ea00640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f44740a3350 0x7f44740a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f448009bdc0 tx=0x7f44800d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 -- 172.21.15.150:0/1826348757 shutdown_connections 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x56362297a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622977fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1826348757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x56362296d710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.841+0000 7f4497ffe740 1 -- 172.21.15.150:0/1826348757 >> 172.21.15.150:0/1826348757 conn(0x5636229698c0 msgr2=0x563622969ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.842+0000 7f4497ffe740 1 -- 172.21.15.150:0/1826348757 shutdown_connections 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.842+0000 7f4497ffe740 1 -- 172.21.15.150:0/1826348757 wait complete. 2024-09-15T22:11:21.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.842+0000 7f4497ffe740 1 -- start start 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.842+0000 7f4497ffe740 1 Processor -- start 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296d330 0x5636229755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622975b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563622978510 0x563622976050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56362297b060 con 0x56362296dc50 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56362285b920 con 0x56362296d330 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56362297b1e0 con 0x563622978510 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f4497ffe740 10 client.0 _ll_register_callbacks cb 0x56362287f8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296d330 0x5636229755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622975b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296d330 0x5636229755d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55724/0 (socket says 172.21.15.150:55724) 2024-09-15T22:11:21.854 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448f400640 1 -- 172.21.15.150:0/896424593 learned_addr learned my addr 172.21.15.150:0/896424593 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448f400640 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563622978510 0x563622976050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448e000640 1 -- 172.21.15.150:0/896424593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563622978510 msgr2=0x563622976050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448e000640 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563622978510 0x563622976050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448e000640 1 -- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296d330 msgr2=0x5636229755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.843+0000 7f448e000640 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296d330 0x5636229755d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f448e000640 1 -- 172.21.15.150:0/896424593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636226442b0 con 0x56362296dc50 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f448e000640 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622975b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c00 tx=0x7f447c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aea8bde0d60ce7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f446fe00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f446fe00640 1 -- 172.21.15.150:0/896424593 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035040 con 0x56362296dc50 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f446fe00640 1 -- 172.21.15.150:0/896424593 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f447c003cb0 con 0x56362296dc50 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4488004050 con 0x56362296dc50 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f446fe00640 1 -- 172.21.15.150:0/896424593 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f447c005020 con 0x56362296dc50 2024-09-15T22:11:21.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.844+0000 7f4497ffe740 10 client.14913 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563622986dd0 con 0x56362296dc50 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f446fe00640 1 -- 172.21.15.150:0/896424593 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4488004050 con 0x56362296dc50 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f446fe00640 1 -- 172.21.15.150:0/896424593 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f447c0315b0 con 0x56362296dc50 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 10 client.14913 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 10 client.14913 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 20 client.14913 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x563622989370 0x56362298a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 4 client.14913 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.845+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 --> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636228e0620 con 0x563622989370 2024-09-15T22:11:21.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.846+0000 7f448f400640 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x563622989370 0x56362298a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.846+0000 7f448f400640 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x563622989370 0x56362298a7e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc6e05bf64c20a0a server_cookie=12915045ba161ff in_seq=0 out_seq=0 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.846+0000 7f446fe00640 10 client.14913 ms_handle_connect on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f446fe00640 1 -- 172.21.15.150:0/896424593 <== mds.3 v2:172.21.15.154:6834/2752652039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636228e0620 con 0x563622989370 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f446fe00640 10 client.14913 handle_command_reply: tid=0 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 client.14913 shutdown 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 msgr2=0x563622975b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622975b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c00 tx=0x7f447c0035f0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 shutdown_connections 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x563622989370 0x56362298a7e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563622978510 0x563622976050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622975b10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 --2- 172.21.15.150:0/896424593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296d330 0x5636229755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f446fe00640 0 client.14913 ms_handle_reset on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 >> 172.21.15.150:0/896424593 conn(0x5636229698c0 msgr2=0x56362296f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 shutdown_connections 2024-09-15T22:11:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.847+0000 7f4497ffe740 1 -- 172.21.15.150:0/896424593 wait complete. 2024-09-15T22:11:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.848+0000 7f4497ffe740 20 client.14913 trim_cache size 0 max 16384 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 Processor -- start 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 -- start start 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622989a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622969ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x563622975ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x563622988b20 con 0x56362296dc50 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5636229891f0 con 0x563622978510 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f4497ffe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5636229898c0 con 0x56362296d330 2024-09-15T22:11:21.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.866+0000 7f448e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622969ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622969ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39238/0 (socket says 172.21.15.150:39238) 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 -- 172.21.15.150:0/1276565954 learned_addr learned my addr 172.21.15.150:0/1276565954 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448f400640 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622989a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448f400640 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x563622975ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 -- 172.21.15.150:0/1276565954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 msgr2=0x563622989a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622989a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 -- 172.21.15.150:0/1276565954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 msgr2=0x563622975ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x563622975ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 -- 172.21.15.150:0/1276565954 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563622973b60 con 0x56362296dc50 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448f400640 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x563622975ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:21.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f448e000640 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622969ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f447c031980 tx=0x7f447c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e5b46eb7bc0e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:21.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.867+0000 7f447aa00640 1 -- 172.21.15.150:0/1276565954 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035030 con 0x56362296dc50 2024-09-15T22:11:21.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f447aa00640 1 -- 172.21.15.150:0/1276565954 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f447c0051c0 con 0x56362296dc50 2024-09-15T22:11:21.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f447aa00640 1 -- 172.21.15.150:0/1276565954 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c004990 con 0x56362296dc50 2024-09-15T22:11:21.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 -- 172.21.15.150:0/1276565954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 msgr2=0x563622969ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622969ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f447c031980 tx=0x7f447c02a480 comp rx=0 tx=0).stop 2024-09-15T22:11:21.874 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 -- 172.21.15.150:0/1276565954 shutdown_connections 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563622978510 0x563622975ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56362296dc50 0x563622969ca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1276565954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622989a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 -- 172.21.15.150:0/1276565954 >> 172.21.15.150:0/1276565954 conn(0x5636229698c0 msgr2=0x56362296ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 -- 172.21.15.150:0/1276565954 shutdown_connections 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.868+0000 7f4497ffe740 1 -- 172.21.15.150:0/1276565954 wait complete. 2024-09-15T22:11:21.875 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 -- start start 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 Processor -- start 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622992c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 0x5636229931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563622978510 0x56362298d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56362298a660 con 0x563622978510 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563622989f90 con 0x56362296dc50 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56362298ad30 con 0x56362296d330 2024-09-15T22:11:21.876 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.869+0000 7f4497ffe740 10 client.0 _ll_register_callbacks cb 0x7f447c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 0x5636229931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448f400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622992c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 0x5636229931c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55748/0 (socket says 172.21.15.150:55748) 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 -- 172.21.15.150:0/1377181562 learned_addr learned my addr 172.21.15.150:0/1377181562 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448f400640 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563622978510 0x56362298d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 -- 172.21.15.150:0/1377181562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 msgr2=0x563622992c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.877 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622992c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 -- 172.21.15.150:0/1377181562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563622978510 msgr2=0x56362298d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563622978510 0x56362298d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 -- 172.21.15.150:0/1377181562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56362298e180 con 0x56362296dc50 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f448e000640 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 0x5636229931c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f447c031a70 tx=0x7f447c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ae67171b2d5518 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.870+0000 7f446fe00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f446fe00640 1 -- 172.21.15.150:0/1377181562 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c003ab0 con 0x56362296dc50 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f446fe00640 1 -- 172.21.15.150:0/1377181562 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f447c003c50 con 0x56362296dc50 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f447c0051c0 con 0x56362296dc50 2024-09-15T22:11:21.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f446fe00640 1 -- 172.21.15.150:0/1377181562 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f447c003e50 con 0x56362296dc50 2024-09-15T22:11:21.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f4497ffe740 10 client.24950 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:21.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5636229f4500 con 0x56362296dc50 2024-09-15T22:11:21.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f446fe00640 1 -- 172.21.15.150:0/1377181562 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f447c0051c0 con 0x56362296dc50 2024-09-15T22:11:21.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.871+0000 7f446fe00640 1 -- 172.21.15.150:0/1377181562 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f447c051070 con 0x56362296dc50 2024-09-15T22:11:21.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f4497ffe740 10 client.24950 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:21.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f4497ffe740 10 client.24950 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-15T22:11:21.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f4497ffe740 20 client.24950 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:21.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x5636229f8d90 0x5636229f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:21.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f4497ffe740 4 client.24950 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:21.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 --> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] -- command(tid 0: {"prefix": "status"}) -- 0x5636228dab30 con 0x5636229f8d90 2024-09-15T22:11:21.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.872+0000 7f448f400640 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x5636229f8d90 0x5636229f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:21.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f448f400640 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x5636229f8d90 0x5636229f7aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=883f1e252eadfcfe server_cookie=d09d0e0cab9916b in_seq=0 out_seq=0 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f446fe00640 10 client.24950 ms_handle_connect on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f446fe00640 1 -- 172.21.15.150:0/1377181562 <== mds.3 v2:172.21.15.154:6834/2752652039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5636228dab30 con 0x5636229f8d90 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f446fe00640 10 client.24950 handle_command_reply: tid=0 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 client.24950 shutdown 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 msgr2=0x5636229931c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 0x5636229931c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f447c031a70 tx=0x7f447c009260 comp rx=0 tx=0).stop 2024-09-15T22:11:21.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 shutdown_connections 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x5636229f8d90 0x5636229f7aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563622978510 0x56362298d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56362296dc50 0x5636229931c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f446fe00640 0 client.24950 ms_handle_reset on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 --2- 172.21.15.150:0/1377181562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56362296d330 0x563622992c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 >> 172.21.15.150:0/1377181562 conn(0x5636229698c0 msgr2=0x563622968a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:21.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 shutdown_connections 2024-09-15T22:11:21.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 1 -- 172.21.15.150:0/1377181562 wait complete. 2024-09-15T22:11:21.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.873+0000 7f4497ffe740 20 client.24950 trim_cache size 0 max 16384 2024-09-15T22:11:21.884 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:21.884 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 3, 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24512, 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 73.108900402000003, 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 82, 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 117.77762685 2024-09-15T22:11:21.885 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:21.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f44740a3350 msgr2=0x7f44740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f44740a3350 0x7f44740a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f448009bdc0 tx=0x7f44800d5530 comp rx=0 tx=0).stop 2024-09-15T22:11:21.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 msgr2=0x7f449019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:21.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 0x7f449019a6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f448000e9f0 tx=0x7f448000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 shutdown_connections 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f449010e3c0 0x7f449019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f44740a3350 0x7f44740a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4490074f40 0x7f449019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 --2- 172.21.15.150:0/1227650803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4490074620 0x7f449019a6b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 >> 172.21.15.150:0/1227650803 conn(0x7f44900fd8c0 msgr2=0x7f44900fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 shutdown_connections 2024-09-15T22:11:21.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:21.874+0000 7f4495600640 1 -- 172.21.15.150:0/1227650803 wait complete. 2024-09-15T22:11:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:22 smithi154 ceph-mon[34853]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:22 smithi150 ceph-mon[30886]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:22 smithi169 ceph-mon[35850]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:22.717 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:11:23.086 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 -- 172.21.15.150:0/3691670724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20301019c0 msgr2=0x7f2030101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 --2- 172.21.15.150:0/3691670724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20301019c0 0x7f2030101e20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f201c009930 tx=0x7f201c02a440 comp rx=0 tx=0).stop 2024-09-15T22:11:23.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 -- 172.21.15.150:0/3691670724 shutdown_connections 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 --2- 172.21.15.150:0/3691670724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2030102360 0x7f203010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 --2- 172.21.15.150:0/3691670724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20301019c0 0x7f2030101e20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 --2- 172.21.15.150:0/3691670724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20301079c0 0x7f2030107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 -- 172.21.15.150:0/3691670724 >> 172.21.15.150:0/3691670724 conn(0x7f20300fd740 msgr2=0x7f20300ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 -- 172.21.15.150:0/3691670724 shutdown_connections 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.661+0000 7f202f200640 1 -- 172.21.15.150:0/3691670724 wait complete. 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.662+0000 7f202f200640 1 Processor -- start 2024-09-15T22:11:23.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.662+0000 7f202f200640 1 -- start start 2024-09-15T22:11:23.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202f200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20301019c0 0x7f203019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 0x7f203019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202f200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20301079c0 0x7f203019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202f200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2030111e10 con 0x7f2030102360 2024-09-15T22:11:23.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202f200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2030111c90 con 0x7f20301079c0 2024-09-15T22:11:23.667 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202f200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2030111f90 con 0x7f20301019c0 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 0x7f203019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 0x7f203019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39280/0 (socket says 172.21.15.150:39280) 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202d400640 1 -- 172.21.15.150:0/1099322127 learned_addr learned my addr 172.21.15.150:0/1099322127 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202de00640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20301019c0 0x7f203019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.663+0000 7f202e800640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20301079c0 0x7f203019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202d400640 1 -- 172.21.15.150:0/1099322127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20301019c0 msgr2=0x7f203019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202d400640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20301019c0 0x7f203019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202d400640 1 -- 172.21.15.150:0/1099322127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20301079c0 msgr2=0x7f203019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202d400640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20301079c0 0x7f203019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202d400640 1 -- 172.21.15.150:0/1099322127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203019f490 con 0x7f2030102360 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202d400640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 0x7f203019aa20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f201c02a960 tx=0x7f201c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:23.668 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f2026a00640 1 -- 172.21.15.150:0/1099322127 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c03f070 con 0x7f2030102360 2024-09-15T22:11:23.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f2026a00640 1 -- 172.21.15.150:0/1099322127 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f201c031c90 con 0x7f2030102360 2024-09-15T22:11:23.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.664+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203019f720 con 0x7f2030102360 2024-09-15T22:11:23.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.665+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20301a7060 con 0x7f2030102360 2024-09-15T22:11:23.669 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.665+0000 7f2026a00640 1 -- 172.21.15.150:0/1099322127 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c049060 con 0x7f2030102360 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2026a00640 1 -- 172.21.15.150:0/1099322127 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f201c042070 con 0x7f2030102360 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 Processor -- start 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 -- start start 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7a3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55673d6fe0b0 con 0x55673d798e00 2024-09-15T22:11:23.670 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55673d6a5ab0 con 0x55673d7984e0 2024-09-15T22:11:23.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f2037818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55673d6fa070 con 0x55673d7a36c0 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.668+0000 7f202de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7a3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39296/0 (socket says 172.21.15.150:39296) 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202de00640 1 -- 172.21.15.150:0/2291093336 learned_addr learned my addr 172.21.15.150:0/2291093336 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202d400640 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 -- 172.21.15.150:0/2291093336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 msgr2=0x55673d7a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 -- 172.21.15.150:0/2291093336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 msgr2=0x55673d7a3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7a3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 -- 172.21.15.150:0/2291093336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673d6b24a0 con 0x55673d7984e0 2024-09-15T22:11:23.672 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f202e800640 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7988c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2028009f50 tx=0x7f2028003d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e7b12bfca57e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f2026a00640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f20140a32d0 0x7f20140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.669+0000 7f201b000640 1 -- 172.21.15.150:0/2291093336 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028004860 con 0x55673d7984e0 2024-09-15T22:11:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2026a00640 1 -- 172.21.15.150:0/1099322127 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f201c0f05c0 con 0x7f2030102360 2024-09-15T22:11:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f201b000640 1 -- 172.21.15.150:0/2291093336 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2028015030 con 0x55673d7984e0 2024-09-15T22:11:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f201b000640 1 -- 172.21.15.150:0/2291093336 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028010940 con 0x55673d7984e0 2024-09-15T22:11:23.673 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f202de00640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f20140a32d0 0x7f20140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 -- 172.21.15.150:0/2291093336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 msgr2=0x55673d7988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f202de00640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f20140a32d0 0x7f20140a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55673d7958d0 tx=0x7f202000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:23.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7988c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2028009f50 tx=0x7f2028003d40 comp rx=0 tx=0).stop 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 -- 172.21.15.150:0/2291093336 shutdown_connections 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 --2- 172.21.15.150:0/2291093336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7988c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.670+0000 7f2037818740 1 -- 172.21.15.150:0/2291093336 >> 172.21.15.150:0/2291093336 conn(0x55673d794a70 msgr2=0x55673d794e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.671+0000 7f2037818740 1 -- 172.21.15.150:0/2291093336 shutdown_connections 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.671+0000 7f2037818740 1 -- 172.21.15.150:0/2291093336 wait complete. 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.671+0000 7f2037818740 1 -- start start 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.671+0000 7f2037818740 1 Processor -- start 2024-09-15T22:11:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 0x55673d7a0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55673d7a6330 con 0x55673d7984e0 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55673d686920 con 0x55673d798e00 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55673d7a64b0 con 0x55673d7a36c0 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f2037818740 10 client.0 _ll_register_callbacks cb 0x55673d6aa8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 0x55673d7a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 0x55673d7a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39300/0 (socket says 172.21.15.150:39300) 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 -- 172.21.15.150:0/3899750583 learned_addr learned my addr 172.21.15.150:0/3899750583 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202d400640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202e800640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.678 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 -- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 msgr2=0x55673d7a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 -- 172.21.15.150:0/3899750583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 msgr2=0x55673d7a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202de00640 1 -- 172.21.15.150:0/3899750583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673d46f2b0 con 0x55673d7984e0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.672+0000 7f202e800640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f202de00640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 0x55673d7a0630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f202001f670 tx=0x7f2020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244a720515de2cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f200f400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f200f400640 1 -- 172.21.15.150:0/3899750583 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020004020 con 0x55673d7984e0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f200f400640 1 -- 172.21.15.150:0/3899750583 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f2020017030 con 0x55673d7984e0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2028015030 con 0x55673d7984e0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f200f400640 1 -- 172.21.15.150:0/3899750583 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20200041c0 con 0x55673d7984e0 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f2037818740 10 client.14931 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:23.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.673+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55673d7b2110 con 0x55673d7984e0 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f200f400640 1 -- 172.21.15.150:0/3899750583 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2028015030 con 0x55673d7984e0 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f200f400640 1 -- 172.21.15.150:0/3899750583 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2020003990 con 0x55673d7984e0 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f2037818740 10 client.14931 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f2037818740 10 client.14931 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f2037818740 20 client.14931 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f2037818740 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d7b4750 0x55673d7b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f2037818740 4 client.14931 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 --> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55673d70b620 con 0x55673d7b4750 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.674+0000 7f202d400640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d7b4750 0x55673d7b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.675+0000 7f202d400640 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d7b4750 0x55673d7b5bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c77c675e52de5848 server_cookie=3454da750c51bdcc in_seq=0 out_seq=0 2024-09-15T22:11:23.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.675+0000 7f200f400640 10 client.14931 ms_handle_connect on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:23.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f200f400640 1 -- 172.21.15.150:0/3899750583 <== mds.2 v2:172.21.15.169:6838/2442112974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55673d70b620 con 0x55673d7b4750 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f200f400640 10 client.14931 handle_command_reply: tid=0 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 client.14931 shutdown 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 msgr2=0x55673d7a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 0x55673d7a0630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f202001f670 tx=0x7f2020004730 comp rx=0 tx=0).stop 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 shutdown_connections 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d7b4750 0x55673d7b5bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 --2- 172.21.15.150:0/3899750583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7984e0 0x55673d7a0630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f200f400640 0 client.14931 ms_handle_reset on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:23.682 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 >> 172.21.15.150:0/3899750583 conn(0x55673d794a70 msgr2=0x55673d793bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:23.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 shutdown_connections 2024-09-15T22:11:23.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 1 -- 172.21.15.150:0/3899750583 wait complete. 2024-09-15T22:11:23.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.676+0000 7f2037818740 20 client.14931 trim_cache size 0 max 16384 2024-09-15T22:11:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 Processor -- start 2024-09-15T22:11:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 -- start start 2024-09-15T22:11:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7984e0 0x55673d79af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7a36c0 0x55673d7a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55673d7b3f00 con 0x55673d7a36c0 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55673d7b45d0 con 0x55673d798e00 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f2037818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55673d7b4ca0 con 0x55673d7984e0 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.695+0000 7f202e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7a36c0 0x55673d7a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7a36c0 0x55673d7a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39308/0 (socket says 172.21.15.150:39308) 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7984e0 0x55673d79af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202e800640 1 -- 172.21.15.150:0/2607800506 learned_addr learned my addr 172.21.15.150:0/2607800506 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202d400640 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 -- 172.21.15.150:0/2607800506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 msgr2=0x55673d7a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 -- 172.21.15.150:0/2607800506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7a36c0 msgr2=0x55673d7a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7a36c0 0x55673d7a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 -- 172.21.15.150:0/2607800506 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673d798310 con 0x55673d7984e0 2024-09-15T22:11:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f202de00640 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7984e0 0x55673d79af90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2020018040 tx=0x7f202000b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf01a6950ebece5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f201a600640 1 -- 172.21.15.150:0/2607800506 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020036070 con 0x55673d7984e0 2024-09-15T22:11:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f201a600640 1 -- 172.21.15.150:0/2607800506 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2020003ad0 con 0x55673d7984e0 2024-09-15T22:11:23.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.696+0000 7f201a600640 1 -- 172.21.15.150:0/2607800506 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020010aa0 con 0x55673d7984e0 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 -- 172.21.15.150:0/2607800506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7984e0 msgr2=0x55673d79af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7984e0 0x55673d79af90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2020018040 tx=0x7f202000b480 comp rx=0 tx=0).stop 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 -- 172.21.15.150:0/2607800506 shutdown_connections 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d7a36c0 0x55673d7a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d798e00 0x55673d7a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 --2- 172.21.15.150:0/2607800506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7984e0 0x55673d79af90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 -- 172.21.15.150:0/2607800506 >> 172.21.15.150:0/2607800506 conn(0x55673d794a70 msgr2=0x55673d79b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 -- 172.21.15.150:0/2607800506 shutdown_connections 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.697+0000 7f2037818740 1 -- 172.21.15.150:0/2607800506 wait complete. 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 -- start start 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 Processor -- start 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55673d7b5a40 con 0x55673d798e00 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55673d7b5370 con 0x55673d7984e0 2024-09-15T22:11:23.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55673d7b6110 con 0x55673d7a36c0 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.698+0000 7f2037818740 10 client.0 _ll_register_callbacks cb 0x7f202001f500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7b8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39320/0 (socket says 172.21.15.150:39320) 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202d400640 1 -- 172.21.15.150:0/2625128783 learned_addr learned my addr 172.21.15.150:0/2625128783 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202e800640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 -- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 msgr2=0x55673d7bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7bc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 -- 172.21.15.150:0/2625128783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 msgr2=0x55673d7b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 -- 172.21.15.150:0/2625128783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673d7bce20 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202d400640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f202de00640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7b82d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2020005d00 tx=0x7f2020005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32c1039770d75cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.699+0000 7f200f400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f200f400640 1 -- 172.21.15.150:0/2625128783 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202003e070 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f200f400640 1 -- 172.21.15.150:0/2625128783 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f2020010a40 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2020003ad0 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f200f400640 1 -- 172.21.15.150:0/2625128783 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2020036070 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 10 client.24968 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55673d81f660 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f200f400640 1 -- 172.21.15.150:0/2625128783 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2020003ad0 con 0x55673d7984e0 2024-09-15T22:11:23.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f200f400640 1 -- 172.21.15.150:0/2625128783 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2020032aa0 con 0x55673d7984e0 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 10 client.24968 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 10 client.24968 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 20 client.24968 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d823ee0 0x55673d822bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 4 client.24968 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.700+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 --> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] -- command(tid 0: {"prefix": "status"}) -- 0x55673d705b30 con 0x55673d823ee0 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.701+0000 7f202d400640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d823ee0 0x55673d822bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.701+0000 7f202d400640 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d823ee0 0x55673d822bf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1430187872a9147 server_cookie=309931d870cae73b in_seq=0 out_seq=0 2024-09-15T22:11:23.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.701+0000 7f200f400640 10 client.24968 ms_handle_connect on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:23.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f200f400640 1 -- 172.21.15.150:0/2625128783 <== mds.2 v2:172.21.15.169:6838/2442112974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55673d705b30 con 0x55673d823ee0 2024-09-15T22:11:23.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f200f400640 10 client.24968 handle_command_reply: tid=0 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 client.24968 shutdown 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 msgr2=0x55673d7b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7b82d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2020005d00 tx=0x7f2020005b90 comp rx=0 tx=0).stop 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 shutdown_connections 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x55673d823ee0 0x55673d822bf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55673d7a36c0 0x55673d7bc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55673d798e00 0x55673d7b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f200f400640 0 client.24968 ms_handle_reset on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 --2- 172.21.15.150:0/2625128783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55673d7984e0 0x55673d7b82d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 >> 172.21.15.150:0/2625128783 conn(0x55673d794a70 msgr2=0x55673d7ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:23.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 shutdown_connections 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 1 -- 172.21.15.150:0/2625128783 wait complete. 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.702+0000 7f2037818740 20 client.24968 trim_cache size 0 max 16384 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 2, 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24523, 2024-09-15T22:11:23.710 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 75.950176868, 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 82, 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 109.892114494 2024-09-15T22:11:23.711 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:23.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f20140a32d0 msgr2=0x7f20140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f20140a32d0 0x7f20140a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55673d7958d0 tx=0x7f202000b410 comp rx=0 tx=0).stop 2024-09-15T22:11:23.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 msgr2=0x7f203019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:23.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 0x7f203019aa20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f201c02a960 tx=0x7f201c003b90 comp rx=0 tx=0).stop 2024-09-15T22:11:23.712 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 shutdown_connections 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20301079c0 0x7f203019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f20140a32d0 0x7f20140a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2030102360 0x7f203019aa20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 --2- 172.21.15.150:0/1099322127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20301019c0 0x7f203019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 >> 172.21.15.150:0/1099322127 conn(0x7f20300fd740 msgr2=0x7f203010cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 shutdown_connections 2024-09-15T22:11:23.713 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:23.703+0000 7f202f200640 1 -- 172.21.15.150:0/1099322127 wait complete. 2024-09-15T22:11:24.369 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:24 smithi150 ceph-mon[30886]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:24.409 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-15T22:11:24.511 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:24 smithi169 ceph-mon[35850]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:24 smithi154 ceph-mon[34853]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:24.777 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 -- 172.21.15.150:0/3874284047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c106f10 msgr2=0x7fbf5c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 --2- 172.21.15.150:0/3874284047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c106f10 0x7fbf5c10ea90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009ca0 tx=0x7fbf5402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 -- 172.21.15.150:0/3874284047 shutdown_connections 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 --2- 172.21.15.150:0/3874284047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c106f10 0x7fbf5c10ea90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 --2- 172.21.15.150:0/3874284047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c102790 0x7fbf5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 --2- 172.21.15.150:0/3874284047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf5c101de0 0x7fbf5c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.334 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 -- 172.21.15.150:0/3874284047 >> 172.21.15.150:0/3874284047 conn(0x7fbf5c0fd8c0 msgr2=0x7fbf5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:25.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 -- 172.21.15.150:0/3874284047 shutdown_connections 2024-09-15T22:11:25.335 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.332+0000 7fbf64000640 1 -- 172.21.15.150:0/3874284047 wait complete. 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 Processor -- start 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 -- start start 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf5c101de0 0x7fbf5c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 0x7fbf5c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c106f10 0x7fbf5c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c111fc0 con 0x7fbf5c102790 2024-09-15T22:11:25.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c111e40 con 0x7fbf5c106f10 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf64000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c112140 con 0x7fbf5c101de0 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf60c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 0x7fbf5c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.333+0000 7fbf60c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 0x7fbf5c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39348/0 (socket says 172.21.15.150:39348) 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 -- 172.21.15.150:0/637488504 learned_addr learned my addr 172.21.15.150:0/637488504 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf62000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c106f10 0x7fbf5c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf61600640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf5c101de0 0x7fbf5c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 -- 172.21.15.150:0/637488504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf5c101de0 msgr2=0x7fbf5c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf5c101de0 0x7fbf5c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 -- 172.21.15.150:0/637488504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c106f10 msgr2=0x7fbf5c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c106f10 0x7fbf5c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 -- 172.21.15.150:0/637488504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c19d3f0 con 0x7fbf5c102790 2024-09-15T22:11:25.337 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf60c00640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 0x7fbf5c198980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800e9f0 tx=0x7fbf4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:25.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.334+0000 7fbf5a000640 1 -- 172.21.15.150:0/637488504 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800cd80 con 0x7fbf5c102790 2024-09-15T22:11:25.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.335+0000 7fbf5a000640 1 -- 172.21.15.150:0/637488504 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf48010910 con 0x7fbf5c102790 2024-09-15T22:11:25.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.335+0000 7fbf5a000640 1 -- 172.21.15.150:0/637488504 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48018990 con 0x7fbf5c102790 2024-09-15T22:11:25.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.335+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c19d6e0 con 0x7fbf5c102790 2024-09-15T22:11:25.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.335+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c1a4fc0 con 0x7fbf5c102790 2024-09-15T22:11:25.340 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 Processor -- start 2024-09-15T22:11:25.341 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 -- start start 2024-09-15T22:11:25.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fccbb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf5a000640 1 -- 172.21.15.150:0/637488504 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbf48010ac0 con 0x7fbf5c102790 2024-09-15T22:11:25.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccc6510 0x5628fccc8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.342 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5628fcc210b0 con 0x5628fccbb330 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628fcbc8ab0 con 0x5628fccc6510 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf66c48740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5628fcc1d070 con 0x5628fccbbc50 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.339+0000 7fbf62000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fccbb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fccbb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39360/0 (socket says 172.21.15.150:39360) 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 -- 172.21.15.150:0/71563075 learned_addr learned my addr 172.21.15.150:0/71563075 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf60c00640 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccc6510 0x5628fccc8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf61600640 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 -- 172.21.15.150:0/71563075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 msgr2=0x5628fccc5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 -- 172.21.15.150:0/71563075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccc6510 msgr2=0x5628fccc8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccc6510 0x5628fccc8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 -- 172.21.15.150:0/71563075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fcbd54a0 con 0x5628fccbb330 2024-09-15T22:11:25.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.340+0000 7fbf62000640 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fccbb710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009ca0 tx=0x7fbf540093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b7c394983a5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf4e600640 1 -- 172.21.15.150:0/71563075 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54031db0 con 0x5628fccbb330 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf4e600640 1 -- 172.21.15.150:0/71563075 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54036030 con 0x5628fccbb330 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf4e600640 1 -- 172.21.15.150:0/71563075 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54004330 con 0x5628fccbb330 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf5a000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbf440a32d0 0x7fbf440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf66c48740 1 -- 172.21.15.150:0/71563075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 msgr2=0x5628fccbb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf66c48740 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fccbb710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009ca0 tx=0x7fbf540093e0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.341+0000 7fbf5a000640 1 -- 172.21.15.150:0/637488504 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fbf480cfd10 con 0x7fbf5c102790 2024-09-15T22:11:25.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 -- 172.21.15.150:0/71563075 shutdown_connections 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccc6510 0x5628fccc8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 --2- 172.21.15.150:0/71563075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fccbb710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 -- 172.21.15.150:0/71563075 >> 172.21.15.150:0/71563075 conn(0x5628fccb78c0 msgr2=0x5628fccb7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf61600640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbf440a32d0 0x7fbf440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 -- 172.21.15.150:0/71563075 shutdown_connections 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 -- 172.21.15.150:0/71563075 wait complete. 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf61600640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbf440a32d0 0x7fbf440a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5628fccb8720 tx=0x7fbf50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.342+0000 7fbf66c48740 1 -- start start 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 Processor -- start 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccc3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5628fccc9000 con 0x5628fccc6510 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628fcba9920 con 0x5628fccbb330 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5628fccc9180 con 0x5628fccbbc50 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf66c48740 10 client.0 _ll_register_callbacks cb 0x5628fcbcd8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf60c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf61600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccc3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf60c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60140/0 (socket says 172.21.15.150:60140) 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf61600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccc3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55852/0 (socket says 172.21.15.150:55852) 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf60c00640 1 -- 172.21.15.150:0/3788521553 learned_addr learned my addr 172.21.15.150:0/3788521553 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.343+0000 7fbf62000640 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf60c00640 1 -- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 msgr2=0x5628fccc3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf60c00640 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccc3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf60c00640 1 -- 172.21.15.150:0/3788521553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 msgr2=0x5628fccc3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf60c00640 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf60c00640 1 -- 172.21.15.150:0/3788521553 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fc9922b0 con 0x5628fccbbc50 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf60c00640 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc39d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf48000c00 tx=0x7fbf480d3450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41886831bec0bca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf42a00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf42a00640 1 -- 172.21.15.150:0/3788521553 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4809bbd0 con 0x5628fccbbc50 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf54036030 con 0x5628fccbbc50 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.344+0000 7fbf42a00640 1 -- 172.21.15.150:0/3788521553 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fbf480cd900 con 0x5628fccbbc50 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf42a00640 1 -- 172.21.15.150:0/3788521553 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf4809c270 con 0x5628fccbbc50 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 10 client.24952 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628fccd9080 con 0x5628fccbbc50 2024-09-15T22:11:25.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf42a00640 1 -- 172.21.15.150:0/3788521553 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54036030 con 0x5628fccbbc50 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf42a00640 1 -- 172.21.15.150:0/3788521553 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbf480bc140 con 0x5628fccbbc50 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 10 client.24952 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 10 client.24952 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 20 client.24952 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fccdb5c0 0x5628fccdca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 4 client.24952 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:25.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.345+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 --> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628fcc2e620 con 0x5628fccdb5c0 2024-09-15T22:11:25.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.346+0000 7fbf61600640 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fccdb5c0 0x5628fccdca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.346+0000 7fbf61600640 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fccdb5c0 0x5628fccdca30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aefa301c1af2fcc4 server_cookie=e35aea6bbe4080eb in_seq=0 out_seq=0 2024-09-15T22:11:25.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.346+0000 7fbf42a00640 10 client.24952 ms_handle_connect on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:25.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf42a00640 1 -- 172.21.15.150:0/3788521553 <== mds.1 v2:172.21.15.154:6836/1010193359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628fcc2e620 con 0x5628fccdb5c0 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf42a00640 10 client.24952 handle_command_reply: tid=0 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 client.24952 shutdown 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 msgr2=0x5628fccc39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc39d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf48000c00 tx=0x7fbf480d3450 comp rx=0 tx=0).stop 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 shutdown_connections 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fccdb5c0 0x5628fccdca30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc39d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 --2- 172.21.15.150:0/3788521553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccc3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf42a00640 0 client.24952 ms_handle_reset on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 >> 172.21.15.150:0/3788521553 conn(0x5628fccb78c0 msgr2=0x5628fccbd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 shutdown_connections 2024-09-15T22:11:25.353 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.347+0000 7fbf66c48740 1 -- 172.21.15.150:0/3788521553 wait complete. 2024-09-15T22:11:25.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.348+0000 7fbf66c48740 20 client.24952 trim_cache size 0 max 16384 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 Processor -- start 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 -- start start 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccdc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5628fccdad70 con 0x5628fccc6510 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628fccdb440 con 0x5628fccbb330 2024-09-15T22:11:25.368 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf66c48740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5628fccdbb10 con 0x5628fccbbc50 2024-09-15T22:11:25.369 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf62000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf62000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39366/0 (socket says 172.21.15.150:39366) 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf62000640 1 -- 172.21.15.150:0/1305041924 learned_addr learned my addr 172.21.15.150:0/1305041924 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf60c00640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.366+0000 7fbf61600640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccdc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf62000640 1 -- 172.21.15.150:0/1305041924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 msgr2=0x5628fccc1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf62000640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf62000640 1 -- 172.21.15.150:0/1305041924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 msgr2=0x5628fccdc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf62000640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccdc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.370 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf62000640 1 -- 172.21.15.150:0/1305041924 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628fccbb160 con 0x5628fccc6510 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf60c00640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf61600640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccdc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf62000640 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc22a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbf540319f0 tx=0x7fbf54031ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaa4c1b3a2f312d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf4dc00640 1 -- 172.21.15.150:0/1305041924 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54055070 con 0x5628fccc6510 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf4dc00640 1 -- 172.21.15.150:0/1305041924 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54036040 con 0x5628fccc6510 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.367+0000 7fbf4dc00640 1 -- 172.21.15.150:0/1305041924 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5404a040 con 0x5628fccc6510 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 -- 172.21.15.150:0/1305041924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 msgr2=0x5628fccc22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc22a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbf540319f0 tx=0x7fbf54031ac0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 -- 172.21.15.150:0/1305041924 shutdown_connections 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccc6510 0x5628fccc22a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccbbc50 0x5628fccc1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 --2- 172.21.15.150:0/1305041924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbb330 0x5628fccdc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 -- 172.21.15.150:0/1305041924 >> 172.21.15.150:0/1305041924 conn(0x5628fccb78c0 msgr2=0x5628fccb7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:25.371 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 -- 172.21.15.150:0/1305041924 shutdown_connections 2024-09-15T22:11:25.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.368+0000 7fbf66c48740 1 -- 172.21.15.150:0/1305041924 wait complete. 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 -- start start 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 Processor -- start 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fcce5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbbc50 0x5628fccde750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccc6510 0x5628fccdec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5628fccdc8b0 con 0x5628fccbb330 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628fccdc1e0 con 0x5628fccbbc50 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5628fccdcf80 con 0x5628fccc6510 2024-09-15T22:11:25.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.369+0000 7fbf66c48740 10 client.0 _ll_register_callbacks cb 0x7fbf4800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf61600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fcce5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf61600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fcce5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39372/0 (socket says 172.21.15.150:39372) 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf61600640 1 -- 172.21.15.150:0/2422289050 learned_addr learned my addr 172.21.15.150:0/2422289050 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf62000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccc6510 0x5628fccdec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbbc50 0x5628fccde750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 -- 172.21.15.150:0/2422289050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccc6510 msgr2=0x5628fccdec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccc6510 0x5628fccdec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 -- 172.21.15.150:0/2422289050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 msgr2=0x5628fcce5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fcce5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 -- 172.21.15.150:0/2422289050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628fccdf4c0 con 0x5628fccbbc50 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf61600640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fcce5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf60c00640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbbc50 0x5628fccde750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5628fccc4ad0 tx=0x7fbf480d33e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9216b80adac13593 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:25.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.370+0000 7fbf42a00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf42a00640 1 -- 172.21.15.150:0/2422289050 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4809bbd0 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf42a00640 1 -- 172.21.15.150:0/2422289050 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fbf480bc0b0 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf54036040 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf42a00640 1 -- 172.21.15.150:0/2422289050 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf4809c040 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 10 client.24986 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628fcd45d30 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf42a00640 1 -- 172.21.15.150:0/2422289050 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54036040 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf42a00640 1 -- 172.21.15.150:0/2422289050 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbf4809b6c0 con 0x5628fccbbc50 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 10 client.24986 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 10 client.24986 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 20 client.24986 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:25.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fcd4a8e0 0x5628fcd495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 4 client.24986 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.371+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 --> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] -- command(tid 0: {"prefix": "status"}) -- 0x5628fcc28b30 con 0x5628fcd4a8e0 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf61600640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fcd4a8e0 0x5628fcd495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf61600640 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fcd4a8e0 0x5628fcd495f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6fa3d00718fac86 server_cookie=3026149c678ebf6d in_seq=0 out_seq=0 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf42a00640 10 client.24986 ms_handle_connect on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf42a00640 1 -- 172.21.15.150:0/2422289050 <== mds.1 v2:172.21.15.154:6836/1010193359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5628fcc28b30 con 0x5628fcd4a8e0 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf42a00640 10 client.24986 handle_command_reply: tid=0 2024-09-15T22:11:25.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf66c48740 1 client.24986 shutdown 2024-09-15T22:11:25.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbbc50 msgr2=0x5628fccde750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.372+0000 7fbf66c48740 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbbc50 0x5628fccde750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5628fccc4ad0 tx=0x7fbf480d33e0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 shutdown_connections 2024-09-15T22:11:25.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x5628fcd4a8e0 0x5628fcd495f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5628fccc6510 0x5628fccdec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628fccbbc50 0x5628fccde750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 --2- 172.21.15.150:0/2422289050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628fccbb330 0x5628fcce5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 >> 172.21.15.150:0/2422289050 conn(0x5628fccb78c0 msgr2=0x5628fccc1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf42a00640 0 client.24986 ms_handle_reset on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 shutdown_connections 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 1 -- 172.21.15.150:0/2422289050 wait complete. 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf66c48740 20 client.24986 trim_cache size 0 max 16384 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:25.379 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 1, 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24539, 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 78.635278486000004, 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 82, 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 113.957442735 2024-09-15T22:11:25.380 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbf440a32d0 msgr2=0x7fbf440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf64000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbf440a32d0 0x7fbf440a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5628fccb8720 tx=0x7fbf50005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 msgr2=0x7fbf5c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.373+0000 7fbf64000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 0x7fbf5c198980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800e9f0 tx=0x7fbf4800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 shutdown_connections 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf5c106f10 0x7fbf5c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fbf440a32d0 0x7fbf440a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf5c102790 0x7fbf5c198980 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 --2- 172.21.15.150:0/637488504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf5c101de0 0x7fbf5c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:25.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 >> 172.21.15.150:0/637488504 conn(0x7fbf5c0fd8c0 msgr2=0x7fbf5c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:25.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 shutdown_connections 2024-09-15T22:11:25.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:25.374+0000 7fbf64000640 1 -- 172.21.15.150:0/637488504 wait complete. 2024-09-15T22:11:26.147 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:11:26.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:26 smithi150 ceph-mon[30886]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:26.516 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:26 smithi154 ceph-mon[34853]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:26 smithi169 ceph-mon[35850]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:27.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 -- 172.21.15.150:0/1693769981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90181049a0 msgr2=0x7f90181089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 --2- 172.21.15.150:0/1693769981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90181049a0 0x7f90181089f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9004009900 tx=0x7f900402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.062 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 -- 172.21.15.150:0/1693769981 shutdown_connections 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 --2- 172.21.15.150:0/1693769981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9018109120 0x7f9018110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 --2- 172.21.15.150:0/1693769981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90181049a0 0x7f90181089f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 --2- 172.21.15.150:0/1693769981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018103ff0 0x7f90181043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 -- 172.21.15.150:0/1693769981 >> 172.21.15.150:0/1693769981 conn(0x7f90180ffa90 msgr2=0x7f9018101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 -- 172.21.15.150:0/1693769981 shutdown_connections 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.055+0000 7f9020600640 1 -- 172.21.15.150:0/1693769981 wait complete. 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.056+0000 7f9020600640 1 Processor -- start 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.056+0000 7f9020600640 1 -- start start 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f9020600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 0x7f901819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f9020600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90181049a0 0x7f901819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.063 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f9020600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9018109120 0x7f901819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f9020600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9018114170 con 0x7f9018103ff0 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f9020600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9018113ff0 con 0x7f90181049a0 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f9020600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90181142f0 con 0x7f9018109120 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 0x7f901819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 0x7f901819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39394/0 (socket says 172.21.15.150:39394) 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 -- 172.21.15.150:0/4141514675 learned_addr learned my addr 172.21.15.150:0/4141514675 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901d200640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90181049a0 0x7f901819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901e600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9018109120 0x7f901819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 -- 172.21.15.150:0/4141514675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9018109120 msgr2=0x7f901819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9018109120 0x7f901819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 -- 172.21.15.150:0/4141514675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90181049a0 msgr2=0x7f901819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90181049a0 0x7f901819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901dc00640 1 -- 172.21.15.150:0/4141514675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901819f5e0 con 0x7f9018103ff0 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.057+0000 7f901d200640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90181049a0 0x7f901819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.058+0000 7f901dc00640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 0x7f901819a630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f900c00ea60 tx=0x7f900c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.058+0000 7f9016000640 1 -- 172.21.15.150:0/4141514675 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c00cde0 con 0x7f9018103ff0 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.058+0000 7f9016000640 1 -- 172.21.15.150:0/4141514675 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f900c0035f0 con 0x7f9018103ff0 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.058+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901819f8d0 con 0x7f9018103ff0 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.058+0000 7f9016000640 1 -- 172.21.15.150:0/4141514675 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c010670 con 0x7f9018103ff0 2024-09-15T22:11:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.058+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90181a71b0 con 0x7f9018103ff0 2024-09-15T22:11:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.061+0000 7f902301b740 1 Processor -- start 2024-09-15T22:11:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.061+0000 7f9016000640 1 -- 172.21.15.150:0/4141514675 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f900c0037a0 con 0x7f9018103ff0 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.061+0000 7f902301b740 1 -- start start 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.061+0000 7f902301b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.061+0000 7f902301b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f902301b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f902301b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8130b0 con 0x55d72e8b8510 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f902301b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d72e7baab0 con 0x55d72e8ad330 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f902301b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d72e80f070 con 0x55d72e8adc50 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901dc00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55896/0 (socket says 172.21.15.150:55896) 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8ba900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39402/0 (socket says 172.21.15.150:39402) 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 -- 172.21.15.150:0/3079786359 learned_addr learned my addr 172.21.15.150:0/3079786359 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 -- 172.21.15.150:0/3079786359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 msgr2=0x55d72e8b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 -- 172.21.15.150:0/3079786359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 msgr2=0x55d72e8ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8ba900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.062+0000 7f901e600640 1 -- 172.21.15.150:0/3079786359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72e7c74a0 con 0x55d72e8ad330 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f9016000640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f90000a3350 0x7f90000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f901e600640 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8ad710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9010009f50 tx=0x7f90100118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7556cef9d70382df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f9016000640 1 -- 172.21.15.150:0/4141514675 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f900c0cfe50 con 0x7f9018103ff0 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f900aa00640 1 -- 172.21.15.150:0/3079786359 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010004d20 con 0x55d72e8ad330 2024-09-15T22:11:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f900aa00640 1 -- 172.21.15.150:0/3079786359 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9010004050 con 0x55d72e8ad330 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f901dc00640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f90000a3350 0x7f90000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.063+0000 7f900aa00640 1 -- 172.21.15.150:0/3079786359 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010005220 con 0x55d72e8ad330 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 -- 172.21.15.150:0/3079786359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 msgr2=0x55d72e8ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f901dc00640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f90000a3350 0x7f90000a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f900c0cd7c0 tx=0x7f900c0d3900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8ad710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9010009f50 tx=0x7f90100118d0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 -- 172.21.15.150:0/3079786359 shutdown_connections 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 --2- 172.21.15.150:0/3079786359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8ad710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 -- 172.21.15.150:0/3079786359 >> 172.21.15.150:0/3079786359 conn(0x55d72e8a98c0 msgr2=0x55d72e8a9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 -- 172.21.15.150:0/3079786359 shutdown_connections 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 -- 172.21.15.150:0/3079786359 wait complete. 2024-09-15T22:11:27.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.064+0000 7f902301b740 1 -- start start 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 Processor -- start 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8bb060 con 0x55d72e8b8510 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d72e79b920 con 0x55d72e8ad330 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8bb1e0 con 0x55d72e8adc50 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.065+0000 7f902301b740 10 client.0 _ll_register_callbacks cb 0x55d72e7bf8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901e600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901e600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55906/0 (socket says 172.21.15.150:55906) 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901e600640 1 -- 172.21.15.150:0/2231709447 learned_addr learned my addr 172.21.15.150:0/2231709447 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901e600640 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 -- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 msgr2=0x55d72e8b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 -- 172.21.15.150:0/2231709447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 msgr2=0x55d72e8b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 -- 172.21.15.150:0/2231709447 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d72e5842b0 con 0x55d72e8adc50 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f901d200640 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b5ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f900402a9e0 tx=0x7f9004005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefde445a137a5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.066+0000 7f8fff400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f8fff400640 1 -- 172.21.15.150:0/2231709447 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004035040 con 0x55d72e8adc50 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9010004050 con 0x55d72e8adc50 2024-09-15T22:11:27.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f8fff400640 1 -- 172.21.15.150:0/2231709447 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f90040046c0 con 0x55d72e8adc50 2024-09-15T22:11:27.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f8fff400640 1 -- 172.21.15.150:0/2231709447 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f90040048c0 con 0x55d72e8adc50 2024-09-15T22:11:27.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f902301b740 10 client.24970 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:27.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d72e8c6e00 con 0x55d72e8adc50 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.067+0000 7f8fff400640 1 -- 172.21.15.150:0/2231709447 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9010004050 con 0x55d72e8adc50 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f8fff400640 1 -- 172.21.15.150:0/2231709447 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9004003b90 con 0x55d72e8adc50 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f902301b740 10 client.24970 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f902301b740 10 client.24970 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f902301b740 20 client.24970 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f902301b740 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e8c93c0 0x55d72e8ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f902301b740 4 client.24970 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d72e820620 con 0x55d72e8c93c0 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.068+0000 7f901e600640 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e8c93c0 0x55d72e8ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.069+0000 7f901e600640 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e8c93c0 0x55d72e8ca830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b48c7922163fb server_cookie=be05ebb17554c5ea in_seq=0 out_seq=0 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.069+0000 7f8fff400640 10 client.24970 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:27.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f8fff400640 1 -- 172.21.15.150:0/2231709447 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d72e820620 con 0x55d72e8c93c0 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f8fff400640 10 client.24970 handle_command_reply: tid=0 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 client.24970 shutdown 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 msgr2=0x55d72e8b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b5ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f900402a9e0 tx=0x7f9004005270 comp rx=0 tx=0).stop 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 shutdown_connections 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e8c93c0 0x55d72e8ca830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8b8510 0x55d72e8b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8b5ae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 --2- 172.21.15.150:0/2231709447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8ad330 0x55d72e8b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f8fff400640 0 client.24970 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 >> 172.21.15.150:0/2231709447 conn(0x55d72e8a98c0 msgr2=0x55d72e8af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:27.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 shutdown_connections 2024-09-15T22:11:27.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 1 -- 172.21.15.150:0/2231709447 wait complete. 2024-09-15T22:11:27.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.070+0000 7f902301b740 20 client.24970 trim_cache size 0 max 16384 2024-09-15T22:11:27.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.088+0000 7f902301b740 1 Processor -- start 2024-09-15T22:11:27.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.088+0000 7f902301b740 1 -- start start 2024-09-15T22:11:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f902301b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8ad330 0x55d72e8c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f902301b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 0x55d72e8b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f902301b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f902301b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8c8b70 con 0x55d72e8adc50 2024-09-15T22:11:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f902301b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8c9240 con 0x55d72e8b8510 2024-09-15T22:11:27.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f902301b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8c9910 con 0x55d72e8ad330 2024-09-15T22:11:27.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f901d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 0x55d72e8b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f901d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 0x55d72e8b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39408/0 (socket says 172.21.15.150:39408) 2024-09-15T22:11:27.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f901d200640 1 -- 172.21.15.150:0/633989184 learned_addr learned my addr 172.21.15.150:0/633989184 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:27.092 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f901e600640 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8ad330 0x55d72e8c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f901e600640 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.089+0000 7f901d200640 1 -- 172.21.15.150:0/633989184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8ad330 msgr2=0x55d72e8c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f901d200640 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8ad330 0x55d72e8c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f901d200640 1 -- 172.21.15.150:0/633989184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 msgr2=0x55d72e8af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f901d200640 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f901d200640 1 -- 172.21.15.150:0/633989184 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72e8ad160 con 0x55d72e8adc50 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f901e600640 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f901d200640 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 0x55d72e8b0970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9004006010 tx=0x7f900402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5cd7a88932951f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f900a000640 1 -- 172.21.15.150:0/633989184 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004035070 con 0x55d72e8adc50 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f900a000640 1 -- 172.21.15.150:0/633989184 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9004040070 con 0x55d72e8adc50 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.090+0000 7f900a000640 1 -- 172.21.15.150:0/633989184 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004003850 con 0x55d72e8adc50 2024-09-15T22:11:27.093 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 -- 172.21.15.150:0/633989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 msgr2=0x55d72e8b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 0x55d72e8b0970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9004006010 tx=0x7f900402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 -- 172.21.15.150:0/633989184 shutdown_connections 2024-09-15T22:11:27.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8adc50 0x55d72e8b0970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 --2- 172.21.15.150:0/633989184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8ad330 0x55d72e8c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 -- 172.21.15.150:0/633989184 >> 172.21.15.150:0/633989184 conn(0x55d72e8a98c0 msgr2=0x55d72e8aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 -- 172.21.15.150:0/633989184 shutdown_connections 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 -- 172.21.15.150:0/633989184 wait complete. 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.091+0000 7f902301b740 1 -- start start 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 Processor -- start 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8ad330 0x55d72e8d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8ca6b0 con 0x55d72e8ad330 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8c9fe0 con 0x55d72e8b8510 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d72e8cad80 con 0x55d72e8adc50 2024-09-15T22:11:27.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f902301b740 10 client.0 _ll_register_callbacks cb 0x7f90040044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f901e600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8ad330 0x55d72e8d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f901e600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8ad330 0x55d72e8d2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39418/0 (socket says 172.21.15.150:39418) 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f901e600640 1 -- 172.21.15.150:0/2385541390 learned_addr learned my addr 172.21.15.150:0/2385541390 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.092+0000 7f901d200640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901e600640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901d200640 1 -- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 msgr2=0x55d72e8cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901d200640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901d200640 1 -- 172.21.15.150:0/2385541390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8ad330 msgr2=0x55d72e8d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901d200640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8ad330 0x55d72e8d2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901d200640 1 -- 172.21.15.150:0/2385541390 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d72e8ce360 con 0x55d72e8adc50 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f901d200640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8d32b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90040316a0 tx=0x7f90040319d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbd2e6e9372309d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f8fff400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:11:27.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f8fff400640 1 -- 172.21.15.150:0/2385541390 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004035040 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f8fff400640 1 -- 172.21.15.150:0/2385541390 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f90040055f0 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.093+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9004040070 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f8fff400640 1 -- 172.21.15.150:0/2385541390 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9004069050 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f902301b740 10 client.24976 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d72e934690 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f8fff400640 1 -- 172.21.15.150:0/2385541390 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9004040070 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f8fff400640 1 -- 172.21.15.150:0/2385541390 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f90040654c0 con 0x55d72e8adc50 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f902301b740 10 client.24976 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f902301b740 10 client.24976 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.094+0000 7f902301b740 20 client.24976 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:27.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.095+0000 7f902301b740 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e938e40 0x55d72e937b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:27.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.095+0000 7f902301b740 4 client.24976 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:27.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.095+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "status"}) -- 0x55d72e81ab30 con 0x55d72e938e40 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.095+0000 7f901e600640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e938e40 0x55d72e937b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.095+0000 7f901e600640 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e938e40 0x55d72e937b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47cbfd77a3acbb49 server_cookie=737ae492447ec88c in_seq=0 out_seq=0 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.095+0000 7f8fff400640 10 client.24976 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f8fff400640 1 -- 172.21.15.150:0/2385541390 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d72e81ab30 con 0x55d72e938e40 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f8fff400640 10 client.24976 handle_command_reply: tid=0 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 client.24976 shutdown 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 msgr2=0x55d72e8d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.101 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8d32b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90040316a0 tx=0x7f90040319d0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 shutdown_connections 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d72e938e40 0x55d72e937b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d72e8b8510 0x55d72e8cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d72e8adc50 0x55d72e8d32b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 --2- 172.21.15.150:0/2385541390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d72e8ad330 0x55d72e8d2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f8fff400640 0 client.24976 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 >> 172.21.15.150:0/2385541390 conn(0x55d72e8a98c0 msgr2=0x55d72e8a8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 shutdown_connections 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 1 -- 172.21.15.150:0/2385541390 wait complete. 2024-09-15T22:11:27.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.096+0000 7f902301b740 20 client.24976 trim_cache size 0 max 16384 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24578, 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 88.413369798999994, 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 82, 2024-09-15T22:11:27.103 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:27.104 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 103.07794592099999 2024-09-15T22:11:27.104 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:27.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f90000a3350 msgr2=0x7f90000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f90000a3350 0x7f90000a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f900c0cd7c0 tx=0x7f900c0d3900 comp rx=0 tx=0).stop 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 msgr2=0x7f901819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 0x7f901819a630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f900c00ea60 tx=0x7f900c00ef20 comp rx=0 tx=0).stop 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 shutdown_connections 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9018109120 0x7f901819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90181049a0 0x7f901819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f90000a3350 0x7f90000a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 --2- 172.21.15.150:0/4141514675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9018103ff0 0x7f901819a630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 >> 172.21.15.150:0/4141514675 conn(0x7f90180ffa90 msgr2=0x7f9018100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 shutdown_connections 2024-09-15T22:11:27.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:27.097+0000 7f9020600640 1 -- 172.21.15.150:0/4141514675 wait complete. 2024-09-15T22:11:27.774 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T22:11:27.774 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:11:27.784 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:11:27.784 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T22:11:28.154 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:28.449 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:28 smithi150 ceph-mon[30886]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:28 smithi154 ceph-mon[34853]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:28.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.680+0000 7fa003200640 1 -- 172.21.15.150:0/1426419802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 msgr2=0x7f9ffc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:28.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.680+0000 7fa003200640 1 --2- 172.21.15.150:0/1426419802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc102000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009900 tx=0x7f9fec02a410 comp rx=0 tx=0).stop 2024-09-15T22:11:28.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 -- 172.21.15.150:0/1426419802 shutdown_connections 2024-09-15T22:11:28.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 --2- 172.21.15.150:0/1426419802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc1037c0 0x7f9ffc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.683 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 --2- 172.21.15.150:0/1426419802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ffc102e00 0x7f9ffc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 --2- 172.21.15.150:0/1426419802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc102000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 -- 172.21.15.150:0/1426419802 >> 172.21.15.150:0/1426419802 conn(0x7f9ffc0fd390 msgr2=0x7f9ffc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:28.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 -- 172.21.15.150:0/1426419802 shutdown_connections 2024-09-15T22:11:28.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 -- 172.21.15.150:0/1426419802 wait complete. 2024-09-15T22:11:28.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.681+0000 7fa003200640 1 Processor -- start 2024-09-15T22:11:28.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 -- start start 2024-09-15T22:11:28.685 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc102e00 0x7f9ffc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ffc1037c0 0x7f9ffc1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc10d8d0 con 0x7f9ffc101c00 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc10d750 con 0x7f9ffc102e00 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa003200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc10da50 con 0x7f9ffc1037c0 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7f9ffbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7f9ffbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39428/0 (socket says 172.21.15.150:39428) 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7f9ffbe00640 1 -- 172.21.15.150:0/665816257 learned_addr learned my addr 172.21.15.150:0/665816257 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7fa001200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ffc1037c0 0x7f9ffc1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:28.686 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.682+0000 7f9ffb400640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc102e00 0x7f9ffc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ffbe00640 1 -- 172.21.15.150:0/665816257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ffc1037c0 msgr2=0x7f9ffc1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ffbe00640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ffc1037c0 0x7f9ffc1a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ffbe00640 1 -- 172.21.15.150:0/665816257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc102e00 msgr2=0x7f9ffc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ffbe00640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc102e00 0x7f9ffc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ffbe00640 1 -- 172.21.15.150:0/665816257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1a1d90 con 0x7f9ffc101c00 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ffbe00640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc19a160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fec031440 tx=0x7f9fec032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec03f030 con 0x7f9ffc101c00 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fec003ce0 con 0x7f9ffc101c00 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec035070 con 0x7f9ffc101c00 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.683+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc1a2020 con 0x7f9ffc101c00 2024-09-15T22:11:28.687 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.684+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc1a24b0 con 0x7f9ffc101c00 2024-09-15T22:11:28.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.685+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc1a2710 con 0x7f9ffc101c00 2024-09-15T22:11:28.688 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.686+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9fec042030 con 0x7f9ffc101c00 2024-09-15T22:11:28.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.688+0000 7f9ff8c00640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9fe00a3380 0x7f9fe00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:28.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.689+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f9fec0efe90 con 0x7f9ffc101c00 2024-09-15T22:11:28.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.689+0000 7f9ffb400640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9fe00a3380 0x7f9fe00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:28.691 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.689+0000 7f9ffb400640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9fe00a3380 0x7f9fe00a5840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc19b680 tx=0x7f9fe8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:28.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.692+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fec0bc390 con 0x7f9ffc101c00 2024-09-15T22:11:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:28 smithi169 ceph-mon[35850]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:28.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.881+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9ffc109d10 con 0x7f9fe00a3380 2024-09-15T22:11:28.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.882+0000 7f9ff8c00640 1 -- 172.21.15.150:0/665816257 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9ffc109d10 con 0x7f9fe00a3380 2024-09-15T22:11:28.884 INFO:teuthology.orchestra.run.smithi150.stdout:Backend: cephadm 2024-09-15T22:11:28.884 INFO:teuthology.orchestra.run.smithi150.stdout:Available: Yes 2024-09-15T22:11:28.884 INFO:teuthology.orchestra.run.smithi150.stdout:Paused: No 2024-09-15T22:11:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.884+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9fe00a3380 msgr2=0x7f9fe00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.884+0000 7fa003200640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9fe00a3380 0x7f9fe00a5840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc19b680 tx=0x7f9fe8005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:28.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.884+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 msgr2=0x7f9ffc19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.884+0000 7fa003200640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc19a160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fec031440 tx=0x7f9fec032ce0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 shutdown_connections 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ffc1037c0 0x7f9ffc1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc102e00 0x7f9ffc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f9fe00a3380 0x7f9fe00a5840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 --2- 172.21.15.150:0/665816257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ffc101c00 0x7f9ffc19a160 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 >> 172.21.15.150:0/665816257 conn(0x7f9ffc0fd390 msgr2=0x7f9ffc1085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 shutdown_connections 2024-09-15T22:11:28.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:28.885+0000 7fa003200640 1 -- 172.21.15.150:0/665816257 wait complete. 2024-09-15T22:11:29.555 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T22:11:29.932 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:30.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:30 smithi150 ceph-mon[30886]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:30.479 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:30 smithi150 ceph-mon[30886]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:30.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 -- 172.21.15.150:0/1421969060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08103e00 msgr2=0x7f7b08104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:30.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 --2- 172.21.15.150:0/1421969060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08103e00 0x7f7b08104200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009ca0 tx=0x7f7af802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 -- 172.21.15.150:0/1421969060 shutdown_connections 2024-09-15T22:11:30.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 --2- 172.21.15.150:0/1421969060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08105920 0x7f7b0810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 --2- 172.21.15.150:0/1421969060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08104f60 0x7f7b081053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 --2- 172.21.15.150:0/1421969060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08103e00 0x7f7b08104200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 -- 172.21.15.150:0/1421969060 >> 172.21.15.150:0/1421969060 conn(0x7f7b080ff5b0 msgr2=0x7f7b081019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:30.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 -- 172.21.15.150:0/1421969060 shutdown_connections 2024-09-15T22:11:30.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.502+0000 7f7b0e200640 1 -- 172.21.15.150:0/1421969060 wait complete. 2024-09-15T22:11:30.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.503+0000 7f7b0e200640 1 Processor -- start 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.503+0000 7f7b0e200640 1 -- start start 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b0e200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08103e00 0x7f7b0819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b0e200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08104f60 0x7f7b0819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b0e200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08105920 0x7f7b081a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b0e200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0810fb00 con 0x7f7b08105920 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b0e200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0810f980 con 0x7f7b08104f60 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b0e200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0810fc80 con 0x7f7b08103e00 2024-09-15T22:11:30.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08105920 0x7f7b081a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08105920 0x7f7b081a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57568/0 (socket says 172.21.15.150:57568) 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b07e00640 1 -- 172.21.15.150:0/4149412223 learned_addr learned my addr 172.21.15.150:0/4149412223 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7afea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08104f60 0x7f7b0819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7b07400640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08103e00 0x7f7b0819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.504+0000 7f7afea00640 1 -- 172.21.15.150:0/4149412223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08103e00 msgr2=0x7f7b0819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7afea00640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08103e00 0x7f7b0819a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7afea00640 1 -- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08105920 msgr2=0x7f7b081a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7afea00640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08105920 0x7f7b081a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7afea00640 1 -- 172.21.15.150:0/4149412223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b081a1cf0 con 0x7f7b08104f60 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7b07400640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08103e00 0x7f7b0819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7afea00640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08104f60 0x7f7b0819a600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7af000e9c0 tx=0x7f7af000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af000ccc0 con 0x7f7b08104f60 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af00035f0 con 0x7f7b08104f60 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b081a1fe0 con 0x7f7b08104f60 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af000ce60 con 0x7f7b08104f60 2024-09-15T22:11:30.510 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.505+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b081a2440 con 0x7f7b08104f60 2024-09-15T22:11:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.507+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0810b1a0 con 0x7f7b08104f60 2024-09-15T22:11:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.508+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7af00037a0 con 0x7f7b08104f60 2024-09-15T22:11:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.509+0000 7f7b04c00640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7aec0a3300 0x7f7aec0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:30.511 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.510+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f7af00cffe0 con 0x7f7b08104f60 2024-09-15T22:11:30.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.510+0000 7f7b07400640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7aec0a3300 0x7f7aec0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:30.512 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.510+0000 7f7b07400640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7aec0a3300 0x7f7aec0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005e30 tx=0x7f7af8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:30.515 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.514+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7af009cb50 con 0x7f7b08104f60 2024-09-15T22:11:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:30 smithi154 ceph-mon[34853]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:30 smithi154 ceph-mon[34853]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:30.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.703+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7b08062630 con 0x7f7aec0a3300 2024-09-15T22:11:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:30 smithi169 ceph-mon[35850]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:30 smithi169 ceph-mon[35850]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:30.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.716+0000 7f7b04c00640 1 -- 172.21.15.150:0/4149412223 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f7b08062630 con 0x7f7aec0a3300 2024-09-15T22:11:30.718 INFO:teuthology.orchestra.run.smithi150.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T22:11:30.718 INFO:teuthology.orchestra.run.smithi150.stdout:mds.a smithi150 running (109s) 25s ago 109s 15.1M - 19.1.1-326-g8921c8ef f1455bd0219c eddaef949812 2024-09-15T22:11:30.719 INFO:teuthology.orchestra.run.smithi150.stdout:mds.b smithi154 running (107s) 39s ago 106s 28.7M - 19.1.1-326-g8921c8ef f1455bd0219c 7c4b4dcb2dde 2024-09-15T22:11:30.719 INFO:teuthology.orchestra.run.smithi150.stdout:mds.c smithi169 running (2m) 39s ago 2m 19.8M - 19.1.1-326-g8921c8ef f1455bd0219c bd2a963b669b 2024-09-15T22:11:30.719 INFO:teuthology.orchestra.run.smithi150.stdout:mds.d smithi150 running (2m) 25s ago 2m 12.6M - 19.1.1-326-g8921c8ef f1455bd0219c 5a696de46c8d 2024-09-15T22:11:30.719 INFO:teuthology.orchestra.run.smithi150.stdout:mds.e smithi154 running (2m) 39s ago 2m 19.1M - 19.1.1-326-g8921c8ef f1455bd0219c f237e2dabed1 2024-09-15T22:11:30.719 INFO:teuthology.orchestra.run.smithi150.stdout:mds.f smithi169 running (2m) 39s ago 2m 17.7M - 19.1.1-326-g8921c8ef f1455bd0219c 75a7e58eea1c 2024-09-15T22:11:30.719 INFO:teuthology.orchestra.run.smithi150.stdout:mds.g smithi150 running (113s) 25s ago 112s 12.6M - 19.1.1-326-g8921c8ef f1455bd0219c ee9ee4ad915d 2024-09-15T22:11:30.720 INFO:teuthology.orchestra.run.smithi150.stdout:mds.h smithi154 running (119s) 39s ago 119s 17.8M - 19.1.1-326-g8921c8ef f1455bd0219c 708640c9fd1e 2024-09-15T22:11:30.720 INFO:teuthology.orchestra.run.smithi150.stdout:mds.i smithi169 running (117s) 39s ago 116s 17.5M - 19.1.1-326-g8921c8ef f1455bd0219c 244e3035a011 2024-09-15T22:11:30.720 INFO:teuthology.orchestra.run.smithi150.stdout:mds.j smithi150 running (2m) 25s ago 2m 15.0M - 19.1.1-326-g8921c8ef f1455bd0219c e5b2db46df2b 2024-09-15T22:11:30.720 INFO:teuthology.orchestra.run.smithi150.stdout:mds.k smithi154 running (2m) 39s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c d4d313e0dadb 2024-09-15T22:11:30.720 INFO:teuthology.orchestra.run.smithi150.stdout:mds.l smithi169 running (2m) 39s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c 7755148e2dd0 2024-09-15T22:11:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:mgr.x smithi150 *:9283,8765 running (9m) 25s ago 9m 509M - 19.1.1-326-g8921c8ef f1455bd0219c 975e487d24f1 2024-09-15T22:11:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:mgr.y smithi154 *:8443,8765 running (7m) 39s ago 7m 443M - 19.1.1-326-g8921c8ef f1455bd0219c b1940ca9085b 2024-09-15T22:11:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:mgr.z smithi169 *:8443,8765 running (7m) 39s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 373cce3569b1 2024-09-15T22:11:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:mon.a smithi150 running (9m) 25s ago 9m 48.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c f6d2430797db 2024-09-15T22:11:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:mon.b smithi154 running (8m) 39s ago 8m 44.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 95a0988015cd 2024-09-15T22:11:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:mon.c smithi169 running (8m) 39s ago 8m 41.0M 2048M 19.1.1-326-g8921c8ef f1455bd0219c aee14a94e3d1 2024-09-15T22:11:30.722 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 smithi150 running (7m) 25s ago 7m 54.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d0f74982009d 2024-09-15T22:11:30.722 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 smithi154 running (7m) 39s ago 6m 56.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 899a815b63d8 2024-09-15T22:11:30.722 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 smithi169 running (6m) 39s ago 6m 50.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d0eeb5bbf8df 2024-09-15T22:11:30.722 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 smithi150 running (6m) 25s ago 6m 53.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 1208ace4fd0a 2024-09-15T22:11:30.722 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 smithi154 running (5m) 39s ago 5m 54.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c b7275eb9cf4a 2024-09-15T22:11:30.723 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 smithi169 running (5m) 39s ago 5m 56.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 9e7bce783e85 2024-09-15T22:11:30.723 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 smithi150 running (4m) 25s ago 4m 43.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 5370f6684443 2024-09-15T22:11:30.723 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 smithi154 running (4m) 39s ago 4m 55.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d6367dc968aa 2024-09-15T22:11:30.723 INFO:teuthology.orchestra.run.smithi150.stdout:osd.8 smithi169 running (3m) 39s ago 3m 46.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 401387ad03bd 2024-09-15T22:11:30.723 INFO:teuthology.orchestra.run.smithi150.stdout:osd.9 smithi150 running (3m) 25s ago 3m 43.0M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 4d89312107aa 2024-09-15T22:11:30.723 INFO:teuthology.orchestra.run.smithi150.stdout:osd.10 smithi154 running (3m) 39s ago 3m 54.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c a578f8445310 2024-09-15T22:11:30.724 INFO:teuthology.orchestra.run.smithi150.stdout:osd.11 smithi169 running (2m) 39s ago 2m 42.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 45205e195884 2024-09-15T22:11:30.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7aec0a3300 msgr2=0x7f7aec0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:30.725 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7aec0a3300 0x7f7aec0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005e30 tx=0x7f7af8004a40 comp rx=0 tx=0).stop 2024-09-15T22:11:30.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08104f60 msgr2=0x7f7b0819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:30.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08104f60 0x7f7b0819a600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7af000e9c0 tx=0x7f7af000ee80 comp rx=0 tx=0).stop 2024-09-15T22:11:30.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 shutdown_connections 2024-09-15T22:11:30.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7aec0a3300 0x7f7aec0a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b08105920 0x7f7b081a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.726 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08104f60 0x7f7b0819a600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 --2- 172.21.15.150:0/4149412223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b08103e00 0x7f7b0819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:30.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 >> 172.21.15.150:0/4149412223 conn(0x7f7b080ff5b0 msgr2=0x7f7b08108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:30.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.718+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 shutdown_connections 2024-09-15T22:11:30.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:30.719+0000 7f7b0e200640 1 -- 172.21.15.150:0/4149412223 wait complete. 2024-09-15T22:11:31.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T22:11:31.968 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:32.389 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:32 smithi150 ceph-mon[30886]: from='client.25016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:32.389 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:32 smithi150 ceph-mon[30886]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:32.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 -- 172.21.15.150:0/6263240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc074c50 msgr2=0x7faebc0750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 --2- 172.21.15.150:0/6263240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc074c50 0x7faebc0750b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faea8009900 tx=0x7faea802a410 comp rx=0 tx=0).stop 2024-09-15T22:11:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 -- 172.21.15.150:0/6263240 shutdown_connections 2024-09-15T22:11:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 --2- 172.21.15.150:0/6263240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc109a80 0x7faebc10bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 --2- 172.21.15.150:0/6263240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc074c50 0x7faebc0750b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 --2- 172.21.15.150:0/6263240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.497+0000 7faec4200640 1 -- 172.21.15.150:0/6263240 >> 172.21.15.150:0/6263240 conn(0x7faebc0fd390 msgr2=0x7faebc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.498+0000 7faec4200640 1 -- 172.21.15.150:0/6263240 shutdown_connections 2024-09-15T22:11:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.498+0000 7faec4200640 1 -- 172.21.15.150:0/6263240 wait complete. 2024-09-15T22:11:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.498+0000 7faec4200640 1 Processor -- start 2024-09-15T22:11:32.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 -- start start 2024-09-15T22:11:32.504 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 0x7faebc19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 0x7faebc1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10faf0 con 0x7faebc109a80 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10f970 con 0x7faebc076220 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec4200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10fc70 con 0x7faebc074c50 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 0x7faebc1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec1800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 0x7faebc19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec0e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec0e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37322/0 (socket says 172.21.15.150:37322) 2024-09-15T22:11:32.505 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 0x7faebc1a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57580/0 (socket says 172.21.15.150:57580) 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec0e00640 1 -- 172.21.15.150:0/1980262534 learned_addr learned my addr 172.21.15.150:0/1980262534 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.499+0000 7faec1800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 0x7faebc19a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:57008/0 (socket says 172.21.15.150:57008) 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec0e00640 1 -- 172.21.15.150:0/1980262534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 msgr2=0x7faebc19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec0e00640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 0x7faebc19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec0e00640 1 -- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 msgr2=0x7faebc1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec0e00640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 0x7faebc1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec0e00640 1 -- 172.21.15.150:0/1980262534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc1a1d50 con 0x7faebc076220 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec2200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 0x7faebc1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec1800640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 0x7faebc19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faec0e00640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc19a660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faea8031440 tx=0x7faea8032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:32.506 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.500+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea803f030 con 0x7faebc076220 2024-09-15T22:11:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.501+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faebc1a1fe0 con 0x7faebc076220 2024-09-15T22:11:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.501+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea8003ce0 con 0x7faebc076220 2024-09-15T22:11:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.501+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8035070 con 0x7faebc076220 2024-09-15T22:11:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.501+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faebc1a2430 con 0x7faebc076220 2024-09-15T22:11:32.507 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.502+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faebc108800 con 0x7faebc076220 2024-09-15T22:11:32.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.504+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7faea8042030 con 0x7faebc076220 2024-09-15T22:11:32.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.505+0000 7faeba000640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7faea40a3300 0x7faea40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:32.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.505+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7faea80efba0 con 0x7faebc076220 2024-09-15T22:11:32.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.505+0000 7faec1800640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7faea40a3300 0x7faea40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:32.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.506+0000 7faec1800640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7faea40a3300 0x7faea40a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faebc076600 tx=0x7faeb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:32.509 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.507+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faea80efe20 con 0x7faebc076220 2024-09-15T22:11:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:32 smithi154 ceph-mon[34853]: from='client.25016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:32 smithi154 ceph-mon[34853]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:32.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.696+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7faebc062630 con 0x7faea40a3300 2024-09-15T22:11:32.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.703+0000 7faeba000640 1 -- 172.21.15.150:0/1980262534 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7faebc062630 con 0x7faea40a3300 2024-09-15T22:11:32.705 INFO:teuthology.orchestra.run.smithi150.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T22:11:32.705 INFO:teuthology.orchestra.run.smithi150.stdout:mds.all 12/12 41s ago 2m smithi150=a;smithi150=d;smithi150=g;smithi150=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-15T22:11:32.705 INFO:teuthology.orchestra.run.smithi150.stdout:mgr 3/3 41s ago 7m smithi150=x;smithi154=y;smithi169=z;count:3 2024-09-15T22:11:32.706 INFO:teuthology.orchestra.run.smithi150.stdout:mon 3/3 41s ago 8m smithi150:172.21.15.150=a;smithi154:172.21.15.154=b;smithi169:172.21.15.169=c;count:3 2024-09-15T22:11:32.706 INFO:teuthology.orchestra.run.smithi150.stdout:osd 12 41s ago - 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7faea40a3300 msgr2=0x7faea40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7faea40a3300 0x7faea40a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faebc076600 tx=0x7faeb0005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 msgr2=0x7faebc19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc19a660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faea8031440 tx=0x7faea8032ce0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 shutdown_connections 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7faea40a3300 0x7faea40a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faebc109a80 0x7faebc1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faebc076220 0x7faebc19a660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 --2- 172.21.15.150:0/1980262534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faebc074c50 0x7faebc19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:32.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.706+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 >> 172.21.15.150:0/1980262534 conn(0x7faebc0fd390 msgr2=0x7faebc1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:32.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.707+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 shutdown_connections 2024-09-15T22:11:32.710 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:32.707+0000 7faec4200640 1 -- 172.21.15.150:0/1980262534 wait complete. 2024-09-15T22:11:32.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:32 smithi169 ceph-mon[35850]: from='client.25016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:32.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:32 smithi169 ceph-mon[35850]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:33.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T22:11:33.926 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:34.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:34 smithi150 ceph-mon[30886]: from='client.25022 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:34.371 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:34 smithi150 ceph-mon[30886]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 -- 172.21.15.150:0/2322463107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c103600 msgr2=0x7fdb2c109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2322463107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c103600 0x7fdb2c109e90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009900 tx=0x7fdb2402a410 comp rx=0 tx=0).stop 2024-09-15T22:11:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 -- 172.21.15.150:0/2322463107 shutdown_connections 2024-09-15T22:11:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2322463107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c103600 0x7fdb2c109e90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2322463107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c102c40 0x7fdb2c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2322463107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c101a40 0x7fdb2c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 -- 172.21.15.150:0/2322463107 >> 172.21.15.150:0/2322463107 conn(0x7fdb2c0fd1f0 msgr2=0x7fdb2c0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 -- 172.21.15.150:0/2322463107 shutdown_connections 2024-09-15T22:11:34.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.482+0000 7fdb31a00640 1 -- 172.21.15.150:0/2322463107 wait complete. 2024-09-15T22:11:34.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 Processor -- start 2024-09-15T22:11:34.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 -- start start 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 0x7fdb2c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c102c40 0x7fdb2c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c103600 0x7fdb2c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10d710 con 0x7fdb2c102c40 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10d590 con 0x7fdb2c101a40 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.483+0000 7fdb31a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10d890 con 0x7fdb2c103600 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 0x7fdb2c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c102c40 0x7fdb2c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 0x7fdb2c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37330/0 (socket says 172.21.15.150:37330) 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb2be00640 1 -- 172.21.15.150:0/2113117391 learned_addr learned my addr 172.21.15.150:0/2113117391 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:34.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb31000640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c103600 0x7fdb2c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 -- 172.21.15.150:0/2113117391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c103600 msgr2=0x7fdb2c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c103600 0x7fdb2c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 -- 172.21.15.150:0/2113117391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 msgr2=0x7fdb2c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 0x7fdb2c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 -- 172.21.15.150:0/2113117391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0753e0 con 0x7fdb2c102c40 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb31000640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c103600 0x7fdb2c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb2be00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 0x7fdb2c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.484+0000 7fdb23400640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c102c40 0x7fdb2c0745e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005fd0 tx=0x7fdb1400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.485+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14009c30 con 0x7fdb2c102c40 2024-09-15T22:11:34.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.485+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb14009dd0 con 0x7fdb2c102c40 2024-09-15T22:11:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.485+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c1a1e40 con 0x7fdb2c102c40 2024-09-15T22:11:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.485+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14010460 con 0x7fdb2c102c40 2024-09-15T22:11:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.485+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c1a22a0 con 0x7fdb2c102c40 2024-09-15T22:11:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.486+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c108d70 con 0x7fdb2c102c40 2024-09-15T22:11:34.489 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.488+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdb14003f50 con 0x7fdb2c102c40 2024-09-15T22:11:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.489+0000 7fdb29600640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdb100a32d0 0x7fdb100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.489+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7fdb140cfa80 con 0x7fdb2c102c40 2024-09-15T22:11:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.489+0000 7fdb2be00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdb100a32d0 0x7fdb100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:34.491 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.490+0000 7fdb2be00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdb100a32d0 0x7fdb100a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009fd0 tx=0x7fdb1c009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:34.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.493+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb140d1e20 con 0x7fdb2c102c40 2024-09-15T22:11:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:34 smithi154 ceph-mon[34853]: from='client.25022 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:34 smithi154 ceph-mon[34853]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:34.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.674+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fdb2c062630 con 0x7fdb100a32d0 2024-09-15T22:11:34.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.675+0000 7fdb29600640 1 -- 172.21.15.150:0/2113117391 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fdb2c062630 con 0x7fdb100a32d0 2024-09-15T22:11:34.677 INFO:teuthology.orchestra.run.smithi150.stdout:HOST ADDR LABELS STATUS 2024-09-15T22:11:34.677 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150 172.21.15.150 2024-09-15T22:11:34.678 INFO:teuthology.orchestra.run.smithi150.stdout:smithi154 172.21.15.154 2024-09-15T22:11:34.678 INFO:teuthology.orchestra.run.smithi150.stdout:smithi169 172.21.15.169 2024-09-15T22:11:34.678 INFO:teuthology.orchestra.run.smithi150.stdout:3 hosts in cluster 2024-09-15T22:11:34.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdb100a32d0 msgr2=0x7fdb100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:34.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdb100a32d0 0x7fdb100a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009fd0 tx=0x7fdb1c009700 comp rx=0 tx=0).stop 2024-09-15T22:11:34.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c102c40 msgr2=0x7fdb2c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:34.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c102c40 0x7fdb2c0745e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005fd0 tx=0x7fdb1400dde0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 shutdown_connections 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb2c103600 0x7fdb2c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdb100a32d0 0x7fdb100a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c102c40 0x7fdb2c0745e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 --2- 172.21.15.150:0/2113117391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c101a40 0x7fdb2c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.678+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 >> 172.21.15.150:0/2113117391 conn(0x7fdb2c0fd1f0 msgr2=0x7fdb2c105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.679+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 shutdown_connections 2024-09-15T22:11:34.681 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:34.679+0000 7fdb31a00640 1 -- 172.21.15.150:0/2113117391 wait complete. 2024-09-15T22:11:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:34 smithi169 ceph-mon[35850]: from='client.25022 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:34 smithi169 ceph-mon[35850]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:35.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T22:11:35.959 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:36.349 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:36 smithi150 ceph-mon[30886]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:36.349 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:36 smithi150 ceph-mon[30886]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:36 smithi154 ceph-mon[34853]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:36 smithi154 ceph-mon[34853]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:36.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.567+0000 7f2a7d000640 1 -- 172.21.15.150:0/922179361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 msgr2=0x7f2a7810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:36.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.567+0000 7f2a7d000640 1 --2- 172.21.15.150:0/922179361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 0x7f2a7810a050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009900 tx=0x7f2a7002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 -- 172.21.15.150:0/922179361 shutdown_connections 2024-09-15T22:11:36.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 --2- 172.21.15.150:0/922179361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 0x7f2a7810a050 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.569 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 --2- 172.21.15.150:0/922179361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a78102e00 0x7f2a78103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 --2- 172.21.15.150:0/922179361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 -- 172.21.15.150:0/922179361 >> 172.21.15.150:0/922179361 conn(0x7f2a780fd390 msgr2=0x7f2a780ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:36.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 -- 172.21.15.150:0/922179361 shutdown_connections 2024-09-15T22:11:36.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.568+0000 7f2a7d000640 1 -- 172.21.15.150:0/922179361 wait complete. 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.569+0000 7f2a7d000640 1 Processor -- start 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.569+0000 7f2a7d000640 1 -- start start 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.569+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a78102e00 0x7f2a781983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 0x7f2a7819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a7d000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810d880 con 0x7f2a781037c0 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a7d000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810d700 con 0x7f2a78101c00 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a7d000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810da00 con 0x7f2a78102e00 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:36.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37346/0 (socket says 172.21.15.150:37346) 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 -- 172.21.15.150:0/3557055258 learned_addr learned my addr 172.21.15.150:0/3557055258 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75400640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a78102e00 0x7f2a781983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a76800640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 0x7f2a7819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 -- 172.21.15.150:0/3557055258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a78102e00 msgr2=0x7f2a781983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a78102e00 0x7f2a781983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 -- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 msgr2=0x7f2a7819f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 0x7f2a7819f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.570+0000 7f2a75e00640 1 -- 172.21.15.150:0/3557055258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7819faa0 con 0x7f2a78101c00 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.571+0000 7f2a75e00640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78197e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800ebc0 tx=0x7f2a6800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.571+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68003b70 con 0x7f2a78101c00 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.571+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a68003d10 con 0x7f2a78101c00 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.571+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7819fd90 con 0x7f2a78101c00 2024-09-15T22:11:36.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.571+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68019980 con 0x7f2a78101c00 2024-09-15T22:11:36.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.571+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a781a0210 con 0x7f2a78101c00 2024-09-15T22:11:36.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.572+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a78108f50 con 0x7f2a78101c00 2024-09-15T22:11:36.575 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.574+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f2a68004b60 con 0x7f2a78101c00 2024-09-15T22:11:36.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.575+0000 7f2a6ea00640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2a5c0a3300 0x7f2a5c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:36.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.575+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f2a680d0590 con 0x7f2a78101c00 2024-09-15T22:11:36.576 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.576+0000 7f2a75400640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2a5c0a3300 0x7f2a5c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:36.577 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.576+0000 7f2a75400640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2a5c0a3300 0x7f2a5c0a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a78199390 tx=0x7f2a64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:36.578 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.577+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a6809d0e0 con 0x7f2a78101c00 2024-09-15T22:11:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:36 smithi169 ceph-mon[35850]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:36 smithi169 ceph-mon[35850]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:11:36.760 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.760+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 --> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f2a78062630 con 0x7f2a5c0a3300 2024-09-15T22:11:36.762 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.761+0000 7f2a6ea00640 1 -- 172.21.15.150:0/3557055258 <== mgr.14150 v2:172.21.15.150:6800/1242932536 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f2a78062630 con 0x7f2a5c0a3300 2024-09-15T22:11:36.762 INFO:teuthology.orchestra.run.smithi150.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T22:11:36.762 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GX400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:11:36.762 INFO:teuthology.orchestra.run.smithi150.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:11:36.762 INFO:teuthology.orchestra.run.smithi150.stdout:smithi169 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300LN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T22:11:36.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2a5c0a3300 msgr2=0x7f2a5c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2a5c0a3300 0x7f2a5c0a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a78199390 tx=0x7f2a64005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 msgr2=0x7f2a78197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78197e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800ebc0 tx=0x7f2a6800c6a0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 shutdown_connections 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2a5c0a3300 0x7f2a5c0a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a781037c0 0x7f2a7819f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a78102e00 0x7f2a781983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 --2- 172.21.15.150:0/3557055258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a78101c00 0x7f2a78197e70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 >> 172.21.15.150:0/3557055258 conn(0x7f2a780fd390 msgr2=0x7f2a78106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 shutdown_connections 2024-09-15T22:11:36.765 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:36.764+0000 7f2a7d000640 1 -- 172.21.15.150:0/3557055258 wait complete. 2024-09-15T22:11:37.548 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:11:37.560 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:11:37.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T22:11:37.931 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:38.361 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:38 smithi150 ceph-mon[30886]: from='client.25034 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:38.361 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:38 smithi150 ceph-mon[30886]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:38.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 -- 172.21.15.150:0/1508803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00076ba0 msgr2=0x7f4a00076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 --2- 172.21.15.150:0/1508803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00076ba0 0x7f4a00076fa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009900 tx=0x7f49f402a410 comp rx=0 tx=0).stop 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 -- 172.21.15.150:0/1508803313 shutdown_connections 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 --2- 172.21.15.150:0/1508803313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a00078790 0x7f4a00079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 --2- 172.21.15.150:0/1508803313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a00077df0 0x7f4a00078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 --2- 172.21.15.150:0/1508803313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00076ba0 0x7f4a00076fa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 -- 172.21.15.150:0/1508803313 >> 172.21.15.150:0/1508803313 conn(0x7f4a000ff3e0 msgr2=0x7f4a00101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 -- 172.21.15.150:0/1508803313 shutdown_connections 2024-09-15T22:11:38.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.471+0000 7f4a06000640 1 -- 172.21.15.150:0/1508803313 wait complete. 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.472+0000 7f4a06000640 1 Processor -- start 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.472+0000 7f4a06000640 1 -- start start 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a06000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a00076ba0 0x7f4a0019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a06000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a00077df0 0x7f4a0019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a06000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 0x7f4a001a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a06000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00113d60 con 0x7f4a00078790 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a06000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00113be0 con 0x7f4a00077df0 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a06000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00113ee0 con 0x7f4a00076ba0 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a05600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 0x7f4a001a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:38.475 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a04c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a00076ba0 0x7f4a0019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a05600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 0x7f4a001a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57636/0 (socket says 172.21.15.150:57636) 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f49ffe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a00077df0 0x7f4a0019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.473+0000 7f4a05600640 1 -- 172.21.15.150:0/293432225 learned_addr learned my addr 172.21.15.150:0/293432225 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a05600640 1 -- 172.21.15.150:0/293432225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a00076ba0 msgr2=0x7f4a0019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a05600640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a00076ba0 0x7f4a0019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a05600640 1 -- 172.21.15.150:0/293432225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a00077df0 msgr2=0x7f4a0019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a05600640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a00077df0 0x7f4a0019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a05600640 1 -- 172.21.15.150:0/293432225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a001a5f50 con 0x7f4a00078790 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a05600640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 0x7f4a001a58e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009fd0 tx=0x7f49f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8017070 con 0x7f4a00078790 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49f8003e50 con 0x7f4a00078790 2024-09-15T22:11:38.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f80106c0 con 0x7f4a00078790 2024-09-15T22:11:38.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a001a6240 con 0x7f4a00078790 2024-09-15T22:11:38.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.474+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001a6730 con 0x7f4a00078790 2024-09-15T22:11:38.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.475+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a001105d0 con 0x7f4a00078790 2024-09-15T22:11:38.478 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.477+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f49f8003970 con 0x7f4a00078790 2024-09-15T22:11:38.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.478+0000 7f49fd600640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f49e80a3300 0x7f49e80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:38.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.479+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f49f80cf7c0 con 0x7f4a00078790 2024-09-15T22:11:38.479 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.479+0000 7f4a04c00640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f49e80a3300 0x7f49e80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:38.480 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.480+0000 7f4a04c00640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f49e80a3300 0x7f49e80a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f49f4031440 tx=0x7f49f40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:38.484 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.483+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49f809bcc0 con 0x7f4a00078790 2024-09-15T22:11:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:38 smithi154 ceph-mon[34853]: from='client.25034 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:38 smithi154 ceph-mon[34853]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:38.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.697+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4a00062df0 con 0x7f4a00078790 2024-09-15T22:11:38.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.697+0000 7f49fd600640 1 -- 172.21.15.150:0/293432225 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3144 (secure 0 0 0) 0x7f49f809ffc0 con 0x7f4a00078790 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:e27 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:btime 2024-09-15T22:10:10:787282+0000 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:legacy client fscid: 1 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:Filesystem 'cephfs' (1) 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:fs_name cephfs 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:epoch 27 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:created 2024-09-15T22:09:57.693830+0000 2024-09-15T22:11:38.699 INFO:teuthology.orchestra.run.smithi150.stdout:modified 2024-09-15T22:10:10.787262+0000 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:tableserver 0 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:root 0 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:session_timeout 300 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:session_autoclose 300 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:max_file_size 1099511627776 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:max_xattr_size 65536 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:required_client_features {} 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:last_failure 0 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:last_failure_osd_epoch 0 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:max_mds 5 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:in 0,1,2,3,4 2024-09-15T22:11:38.700 INFO:teuthology.orchestra.run.smithi150.stdout:up {0=24578,1=24539,2=24523,3=24512,4=24508} 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:failed 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:damaged 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:stopped 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:data_pools [3] 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:metadata_pool 2 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:inline_data disabled 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:balancer 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:bal_rank_mask -1 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:standby_count_wanted 0 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:qdb_cluster leader: 24578 members: 24578,24539,24523,24512,24508 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b{0:24578} state up:active seq 5 addr [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.f{0:24496} state up:standby-replay seq 1 addr [v2:172.21.15.169:6834/721825855,v1:172.21.15.169:6835/721825855] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.701 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.h{1:24539} state up:active seq 10 addr [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.j{1:24488} state up:standby-replay seq 1 addr [v2:172.21.15.150:6834/3135790520,v1:172.21.15.150:6835/3135790520] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.i{2:24523} state up:active seq 10 addr [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.k{2:24476} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/1449001850,v1:172.21.15.154:6833/1449001850] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.e{3:24512} state up:active seq 13 addr [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.l{3:24451} state up:standby-replay seq 1 addr [v2:172.21.15.169:6832/2170086704,v1:172.21.15.169:6833/2170086704] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c{4:24508} state up:active seq 12 addr [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a{4:14535} state up:standby-replay seq 1 addr [v2:172.21.15.150:6840/1726301246,v1:172.21.15.150:6841/1726301246] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:38.702 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:38.703 INFO:teuthology.orchestra.run.smithi150.stdout:Standby daemons: 2024-09-15T22:11:38.703 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:38.703 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d{-1:14481} state up:standby seq 1 addr [v2:172.21.15.150:6836/2570378588,v1:172.21.15.150:6837/2570378588] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.703 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.g{-1:14523} state up:standby seq 1 addr [v2:172.21.15.150:6838/715300877,v1:172.21.15.150:6839/715300877] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f49e80a3300 msgr2=0x7f49e80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f49e80a3300 0x7f49e80a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f49f4031440 tx=0x7f49f40315b0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 msgr2=0x7f4a001a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 0x7f4a001a58e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009fd0 tx=0x7f49f800b260 comp rx=0 tx=0).stop 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 shutdown_connections 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f49e80a3300 0x7f49e80a57c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a00078790 0x7f4a001a58e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a00077df0 0x7f4a0019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 --2- 172.21.15.150:0/293432225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a00076ba0 0x7f4a0019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:38.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 >> 172.21.15.150:0/293432225 conn(0x7f4a000ff3e0 msgr2=0x7f4a00100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:38.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 shutdown_connections 2024-09-15T22:11:38.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:38.700+0000 7f4a06000640 1 -- 172.21.15.150:0/293432225 wait complete. 2024-09-15T22:11:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:38 smithi169 ceph-mon[35850]: from='client.25034 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:38.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:38 smithi169 ceph-mon[35850]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:39.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:39 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/293432225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:11:39.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:39 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/293432225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:11:39.529 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T22:11:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:39 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/293432225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:11:39.902 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:40.320 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:40 smithi150 ceph-mon[30886]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 -- 172.21.15.150:0/4065050114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c104f60 msgr2=0x7f5b1c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 --2- 172.21.15.150:0/4065050114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c104f60 0x7f5b1c1053e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009900 tx=0x7f5b0402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 -- 172.21.15.150:0/4065050114 shutdown_connections 2024-09-15T22:11:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 --2- 172.21.15.150:0/4065050114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 0x7f5b1c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 --2- 172.21.15.150:0/4065050114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c104f60 0x7f5b1c1053e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 --2- 172.21.15.150:0/4065050114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c103e00 0x7f5b1c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 -- 172.21.15.150:0/4065050114 >> 172.21.15.150:0/4065050114 conn(0x7f5b1c0ff5b0 msgr2=0x7f5b1c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:40.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 -- 172.21.15.150:0/4065050114 shutdown_connections 2024-09-15T22:11:40.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.429+0000 7f5b22a00640 1 -- 172.21.15.150:0/4065050114 wait complete. 2024-09-15T22:11:40.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 Processor -- start 2024-09-15T22:11:40.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 -- start start 2024-09-15T22:11:40.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c103e00 0x7f5b1c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:40.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 0x7f5b1c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:40.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 0x7f5b1c1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:40.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c10fae0 con 0x7f5b1c103e00 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c10f960 con 0x7f5b1c104f60 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.430+0000 7f5b22a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c10fc60 con 0x7f5b1c105920 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b1be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c103e00 0x7f5b1c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 0x7f5b1c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 0x7f5b1c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:44636/0 (socket says 172.21.15.150:44636) 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 -- 172.21.15.150:0/2829017528 learned_addr learned my addr 172.21.15.150:0/2829017528 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b20a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 0x7f5b1c1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 -- 172.21.15.150:0/2829017528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 msgr2=0x7f5b1c1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 0x7f5b1c1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 -- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c103e00 msgr2=0x7f5b1c19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c103e00 0x7f5b1c19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 -- 172.21.15.150:0/2829017528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c1a1d10 con 0x7f5b1c104f60 2024-09-15T22:11:40.434 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b1be00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c103e00 0x7f5b1c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:40.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b20a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 0x7f5b1c1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:40.435 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.431+0000 7f5b13e00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 0x7f5b1c19a620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b04031440 tx=0x7f5b04032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:40.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.432+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0403f030 con 0x7f5b1c104f60 2024-09-15T22:11:40.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.432+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b04003ce0 con 0x7f5b1c104f60 2024-09-15T22:11:40.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.432+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04035070 con 0x7f5b1c104f60 2024-09-15T22:11:40.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.432+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c1a1fa0 con 0x7f5b1c104f60 2024-09-15T22:11:40.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.432+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c1a2390 con 0x7f5b1c104f60 2024-09-15T22:11:40.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.433+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1c10b1a0 con 0x7f5b1c104f60 2024-09-15T22:11:40.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.435+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5b04042030 con 0x7f5b1c104f60 2024-09-15T22:11:40.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.436+0000 7f5b19600640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5b000a3300 0x7f5b000a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:40.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.436+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f5b040efb50 con 0x7f5b1c104f60 2024-09-15T22:11:40.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.436+0000 7f5b1be00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5b000a3300 0x7f5b000a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:40.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.437+0000 7f5b1be00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5b000a3300 0x7f5b000a57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009fc0 tx=0x7f5b0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:40.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.438+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b040bc160 con 0x7f5b1c104f60 2024-09-15T22:11:40.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:40 smithi154 ceph-mon[34853]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:40.617 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.615+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f5b1c02d7c0 con 0x7f5b1c104f60 2024-09-15T22:11:40.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.616+0000 7f5b19600640 1 -- 172.21.15.150:0/2829017528 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5338 (secure 0 0 0) 0x7f5b040c0460 con 0x7f5b1c104f60 2024-09-15T22:11:40.618 INFO:teuthology.orchestra.run.smithi150.stdout:epoch 82 2024-09-15T22:11:40.618 INFO:teuthology.orchestra.run.smithi150.stdout:fsid faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:created 2024-09-15T22:01:51.173086+0000 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:modified 2024-09-15T22:10:44.216028+0000 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:crush_version 26 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:full_ratio 0.95 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:backfillfull_ratio 0.9 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:nearfull_ratio 0.85 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:require_min_compat_client luminous 2024-09-15T22:11:40.619 INFO:teuthology.orchestra.run.smithi150.stdout:min_compat_client luminous 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:require_osd_release squid 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:stretch_mode_enabled false 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:max_osd 12 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6802/1337195961,v1:172.21.15.150:6803/1337195961] [v2:172.21.15.150:6804/1337195961,v1:172.21.15.150:6805/1337195961] exists,up defc4d93-c2c6-464f-a12c-3081cad7a002 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:osd.1 up in weight 1 up_from 12 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/1467569583,v1:172.21.15.154:6801/1467569583] [v2:172.21.15.154:6802/1467569583,v1:172.21.15.154:6803/1467569583] exists,up 042fff78-7cda-42c3-b58a-ad6488a3dece 2024-09-15T22:11:40.620 INFO:teuthology.orchestra.run.smithi150.stdout:osd.2 up in weight 1 up_from 16 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/2021221848,v1:172.21.15.169:6801/2021221848] [v2:172.21.15.169:6802/2021221848,v1:172.21.15.169:6803/2021221848] exists,up 82099aa0-3e95-412f-8801-880ea1f6d9aa 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.3 up in weight 1 up_from 23 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6810/720589173,v1:172.21.15.150:6811/720589173] [v2:172.21.15.150:6812/720589173,v1:172.21.15.150:6813/720589173] exists,up c82106b6-b1f8-47e1-9be8-631d67fbb09e 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.4 up in weight 1 up_from 30 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/3739544078,v1:172.21.15.154:6809/3739544078] [v2:172.21.15.154:6810/3739544078,v1:172.21.15.154:6811/3739544078] exists,up 2d7e1830-827c-415b-b6e2-a495eb3914fb 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.5 up in weight 1 up_from 34 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/2553035733,v1:172.21.15.169:6809/2553035733] [v2:172.21.15.169:6810/2553035733,v1:172.21.15.169:6811/2553035733] exists,up 8835e251-fc59-4515-b973-ee290b8c9093 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.6 up in weight 1 up_from 41 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6818/2947582295,v1:172.21.15.150:6819/2947582295] [v2:172.21.15.150:6820/2947582295,v1:172.21.15.150:6821/2947582295] exists,up a6debad2-ff5e-42e8-941d-5568a5d7d9dc 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.7 up in weight 1 up_from 46 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/1862188814,v1:172.21.15.154:6817/1862188814] [v2:172.21.15.154:6818/1862188814,v1:172.21.15.154:6819/1862188814] exists,up b2fe39e3-34ef-4b27-a7ab-688f0497e893 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.8 up in weight 1 up_from 53 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/2545784116,v1:172.21.15.169:6817/2545784116] [v2:172.21.15.169:6818/2545784116,v1:172.21.15.169:6819/2545784116] exists,up d0cfc7ba-4548-480a-9251-906ba609e9cf 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.9 up in weight 1 up_from 60 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6826/3744711849,v1:172.21.15.150:6827/3744711849] [v2:172.21.15.150:6828/3744711849,v1:172.21.15.150:6829/3744711849] exists,up 1f871001-d0f3-4b56-ab67-15c4c7ac88d9 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.10 up in weight 1 up_from 66 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/3374528953,v1:172.21.15.154:6825/3374528953] [v2:172.21.15.154:6826/3374528953,v1:172.21.15.154:6827/3374528953] exists,up cbf9fa28-8307-41a7-8c98-b00697d3c837 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:osd.11 up in weight 1 up_from 73 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6824/33837423,v1:172.21.15.169:6825/33837423] [v2:172.21.15.169:6826/33837423,v1:172.21.15.169:6827/33837423] exists,up 8474de2f-ba9c-4888-adec-e408f8c16e95 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 2.16 [2,4] 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 2.1a [8,1] 2024-09-15T22:11:40.621 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 2.1d [2,4] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 3.c [3,9] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 3.14 [4,6] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 3.1d [4,7] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 3.28 [5,8,3,6] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 3.2c [4,9] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:pg_upmap_items 3.37 [1,9] 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:6801/3271868660 expires 2024-09-16T22:02:43.046629+0000 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:6800/3271868660 expires 2024-09-16T22:02:43.046629+0000 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:0/2539129789 expires 2024-09-16T22:02:43.046629+0000 2024-09-15T22:11:40.622 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:0/370021496 expires 2024-09-16T22:02:43.046629+0000 2024-09-15T22:11:40.623 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:0/2466465214 expires 2024-09-16T22:02:16.539388+0000 2024-09-15T22:11:40.623 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:0/3629553483 expires 2024-09-16T22:02:43.046629+0000 2024-09-15T22:11:40.623 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:6801/685691735 expires 2024-09-16T22:02:16.539388+0000 2024-09-15T22:11:40.623 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:0/3932611497 expires 2024-09-16T22:02:16.539388+0000 2024-09-15T22:11:40.623 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:6800/685691735 expires 2024-09-16T22:02:16.539388+0000 2024-09-15T22:11:40.623 INFO:teuthology.orchestra.run.smithi150.stdout:blocklist 172.21.15.150:0/3547163182 expires 2024-09-16T22:02:16.539388+0000 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5b000a3300 msgr2=0x7f5b000a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5b000a3300 0x7f5b000a57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009fc0 tx=0x7f5b0c005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 msgr2=0x7f5b1c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 0x7f5b1c19a620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b04031440 tx=0x7f5b04032ce0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 shutdown_connections 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c105920 0x7f5b1c1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c104f60 0x7f5b1c19a620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5b000a3300 0x7f5b000a57c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 --2- 172.21.15.150:0/2829017528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b1c103e00 0x7f5b1c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:40.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 >> 172.21.15.150:0/2829017528 conn(0x7f5b1c0ff5b0 msgr2=0x7f5b1c108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:40.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 shutdown_connections 2024-09-15T22:11:40.626 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:40.620+0000 7f5b22a00640 1 -- 172.21.15.150:0/2829017528 wait complete. 2024-09-15T22:11:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:40 smithi169 ceph-mon[35850]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:11:41.304 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T22:11:41.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:11:41.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:41 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2829017528' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:11:41.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:41 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2829017528' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:11:41.687 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:41.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:41 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2829017528' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:11:42.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 -- 172.21.15.150:0/1204583420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658108f60 msgr2=0x7f4658110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:42.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 --2- 172.21.15.150:0/1204583420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658108f60 0x7f4658110ae0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4650009ca0 tx=0x7f465002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 -- 172.21.15.150:0/1204583420 shutdown_connections 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 --2- 172.21.15.150:0/1204583420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658108f60 0x7f4658110ae0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 --2- 172.21.15.150:0/1204583420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46581047e0 0x7f4658108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 --2- 172.21.15.150:0/1204583420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4658103e30 0x7f4658104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 -- 172.21.15.150:0/1204583420 >> 172.21.15.150:0/1204583420 conn(0x7f46580ff910 msgr2=0x7f4658101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 -- 172.21.15.150:0/1204583420 shutdown_connections 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.235+0000 7f4657e00640 1 -- 172.21.15.150:0/1204583420 wait complete. 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.236+0000 7f4657e00640 1 Processor -- start 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.236+0000 7f4657e00640 1 -- start start 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 0x7f465819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46581047e0 0x7f465819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:42.245 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4658108f60 0x7f465819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4658114010 con 0x7f4658103e30 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4658113e90 con 0x7f4658108f60 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4658114190 con 0x7f46581047e0 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 0x7f465819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 0x7f465819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33340/0 (socket says 172.21.15.150:33340) 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 -- 172.21.15.150:0/960271851 learned_addr learned my addr 172.21.15.150:0/960271851 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4657400640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4658108f60 0x7f465819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656000640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46581047e0 0x7f465819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 -- 172.21.15.150:0/960271851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46581047e0 msgr2=0x7f465819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46581047e0 0x7f465819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 -- 172.21.15.150:0/960271851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4658108f60 msgr2=0x7f465819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:42.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4658108f60 0x7f465819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.237+0000 7f4656a00640 1 -- 172.21.15.150:0/960271851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465819f3c0 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.238+0000 7f4656a00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 0x7f465819a410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f464800e9f0 tx=0x7f464800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.238+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464800cd80 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.238+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4648010910 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.238+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648018990 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.238+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465819f6b0 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.238+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46581a6f90 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.239+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4658105310 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.241+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4648010ac0 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.242+0000 7f465ca00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f463c0a3350 0x7f463c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.243+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f46480d01a0 con 0x7f4658103e30 2024-09-15T22:11:42.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.243+0000 7f4656000640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f463c0a3350 0x7f463c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:42.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.243+0000 7f4656000640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f463c0a3350 0x7f463c0a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4658101730 tx=0x7f4644005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:42.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.244+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f464809c6a0 con 0x7f4658103e30 2024-09-15T22:11:42.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:42 smithi150 ceph-mon[30886]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:42.455 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.453+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4658104210 con 0x7f4658103e30 2024-09-15T22:11:42.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.454+0000 7f465ca00640 1 -- 172.21.15.150:0/960271851 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11997 (secure 0 0 0) 0x7f46480a09a0 con 0x7f4658103e30 2024-09-15T22:11:42.456 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:42.456 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"btime":"2024-09-15T22:10:10:787282+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:10:10.787262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:11:42.457 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:11:42.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.456+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f463c0a3350 msgr2=0x7f463c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.456+0000 7f4657e00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f463c0a3350 0x7f463c0a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4658101730 tx=0x7f4644005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.456+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 msgr2=0x7f465819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.456+0000 7f4657e00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 0x7f465819a410 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f464800e9f0 tx=0x7f464800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 shutdown_connections 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4658108f60 0x7f465819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46581047e0 0x7f465819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f463c0a3350 0x7f463c0a5810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 --2- 172.21.15.150:0/960271851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4658103e30 0x7f465819a410 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 >> 172.21.15.150:0/960271851 conn(0x7f46580ff910 msgr2=0x7f4658101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:42.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 shutdown_connections 2024-09-15T22:11:42.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:42.457+0000 7f4657e00640 1 -- 172.21.15.150:0/960271851 wait complete. 2024-09-15T22:11:42.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:42 smithi154 ceph-mon[34853]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:42 smithi169 ceph-mon[35850]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-15T22:11:43.202 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:11:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:43 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/960271851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-15T22:11:43.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:43 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-09-15T22:11:43.575 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:43 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/960271851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-15T22:11:43.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:43 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-09-15T22:11:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:43 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/960271851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-15T22:11:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:43 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 -- 172.21.15.150:0/1659510563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0106f10 msgr2=0x7f22c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 --2- 172.21.15.150:0/1659510563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0106f10 0x7f22c010ea90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009ca0 tx=0x7f22b802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 -- 172.21.15.150:0/1659510563 shutdown_connections 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 --2- 172.21.15.150:0/1659510563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0106f10 0x7f22c010ea90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 --2- 172.21.15.150:0/1659510563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c0102790 0x7f22c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 --2- 172.21.15.150:0/1659510563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 0x7f22c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 -- 172.21.15.150:0/1659510563 >> 172.21.15.150:0/1659510563 conn(0x7f22c00fd8c0 msgr2=0x7f22c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 -- 172.21.15.150:0/1659510563 shutdown_connections 2024-09-15T22:11:44.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.076+0000 7f22c7200640 1 -- 172.21.15.150:0/1659510563 wait complete. 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 Processor -- start 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 -- start start 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 0x7f22c019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 0x7f22c019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c0106f10 0x7f22c019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0111f70 con 0x7f22c0102790 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0111df0 con 0x7f22c0106f10 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22c7200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f22c01120f0 con 0x7f22c0101de0 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22b7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 0x7f22c019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:44.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.077+0000 7f22b7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 0x7f22c019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33354/0 (socket says 172.21.15.150:33354) 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 0x7f22c019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22b7400640 1 -- 172.21.15.150:0/2234003901 learned_addr learned my addr 172.21.15.150:0/2234003901 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22c5200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c0106f10 0x7f22c019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 -- 172.21.15.150:0/2234003901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c0106f10 msgr2=0x7f22c019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c0106f10 0x7f22c019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 -- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 msgr2=0x7f22c019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 0x7f22c019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 -- 172.21.15.150:0/2234003901 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c019f5d0 con 0x7f22c0101de0 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22b7400640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 0x7f22c019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bfe00640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 0x7f22c019a620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22b000e9f0 tx=0x7f22b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:44.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.078+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b000ccc0 con 0x7f22c0101de0 2024-09-15T22:11:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.079+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c019f8c0 con 0x7f22c0101de0 2024-09-15T22:11:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.079+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22b0010910 con 0x7f22c0101de0 2024-09-15T22:11:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.079+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0018960 con 0x7f22c0101de0 2024-09-15T22:11:44.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.079+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c01a71a0 con 0x7f22c0101de0 2024-09-15T22:11:44.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.080+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c01021c0 con 0x7f22c0101de0 2024-09-15T22:11:44.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.082+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f22b0010ac0 con 0x7f22c0101de0 2024-09-15T22:11:44.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.083+0000 7f22bd600640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22a40a32c0 0x7f22a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:44.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.083+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8285+0+0 (secure 0 0 0) 0x7f22b00cfe50 con 0x7f22c0101de0 2024-09-15T22:11:44.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.083+0000 7f22b7400640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22a40a32c0 0x7f22a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:44.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.084+0000 7f22b7400640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22a40a32c0 0x7f22a40a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22c00fddc0 tx=0x7f22a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:44.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.085+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22b009c490 con 0x7f22c0101de0 2024-09-15T22:11:44.300 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.299+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22c01a73a0 con 0x7f22c0101de0 2024-09-15T22:11:44.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.300+0000 7f22bd600640 1 -- 172.21.15.150:0/2234003901 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11997 (secure 0 0 0) 0x7f22b00a0790 con 0x7f22c0101de0 2024-09-15T22:11:44.302 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:44.302 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":27,"btime":"2024-09-15T22:10:10:787282+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:10:10.787262+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:11:44.303 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 27 2024-09-15T22:11:44.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22a40a32c0 msgr2=0x7f22a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:44.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22a40a32c0 0x7f22a40a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22c00fddc0 tx=0x7f22a8005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:44.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 msgr2=0x7f22c019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:44.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 0x7f22c019a620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22b000e9f0 tx=0x7f22b000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.304 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 shutdown_connections 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c0106f10 0x7f22c019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f22a40a32c0 0x7f22a40a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22c0102790 0x7f22c019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 --2- 172.21.15.150:0/2234003901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22c0101de0 0x7f22c019a620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 >> 172.21.15.150:0/2234003901 conn(0x7f22c00fd8c0 msgr2=0x7f22c00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 shutdown_connections 2024-09-15T22:11:44.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:44.302+0000 7f22c7200640 1 -- 172.21.15.150:0/2234003901 wait complete. 2024-09-15T22:11:44.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:44 smithi150 ceph-mon[30886]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:44.671 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-15T22:11:44.671 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-09-15T22:11:44.671 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:44 smithi150 ceph-mon[30886]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:11:44.671 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:44 smithi150 ceph-mon[30886]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:11:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:44 smithi169 ceph-mon[35850]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-15T22:11:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-09-15T22:11:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:44 smithi169 ceph-mon[35850]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:11:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:44 smithi169 ceph-mon[35850]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:11:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:44 smithi154 ceph-mon[34853]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:11:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-15T22:11:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-09-15T22:11:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:44 smithi154 ceph-mon[34853]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:11:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:44 smithi154 ceph-mon[34853]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:11:45.128 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:11:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:45 smithi150 ceph-mon[30886]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:11:45.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:45 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2234003901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:45.499 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:45 smithi169 ceph-mon[35850]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:11:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:45 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2234003901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:45 smithi154 ceph-mon[34853]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:11:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:45 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2234003901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 -- 172.21.15.150:0/2041169405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24041047e0 msgr2=0x7f2404108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 --2- 172.21.15.150:0/2041169405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24041047e0 0x7f2404108830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 -- 172.21.15.150:0/2041169405 shutdown_connections 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 --2- 172.21.15.150:0/2041169405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404108f60 0x7f2404110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 --2- 172.21.15.150:0/2041169405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24041047e0 0x7f2404108830 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 --2- 172.21.15.150:0/2041169405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404103e30 0x7f2404104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.068+0000 7f2409200640 1 -- 172.21.15.150:0/2041169405 >> 172.21.15.150:0/2041169405 conn(0x7f24040ff8d0 msgr2=0x7f2404101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.069+0000 7f2409200640 1 -- 172.21.15.150:0/2041169405 shutdown_connections 2024-09-15T22:11:46.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.069+0000 7f2409200640 1 -- 172.21.15.150:0/2041169405 wait complete. 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 Processor -- start 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 -- start start 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404103e30 0x7f240419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 0x7f240419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404108f60 0x7f240419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2404113fc0 con 0x7f2404108f60 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2404113e40 con 0x7f2404103e30 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2409200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2404114140 con 0x7f24041047e0 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2402a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 0x7f240419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2402a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 0x7f240419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40416/0 (socket says 172.21.15.150:40416) 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2402a00640 1 -- 172.21.15.150:0/780859511 learned_addr learned my addr 172.21.15.150:0/780859511 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:46.073 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.070+0000 7f2403e00640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404108f60 0x7f240419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2403400640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404103e30 0x7f240419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2402a00640 1 -- 172.21.15.150:0/780859511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404103e30 msgr2=0x7f240419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2402a00640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404103e30 0x7f240419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2402a00640 1 -- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404108f60 msgr2=0x7f240419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2402a00640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404108f60 0x7f240419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2402a00640 1 -- 172.21.15.150:0/780859511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240419f480 con 0x7f24041047e0 2024-09-15T22:11:46.074 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2403e00640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404108f60 0x7f240419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:46.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.071+0000 7f2402a00640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 0x7f240419aa10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006010 tx=0x7f23f00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:46.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.072+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f003f030 con 0x7f24041047e0 2024-09-15T22:11:46.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.072+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240419f710 con 0x7f24041047e0 2024-09-15T22:11:46.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.072+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041a7050 con 0x7f24041047e0 2024-09-15T22:11:46.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.072+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f0003ce0 con 0x7f24041047e0 2024-09-15T22:11:46.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.072+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0049060 con 0x7f24041047e0 2024-09-15T22:11:46.076 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.073+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2404104210 con 0x7f24041047e0 2024-09-15T22:11:46.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.075+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f23f0042030 con 0x7f24041047e0 2024-09-15T22:11:46.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.077+0000 7f23fbe00640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23e80a32c0 0x7f23e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:46.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.077+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f23f00efc60 con 0x7f24041047e0 2024-09-15T22:11:46.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.077+0000 7f2403400640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23e80a32c0 0x7f23e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:46.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.077+0000 7f2403400640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23e80a32c0 0x7f23e80a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009bd0 tx=0x7f23f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:46.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.078+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23f00bc2a0 con 0x7f24041047e0 2024-09-15T22:11:46.257 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.255+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f240419b830 con 0x7f24041047e0 2024-09-15T22:11:46.258 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.256+0000 7f23fbe00640 1 -- 172.21.15.150:0/780859511 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22912 (secure 0 0 0) 0x7f240419b830 con 0x7f24041047e0 2024-09-15T22:11:46.259 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:11:46.259 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":84,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:11:44.269746+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8},{"from":3,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:11:46.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23e80a32c0 msgr2=0x7f23e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:46.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23e80a32c0 0x7f23e80a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009bd0 tx=0x7f23f4005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 msgr2=0x7f240419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 0x7f240419aa10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006010 tx=0x7f23f00042f0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 shutdown_connections 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f23e80a32c0 0x7f23e80a5780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2404108f60 0x7f240419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24041047e0 0x7f240419aa10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 --2- 172.21.15.150:0/780859511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2404103e30 0x7f240419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.259+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 >> 172.21.15.150:0/780859511 conn(0x7f24040ff8d0 msgr2=0x7f2404100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.260+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 shutdown_connections 2024-09-15T22:11:46.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:46.260+0000 7f2409200640 1 -- 172.21.15.150:0/780859511 wait complete. 2024-09-15T22:11:46.638 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:46 smithi150 ceph-mon[30886]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-15T22:11:46.639 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:46 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/780859511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:11:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:46 smithi169 ceph-mon[35850]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-15T22:11:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:46 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/780859511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:11:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:46 smithi154 ceph-mon[34853]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-15T22:11:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:46 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/780859511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:11:47.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:09:57.693830+0000', 'modified': '2024-09-15T22:10:10.787262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24578, 'mds_1': 24539, 'mds_2': 24523, 'mds_3': 24512, 'mds_4': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14535': {'gid': 14535, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.150:6841/1726301246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6840', 'nonce': 1726301246}, {'type': 'v1', 'addr': '172.21.15.150:6841', 'nonce': 1726301246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6833/2170086704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 2170086704}, {'type': 'v1', 'addr': '172.21.15.169:6833', 'nonce': 2170086704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/1449001850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 1449001850}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 1449001850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.150:6835/3135790520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 3135790520}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 3135790520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/721825855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 721825855}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 721825855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.169:6837/2204560239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2204560239}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2204560239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.154:6835/2752652039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2752652039}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2752652039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.169:6839/2442112974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 2442112974}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 2442112974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.154:6837/1010193359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 1010193359}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1010193359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/2093141507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 2093141507}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 2093141507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24578, 'qdb_cluster': [24578, 24539, 24523, 24512, 24508]} 2024-09-15T22:11:47.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-15T22:11:47.141 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:11:47.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:47 smithi150 ceph-mon[30886]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:47.512 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:47 smithi169 ceph-mon[35850]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:47 smithi154 ceph-mon[34853]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 -- 172.21.15.150:0/2883423285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8101de0 msgr2=0x7f68e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 --2- 172.21.15.150:0/2883423285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8101de0 0x7f68e81021c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009900 tx=0x7f68d802a410 comp rx=0 tx=0).stop 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 -- 172.21.15.150:0/2883423285 shutdown_connections 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 --2- 172.21.15.150:0/2883423285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8106f10 0x7f68e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 --2- 172.21.15.150:0/2883423285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8102790 0x7f68e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 --2- 172.21.15.150:0/2883423285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8101de0 0x7f68e81021c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.078+0000 7f68ee400640 1 -- 172.21.15.150:0/2883423285 >> 172.21.15.150:0/2883423285 conn(0x7f68e80fd8c0 msgr2=0x7f68e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.079+0000 7f68ee400640 1 -- 172.21.15.150:0/2883423285 shutdown_connections 2024-09-15T22:11:48.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.079+0000 7f68ee400640 1 -- 172.21.15.150:0/2883423285 wait complete. 2024-09-15T22:11:48.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.079+0000 7f68ee400640 1 Processor -- start 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 -- start start 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 0x7f68e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8102790 0x7f68e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8106f10 0x7f68e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f68e8111fc0 con 0x7f68e8106f10 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68e8111e40 con 0x7f68e8102790 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68ee400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68e8112140 con 0x7f68e8101de0 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68e7400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 0x7f68e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68e7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8106f10 0x7f68e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68e7400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 0x7f68e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40428/0 (socket says 172.21.15.150:40428) 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68e7400640 1 -- 172.21.15.150:0/2046565428 learned_addr learned my addr 172.21.15.150:0/2046565428 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:48.083 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.080+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8102790 0x7f68e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7e00640 1 -- 172.21.15.150:0/2046565428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 msgr2=0x7f68e80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7e00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 0x7f68e80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7e00640 1 -- 172.21.15.150:0/2046565428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8102790 msgr2=0x7f68e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7e00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8102790 0x7f68e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7e00640 1 -- 172.21.15.150:0/2046565428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e81a6900 con 0x7f68e8106f10 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 0x7f68e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8102790 0x7f68e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68e7e00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8106f10 0x7f68e8074f70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009fd0 tx=0x7f68e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68dfe00640 1 -- 172.21.15.150:0/2046565428 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e000ce20 con 0x7f68e8106f10 2024-09-15T22:11:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68dfe00640 1 -- 172.21.15.150:0/2046565428 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68e0005020 con 0x7f68e8106f10 2024-09-15T22:11:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e81a6bf0 con 0x7f68e8106f10 2024-09-15T22:11:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.081+0000 7f68dfe00640 1 -- 172.21.15.150:0/2046565428 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0010720 con 0x7f68e8106f10 2024-09-15T22:11:48.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.082+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e81a7130 con 0x7f68e8106f10 2024-09-15T22:11:48.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.084+0000 7f68dfe00640 1 -- 172.21.15.150:0/2046565428 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f68e0005540 con 0x7f68e8106f10 2024-09-15T22:11:48.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 Processor -- start 2024-09-15T22:11:48.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 -- start start 2024-09-15T22:11:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98aebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98aee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560e98a470b0 con 0x560e98ae1330 2024-09-15T22:11:48.087 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e989eeab0 con 0x560e98aec510 2024-09-15T22:11:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e98a43070 con 0x560e98ae1c50 2024-09-15T22:11:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68e7400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98aebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.085+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33404/0 (socket says 172.21.15.150:33404) 2024-09-15T22:11:48.088 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e6a00640 1 -- 172.21.15.150:0/4281145041 learned_addr learned my addr 172.21.15.150:0/4281145041 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e6a00640 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98aee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.089 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e7400640 1 -- 172.21.15.150:0/4281145041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 msgr2=0x560e98aee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e7400640 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98aee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e7400640 1 -- 172.21.15.150:0/4281145041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 msgr2=0x560e98ae1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e7400640 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e7400640 1 -- 172.21.15.150:0/4281145041 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e989fb4a0 con 0x560e98ae1c50 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e6a00640 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68dfe00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f68cc0a32c0 0x7f68cc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68dfe00640 1 -- 172.21.15.150:0/2046565428 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f68e00cff60 con 0x7f68e8106f10 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e7400640 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98aebfd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68d8031550 tx=0x7f68d8005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0ff91e151e0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.086+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f68cc0a32c0 0x7f68cc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.087+0000 7f68dcc00640 1 -- 172.21.15.150:0/4281145041 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8040070 con 0x560e98ae1c50 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.087+0000 7f68dcc00640 1 -- 172.21.15.150:0/4281145041 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d80047a0 con 0x560e98ae1c50 2024-09-15T22:11:48.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.087+0000 7f68dcc00640 1 -- 172.21.15.150:0/4281145041 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8035040 con 0x560e98ae1c50 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.087+0000 7f68f0e6e740 1 -- 172.21.15.150:0/4281145041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 msgr2=0x560e98aebfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.087+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f68cc0a32c0 0x7f68cc0a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x560e98adec40 tx=0x7f68d4009c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.087+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98aebfd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68d8031550 tx=0x7f68d8005dd0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 -- 172.21.15.150:0/4281145041 shutdown_connections 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98aee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98aebfd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/4281145041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 -- 172.21.15.150:0/4281145041 >> 172.21.15.150:0/4281145041 conn(0x560e98add8c0 msgr2=0x560e98addca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 -- 172.21.15.150:0/4281145041 shutdown_connections 2024-09-15T22:11:48.091 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 -- 172.21.15.150:0/4281145041 wait complete. 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 -- start start 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.088+0000 7f68f0e6e740 1 Processor -- start 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98ae1c50 0x560e98ae9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98aec510 0x560e98ae9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560e98aef060 con 0x560e98ae1330 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e989cf920 con 0x560e98ae1c50 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e98aef1e0 con 0x560e98aec510 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68f0e6e740 10 client.0 _ll_register_callbacks cb 0x560e989f38a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68e7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.094 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98ae1c50 0x560e98ae9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68e7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33420/0 (socket says 172.21.15.150:33420) 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68e7400640 1 -- 172.21.15.150:0/3141488054 learned_addr learned my addr 172.21.15.150:0/3141488054 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.089+0000 7f68e7e00640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98aec510 0x560e98ae9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7400640 1 -- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98aec510 msgr2=0x560e98ae9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7400640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98aec510 0x560e98ae9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7400640 1 -- 172.21.15.150:0/3141488054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98ae1c50 msgr2=0x560e98ae9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7400640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98ae1c50 0x560e98ae9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7400640 1 -- 172.21.15.150:0/3141488054 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e987b82b0 con 0x560e98ae1330 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e6a00640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98ae1c50 0x560e98ae9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7e00640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98aec510 0x560e98ae9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68e7400640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae9510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68d80057c0 tx=0x7f68d80317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbd19a492ca3e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68d1600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68d1600640 1 -- 172.21.15.150:0/3141488054 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8040070 con 0x560e98ae1330 2024-09-15T22:11:48.095 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d80047a0 con 0x560e98ae1330 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68d1600640 1 -- 172.21.15.150:0/3141488054 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f68d8031de0 con 0x560e98ae1330 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68d1600640 1 -- 172.21.15.150:0/3141488054 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68d8035040 con 0x560e98ae1330 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68f0e6e740 10 client.15045 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.090+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560e98afae50 con 0x560e98ae1330 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68d1600640 1 -- 172.21.15.150:0/3141488054 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d80047a0 con 0x560e98ae1330 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68d1600640 1 -- 172.21.15.150:0/3141488054 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f68d803c7e0 con 0x560e98ae1330 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68f0e6e740 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68f0e6e740 10 client.15045 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68f0e6e740 20 client.15045 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98afcf90 0x560e98afe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68f0e6e740 4 client.15045 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:48.096 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.091+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 --> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e98a54620 con 0x560e98afcf90 2024-09-15T22:11:48.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.092+0000 7f68e6a00640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98afcf90 0x560e98afe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.092+0000 7f68e6a00640 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98afcf90 0x560e98afe400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a651aae25e0fc31e server_cookie=d70a2279589590b0 in_seq=0 out_seq=0 2024-09-15T22:11:48.097 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.092+0000 7f68d1600640 10 client.15045 ms_handle_connect on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68d1600640 1 -- 172.21.15.150:0/3141488054 <== mds.4 v2:172.21.15.169:6836/2204560239 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e98a54620 con 0x560e98afcf90 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68d1600640 10 client.15045 handle_command_reply: tid=0 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 client.15045 shutdown 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 msgr2=0x560e98ae9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae9510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68d80057c0 tx=0x7f68d80317e0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 shutdown_connections 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98aec510 0x560e98ae9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98ae1c50 0x560e98ae9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98afcf90 0x560e98afe400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/3141488054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98ae9510 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 >> 172.21.15.150:0/3141488054 conn(0x560e98add8c0 msgr2=0x560e98ae35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68d1600640 0 client.15045 ms_handle_reset on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 shutdown_connections 2024-09-15T22:11:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.093+0000 7f68f0e6e740 1 -- 172.21.15.150:0/3141488054 wait complete. 2024-09-15T22:11:48.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.094+0000 7f68f0e6e740 20 client.15045 trim_cache size 0 max 16384 2024-09-15T22:11:48.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.112+0000 7f68f0e6e740 1 Processor -- start 2024-09-15T22:11:48.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.112+0000 7f68f0e6e740 1 -- start start 2024-09-15T22:11:48.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.112+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1330 0x560e98afd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.112+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 0x560e98afc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.112+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98ae3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560e98afc740 con 0x560e98ae1c50 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e98afce10 con 0x560e98aec510 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e98afd4e0 con 0x560e98ae1330 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 0x560e98afc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 0x560e98afc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33430/0 (socket says 172.21.15.150:33430) 2024-09-15T22:11:48.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 -- 172.21.15.150:0/2035174504 learned_addr learned my addr 172.21.15.150:0/2035174504 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:48.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e7e00640 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98ae3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 -- 172.21.15.150:0/2035174504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1330 msgr2=0x560e98afd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1330 0x560e98afd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 -- 172.21.15.150:0/2035174504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 msgr2=0x560e98ae3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98ae3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 -- 172.21.15.150:0/2035174504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e98aebe80 con 0x560e98ae1c50 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.113+0000 7f68e6a00640 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 0x560e98afc8c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x560e98ae8da0 tx=0x7f68d4012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b0201983591e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68d3e00640 1 -- 172.21.15.150:0/2035174504 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4013560 con 0x560e98ae1c50 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68d3e00640 1 -- 172.21.15.150:0/2035174504 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d4013210 con 0x560e98ae1c50 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68d3e00640 1 -- 172.21.15.150:0/2035174504 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4005640 con 0x560e98ae1c50 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 -- 172.21.15.150:0/2035174504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 msgr2=0x560e98afc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 0x560e98afc8c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x560e98ae8da0 tx=0x7f68d4012040 comp rx=0 tx=0).stop 2024-09-15T22:11:48.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 -- 172.21.15.150:0/2035174504 shutdown_connections 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98ae3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1c50 0x560e98afc8c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/2035174504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1330 0x560e98afd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.114+0000 7f68f0e6e740 1 -- 172.21.15.150:0/2035174504 >> 172.21.15.150:0/2035174504 conn(0x560e98add8c0 msgr2=0x560e98ae7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.115+0000 7f68f0e6e740 1 -- 172.21.15.150:0/2035174504 shutdown_connections 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.115+0000 7f68f0e6e740 1 -- 172.21.15.150:0/2035174504 wait complete. 2024-09-15T22:11:48.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.115+0000 7f68f0e6e740 1 -- start start 2024-09-15T22:11:48.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.115+0000 7f68f0e6e740 1 Processor -- start 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98aff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98affb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98b00080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560e98afe280 con 0x560e98ae1330 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e98afdbb0 con 0x560e98aec510 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e98afe950 con 0x560e98ae1c50 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68f0e6e740 10 client.0 _ll_register_callbacks cb 0x7f68d8009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98affb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98aff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98affb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40462/0 (socket says 172.21.15.150:40462) 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 -- 172.21.15.150:0/1087439328 learned_addr learned my addr 172.21.15.150:0/1087439328 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:48.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e7e00640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98b00080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 -- 172.21.15.150:0/1087439328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 msgr2=0x560e98b00080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98b00080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 -- 172.21.15.150:0/1087439328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 msgr2=0x560e98aff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98aff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e6a00640 1 -- 172.21.15.150:0/1087439328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e98b65690 con 0x560e98ae1c50 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e7e00640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98b00080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.116+0000 7f68e7400640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98aff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68e6a00640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98affb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009710 tx=0x7f68d4013560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6813a0fda10ff4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68d1600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68d1600640 1 -- 172.21.15.150:0/1087439328 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4005580 con 0x560e98ae1c50 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d4013210 con 0x560e98ae1c50 2024-09-15T22:11:48.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68d1600640 1 -- 172.21.15.150:0/1087439328 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f68d402a040 con 0x560e98ae1c50 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68d1600640 1 -- 172.21.15.150:0/1087439328 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68d4003ac0 con 0x560e98ae1c50 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68f0e6e740 10 client.25051 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.117+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560e98b66840 con 0x560e98ae1c50 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68d1600640 1 -- 172.21.15.150:0/1087439328 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d4013210 con 0x560e98ae1c50 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68d1600640 1 -- 172.21.15.150:0/1087439328 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f68d4023420 con 0x560e98ae1c50 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68f0e6e740 10 client.25051 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68f0e6e740 10 client.25051 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68f0e6e740 20 client.25051 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98b6b0e0 0x560e98b69df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68f0e6e740 4 client.25051 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 --> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] -- command(tid 0: {"prefix": "status"}) -- 0x560e98a4eb30 con 0x560e98b6b0e0 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.118+0000 7f68e7400640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98b6b0e0 0x560e98b69df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:48.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68e7400640 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98b6b0e0 0x560e98b69df0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=74de51788bf5f674 server_cookie=51ade7f799fa0e6c in_seq=0 out_seq=0 2024-09-15T22:11:48.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68d1600640 10 client.25051 ms_handle_connect on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:48.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68d1600640 1 -- 172.21.15.150:0/1087439328 <== mds.4 v2:172.21.15.169:6836/2204560239 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560e98a4eb30 con 0x560e98b6b0e0 2024-09-15T22:11:48.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68d1600640 10 client.25051 handle_command_reply: tid=0 2024-09-15T22:11:48.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 client.25051 shutdown 2024-09-15T22:11:48.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 msgr2=0x560e98affb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98affb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009710 tx=0x7f68d4013560 comp rx=0 tx=0).stop 2024-09-15T22:11:48.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 shutdown_connections 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e98aec510 0x560e98b00080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e98ae1c50 0x560e98affb40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.169:6836/2204560239,v1:172.21.15.169:6837/2204560239] conn(0x560e98b6b0e0 0x560e98b69df0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 --2- 172.21.15.150:0/1087439328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e98ae1330 0x560e98aff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68d1600640 0 client.25051 ms_handle_reset on v2:172.21.15.169:6836/2204560239 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.119+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 >> 172.21.15.150:0/1087439328 conn(0x560e98add8c0 msgr2=0x560e98af7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 shutdown_connections 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68f0e6e740 1 -- 172.21.15.150:0/1087439328 wait complete. 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68f0e6e740 20 client.25051 trim_cache size 0 max 16384 2024-09-15T22:11:48.126 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 4, 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24508, 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 98.340390528, 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 84, 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 139.10374162700001 2024-09-15T22:11:48.127 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f68cc0a32c0 msgr2=0x7f68cc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68ee400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f68cc0a32c0 0x7f68cc0a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x560e98adec40 tx=0x7f68d4009c00 comp rx=0 tx=0).stop 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8106f10 msgr2=0x7f68e8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.120+0000 7f68ee400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8106f10 0x7f68e8074f70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009fd0 tx=0x7f68e000ef10 comp rx=0 tx=0).stop 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 shutdown_connections 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f68cc0a32c0 0x7f68cc0a5780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e8106f10 0x7f68e8074f70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68e8102790 0x7f68e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 --2- 172.21.15.150:0/2046565428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68e8101de0 0x7f68e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 >> 172.21.15.150:0/2046565428 conn(0x7f68e80fd8c0 msgr2=0x7f68e80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 shutdown_connections 2024-09-15T22:11:48.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:48.121+0000 7f68ee400640 1 -- 172.21.15.150:0/2046565428 wait complete. 2024-09-15T22:11:48.931 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-15T22:11:49.301 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:49.843 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 -- 172.21.15.150:0/731018987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 msgr2=0x7f4ee0110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/731018987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee0110cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009be0 tx=0x7f4ed802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 -- 172.21.15.150:0/731018987 shutdown_connections 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/731018987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee0110cc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/731018987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee01049c0 0x7f4ee0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/731018987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee0104010 0x7f4ee01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 -- 172.21.15.150:0/731018987 >> 172.21.15.150:0/731018987 conn(0x7f4ee00ffa50 msgr2=0x7f4ee0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 -- 172.21.15.150:0/731018987 shutdown_connections 2024-09-15T22:11:49.844 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.841+0000 7f4ee4c00640 1 -- 172.21.15.150:0/731018987 wait complete. 2024-09-15T22:11:49.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.842+0000 7f4ee4c00640 1 Processor -- start 2024-09-15T22:11:49.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.842+0000 7f4ee4c00640 1 -- start start 2024-09-15T22:11:49.845 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ee4c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 0x7f4ee019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ee4c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee01049c0 0x7f4ee019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ee4c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ee4c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee0114170 con 0x7f4ee0109140 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ee4c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee0113ff0 con 0x7f4ee0104010 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ee4c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee01142f0 con 0x7f4ee01049c0 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4edde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 0x7f4ee019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4edde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 0x7f4ee019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36546/0 (socket says 172.21.15.150:36546) 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4edde00640 1 -- 172.21.15.150:0/3584557960 learned_addr learned my addr 172.21.15.150:0/3584557960 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ede800640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.843+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee01049c0 0x7f4ee019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4edde00640 1 -- 172.21.15.150:0/3584557960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee01049c0 msgr2=0x7f4ee019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.846 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4edde00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee01049c0 0x7f4ee019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4edde00640 1 -- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 msgr2=0x7f4ee019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4edde00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4edde00640 1 -- 172.21.15.150:0/3584557960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee019f600 con 0x7f4ee0104010 2024-09-15T22:11:49.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4ede800640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:49.847 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4edde00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 0x7f4ee019a650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000e9f0 tx=0x7f4ed000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:49.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4ed6a00640 1 -- 172.21.15.150:0/3584557960 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000ccc0 con 0x7f4ee0104010 2024-09-15T22:11:49.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee019f8f0 con 0x7f4ee0104010 2024-09-15T22:11:49.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4ed6a00640 1 -- 172.21.15.150:0/3584557960 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed0005500 con 0x7f4ee0104010 2024-09-15T22:11:49.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4ed6a00640 1 -- 172.21.15.150:0/3584557960 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0010690 con 0x7f4ee0104010 2024-09-15T22:11:49.848 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.844+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee01a71d0 con 0x7f4ee0104010 2024-09-15T22:11:49.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.847+0000 7f4ed6a00640 1 -- 172.21.15.150:0/3584557960 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f4ed00046c0 con 0x7f4ee0104010 2024-09-15T22:11:49.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.847+0000 7f4ee7682740 1 Processor -- start 2024-09-15T22:11:49.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 -- start start 2024-09-15T22:11:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 0x55880bb67710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb71fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb72510 0x55880bb74900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55880bacd0b0 con 0x55880bb67c50 2024-09-15T22:11:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55880ba74ab0 con 0x55880bb72510 2024-09-15T22:11:49.850 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ee7682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55880bac9070 con 0x55880bb67330 2024-09-15T22:11:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4edde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb71fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ede800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 0x55880bb67710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ede800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 0x55880bb67710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:42864/0 (socket says 172.21.15.150:42864) 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.848+0000 7f4ede800640 1 -- 172.21.15.150:0/117482160 learned_addr learned my addr 172.21.15.150:0/117482160 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb72510 0x55880bb74900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ede800640 1 -- 172.21.15.150:0/117482160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb72510 msgr2=0x55880bb74900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ede800640 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb72510 0x55880bb74900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ede800640 1 -- 172.21.15.150:0/117482160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 msgr2=0x55880bb71fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ede800640 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb71fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ede800640 1 -- 172.21.15.150:0/117482160 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55880ba814a0 con 0x55880bb67330 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ed6a00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4ec40a3240 0x7f4ec40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ed6a00640 1 -- 172.21.15.150:0/3584557960 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4ed00cfd10 con 0x7f4ee0104010 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4ede800640 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 0x55880bb67710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ed802acb0 tx=0x7f4ed8030ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8766588b02e70f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:49.852 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.849+0000 7f4edde00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4ec40a3240 0x7f4ec40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.850+0000 7f4ecf000640 1 -- 172.21.15.150:0/117482160 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8040030 con 0x55880bb67330 2024-09-15T22:11:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.850+0000 7f4ecf000640 1 -- 172.21.15.150:0/117482160 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed8030d60 con 0x55880bb67330 2024-09-15T22:11:49.853 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.850+0000 7f4ecf000640 1 -- 172.21.15.150:0/117482160 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8036040 con 0x55880bb67330 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.850+0000 7f4ee7682740 1 -- 172.21.15.150:0/117482160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 msgr2=0x55880bb67710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.850+0000 7f4edde00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4ec40a3240 0x7f4ec40a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0098c70 tx=0x7f4ed00d3750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.850+0000 7f4ee7682740 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 0x55880bb67710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ed802acb0 tx=0x7f4ed8030ab0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 -- 172.21.15.150:0/117482160 shutdown_connections 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb72510 0x55880bb74900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb71fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 --2- 172.21.15.150:0/117482160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67330 0x55880bb67710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 -- 172.21.15.150:0/117482160 >> 172.21.15.150:0/117482160 conn(0x55880bb638c0 msgr2=0x55880bb63ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 -- 172.21.15.150:0/117482160 shutdown_connections 2024-09-15T22:11:49.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 -- 172.21.15.150:0/117482160 wait complete. 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 -- start start 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.851+0000 7f4ee7682740 1 Processor -- start 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 0x55880bb6f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67c50 0x55880bb6fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb70000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55880bb75060 con 0x55880bb67330 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55880ba55920 con 0x55880bb67c50 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55880bb751e0 con 0x55880bb72510 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ee7682740 10 client.0 _ll_register_callbacks cb 0x55880ba798a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ede800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 0x55880bb6f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ede800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 0x55880bb6f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47294/0 (socket says 172.21.15.150:47294) 2024-09-15T22:11:49.856 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ede800640 1 -- 172.21.15.150:0/3346897394 learned_addr learned my addr 172.21.15.150:0/3346897394 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ede800640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb70000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.852+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67c50 0x55880bb6fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ede800640 1 -- 172.21.15.150:0/3346897394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 msgr2=0x55880bb70000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ede800640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb70000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ede800640 1 -- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67c50 msgr2=0x55880bb6fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ede800640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67c50 0x55880bb6fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ede800640 1 -- 172.21.15.150:0/3346897394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55880b83e2b0 con 0x55880bb67330 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ede800640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 0x55880bb6f580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009bb0 tx=0x7f4ed8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8448d89203e3a370 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ec3400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ec3400640 1 -- 172.21.15.150:0/3346897394 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8036050 con 0x55880bb67330 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ec3400640 1 -- 172.21.15.150:0/3346897394 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4ed8003fa0 con 0x55880bb67330 2024-09-15T22:11:49.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed8030d60 con 0x55880bb67330 2024-09-15T22:11:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ec3400640 1 -- 172.21.15.150:0/3346897394 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ed8040040 con 0x55880bb67330 2024-09-15T22:11:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ee7682740 10 client.15063 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.853+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55880bb80e10 con 0x55880bb67330 2024-09-15T22:11:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ec3400640 1 -- 172.21.15.150:0/3346897394 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed8030d60 con 0x55880bb67330 2024-09-15T22:11:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ec3400640 1 -- 172.21.15.150:0/3346897394 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4ed8052070 con 0x55880bb67330 2024-09-15T22:11:49.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ee7682740 10 client.15063 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ee7682740 10 client.15063 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ee7682740 20 client.15063 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ee7682740 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bb82160 0x55880bb84340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ee7682740 4 client.15063 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 --> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55880bada620 con 0x55880bb82160 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.854+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bb82160 0x55880bb84340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.855+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bb82160 0x55880bb84340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c31a67d768c861c3 server_cookie=e05a4cfe8f843555 in_seq=0 out_seq=0 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.855+0000 7f4ec3400640 10 client.15063 ms_handle_connect on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ec3400640 1 -- 172.21.15.150:0/3346897394 <== mds.3 v2:172.21.15.154:6834/2752652039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55880bada620 con 0x55880bb82160 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ec3400640 10 client.15063 handle_command_reply: tid=0 2024-09-15T22:11:49.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 client.15063 shutdown 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 msgr2=0x55880bb6f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 0x55880bb6f580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009bb0 tx=0x7f4ed8003f10 comp rx=0 tx=0).stop 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 shutdown_connections 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bb82160 0x55880bb84340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb70000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67c50 0x55880bb6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 --2- 172.21.15.150:0/3346897394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67330 0x55880bb6f580 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 >> 172.21.15.150:0/3346897394 conn(0x55880bb638c0 msgr2=0x55880bb695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ec3400640 0 client.15063 ms_handle_reset on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 shutdown_connections 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 1 -- 172.21.15.150:0/3346897394 wait complete. 2024-09-15T22:11:49.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.856+0000 7f4ee7682740 20 client.15063 trim_cache size 0 max 16384 2024-09-15T22:11:49.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 Processor -- start 2024-09-15T22:11:49.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 -- start start 2024-09-15T22:11:49.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb6e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.878 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67c50 0x55880bb6c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb72510 0x55880bb6cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55880bb82680 con 0x55880bb72510 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55880bb82d50 con 0x55880bb67330 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.875+0000 7f4ee7682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55880bb83420 con 0x55880bb67c50 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb6e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb6e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36578/0 (socket says 172.21.15.150:36578) 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 -- 172.21.15.150:0/410242074 learned_addr learned my addr 172.21.15.150:0/410242074 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67c50 0x55880bb6c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb72510 0x55880bb6cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 -- 172.21.15.150:0/410242074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67c50 msgr2=0x55880bb6c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67c50 0x55880bb6c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 -- 172.21.15.150:0/410242074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb72510 msgr2=0x55880bb6cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.879 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb72510 0x55880bb6cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 -- 172.21.15.150:0/410242074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55880bb71ef0 con 0x55880bb67330 2024-09-15T22:11:49.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.876+0000 7f4ede800640 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb6e580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8005d70 tx=0x7f4ed802a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a798e643b009d31d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:49.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ece600640 1 -- 172.21.15.150:0/410242074 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8036070 con 0x55880bb67330 2024-09-15T22:11:49.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ece600640 1 -- 172.21.15.150:0/410242074 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed804a070 con 0x55880bb67330 2024-09-15T22:11:49.880 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ece600640 1 -- 172.21.15.150:0/410242074 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8057040 con 0x55880bb67330 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 -- 172.21.15.150:0/410242074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 msgr2=0x55880bb6e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb6e580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8005d70 tx=0x7f4ed802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 -- 172.21.15.150:0/410242074 shutdown_connections 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb72510 0x55880bb6cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb67c50 0x55880bb6c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 --2- 172.21.15.150:0/410242074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb6e580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 -- 172.21.15.150:0/410242074 >> 172.21.15.150:0/410242074 conn(0x55880bb638c0 msgr2=0x55880bb6de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 -- 172.21.15.150:0/410242074 shutdown_connections 2024-09-15T22:11:49.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.877+0000 7f4ee7682740 1 -- 172.21.15.150:0/410242074 wait complete. 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 -- start start 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 Processor -- start 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb87260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb87ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55880bb841c0 con 0x55880bb67c50 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55880bb83af0 con 0x55880bb67330 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.878+0000 7f4ee7682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55880bb84890 con 0x55880bb72510 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ee7682740 10 client.0 _ll_register_callbacks cb 0x7f4ed0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ede800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb87260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb877a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47306/0 (socket says 172.21.15.150:47306) 2024-09-15T22:11:49.884 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 -- 172.21.15.150:0/2722451343 learned_addr learned my addr 172.21.15.150:0/2722451343 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ede800640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb87ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 -- 172.21.15.150:0/2722451343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 msgr2=0x55880bb87ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb87ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 -- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 msgr2=0x55880bb87260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb87260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 -- 172.21.15.150:0/2722451343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55880bb8c330 con 0x55880bb67c50 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ede800640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb87260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ed7e00640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb877a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55880bb64c40 tx=0x7f4ec8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b56fc848a5e8226 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.879+0000 7f4ec3400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ec3400640 1 -- 172.21.15.150:0/2722451343 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8004250 con 0x55880bb67c50 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ec3400640 1 -- 172.21.15.150:0/2722451343 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4ec80043f0 con 0x55880bb67c50 2024-09-15T22:11:49.885 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed804a070 con 0x55880bb67c50 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ec3400640 1 -- 172.21.15.150:0/2722451343 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ec8020cd0 con 0x55880bb67c50 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ee7682740 10 client.15069 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55880bbed9c0 con 0x55880bb67c50 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ec3400640 1 -- 172.21.15.150:0/2722451343 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed804a070 con 0x55880bb67c50 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.880+0000 7f4ec3400640 1 -- 172.21.15.150:0/2722451343 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4ec80317d0 con 0x55880bb67c50 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ee7682740 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ee7682740 10 client.15069 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ee7682740 20 client.15069 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ee7682740 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bbf2580 0x55880bbf1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ee7682740 4 client.15069 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 --> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] -- command(tid 0: {"prefix": "status"}) -- 0x55880bad4b30 con 0x55880bbf2580 2024-09-15T22:11:49.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ede800640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bbf2580 0x55880bbf1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:49.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ede800640 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bbf2580 0x55880bbf1290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c6cb998ba66fdfa server_cookie=cfaba2315b9f9c51 in_seq=0 out_seq=0 2024-09-15T22:11:49.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.881+0000 7f4ec3400640 10 client.15069 ms_handle_connect on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ec3400640 1 -- 172.21.15.150:0/2722451343 <== mds.3 v2:172.21.15.154:6834/2752652039 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55880bad4b30 con 0x55880bbf2580 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ec3400640 10 client.15069 handle_command_reply: tid=0 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 client.15069 shutdown 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 msgr2=0x55880bb877a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb877a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55880bb64c40 tx=0x7f4ec8009ca0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 shutdown_connections 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:6834/2752652039,v1:172.21.15.154:6835/2752652039] conn(0x55880bbf2580 0x55880bbf1290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55880bb72510 0x55880bb87ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55880bb67c50 0x55880bb877a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 --2- 172.21.15.150:0/2722451343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55880bb67330 0x55880bb87260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.888 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ec3400640 0 client.15069 ms_handle_reset on v2:172.21.15.154:6834/2752652039 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 >> 172.21.15.150:0/2722451343 conn(0x55880bb638c0 msgr2=0x55880bb6e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 shutdown_connections 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 1 -- 172.21.15.150:0/2722451343 wait complete. 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.882+0000 7f4ee7682740 20 client.15069 trim_cache size 0 max 16384 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 3, 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24512, 2024-09-15T22:11:49.889 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 101.117711734, 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 84, 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 145.78643767299999 2024-09-15T22:11:49.890 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4ec40a3240 msgr2=0x7f4ec40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4ec40a3240 0x7f4ec40a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0098c70 tx=0x7f4ed00d3750 comp rx=0 tx=0).stop 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 msgr2=0x7f4ee019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 0x7f4ee019a650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000e9f0 tx=0x7f4ed000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 shutdown_connections 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4ec40a3240 0x7f4ec40a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ee0109140 0x7f4ee019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee01049c0 0x7f4ee019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 --2- 172.21.15.150:0/3584557960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee0104010 0x7f4ee019a650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 >> 172.21.15.150:0/3584557960 conn(0x7f4ee00ffa50 msgr2=0x7f4ee0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 shutdown_connections 2024-09-15T22:11:49.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:49.883+0000 7f4ee4c00640 1 -- 172.21.15.150:0/3584557960 wait complete. 2024-09-15T22:11:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:50 smithi154 ceph-mon[34853]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:50.660 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:50 smithi150 ceph-mon[30886]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:50.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:11:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:50 smithi169 ceph-mon[35850]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:51.065 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 -- 172.21.15.150:0/4123484997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 msgr2=0x7f3e84104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/4123484997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 0x7f3e84104210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009860 tx=0x7f3e7802a340 comp rx=0 tx=0).stop 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 -- 172.21.15.150:0/4123484997 shutdown_connections 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/4123484997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e84108f60 0x7f3e84110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/4123484997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e841047e0 0x7f3e84108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/4123484997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 0x7f3e84104210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 -- 172.21.15.150:0/4123484997 >> 172.21.15.150:0/4123484997 conn(0x7f3e840ff8d0 msgr2=0x7f3e84101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:51.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 -- 172.21.15.150:0/4123484997 shutdown_connections 2024-09-15T22:11:51.619 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.616+0000 7f3e8ac00640 1 -- 172.21.15.150:0/4123484997 wait complete. 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.617+0000 7f3e8ac00640 1 Processor -- start 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.617+0000 7f3e8ac00640 1 -- start start 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8ac00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 0x7f3e8419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8ac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 0x7f3e8419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8ac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e84108f60 0x7f3e8419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8ac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84113fc0 con 0x7f3e841047e0 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8ac00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84113e40 con 0x7f3e84108f60 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8ac00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84114140 con 0x7f3e84103e30 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 0x7f3e8419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 0x7f3e8419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47316/0 (socket says 172.21.15.150:47316) 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 -- 172.21.15.150:0/3655337865 learned_addr learned my addr 172.21.15.150:0/3655337865 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:51.620 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8a200640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e84108f60 0x7f3e8419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e89800640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 0x7f3e8419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 -- 172.21.15.150:0/3655337865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 msgr2=0x7f3e8419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.621 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 0x7f3e8419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 -- 172.21.15.150:0/3655337865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e84108f60 msgr2=0x7f3e8419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e84108f60 0x7f3e8419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e88e00640 1 -- 172.21.15.150:0/3655337865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8419f450 con 0x7f3e841047e0 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.618+0000 7f3e8a200640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e84108f60 0x7f3e8419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.619+0000 7f3e88e00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 0x7f3e8419a9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000e9f0 tx=0x7f3e7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.619+0000 7f3e82000640 1 -- 172.21.15.150:0/3655337865 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000ccc0 con 0x7f3e841047e0 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.619+0000 7f3e82000640 1 -- 172.21.15.150:0/3655337865 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e70005500 con 0x7f3e841047e0 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.619+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8419f740 con 0x7f3e841047e0 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.619+0000 7f3e82000640 1 -- 172.21.15.150:0/3655337865 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70010690 con 0x7f3e841047e0 2024-09-15T22:11:51.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.619+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e841a7020 con 0x7f3e841047e0 2024-09-15T22:11:51.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.622+0000 7f3e82000640 1 -- 172.21.15.150:0/3655337865 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f3e700046c0 con 0x7f3e841047e0 2024-09-15T22:11:51.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.622+0000 7f3e8ee77740 1 Processor -- start 2024-09-15T22:11:51.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.622+0000 7f3e8ee77740 1 -- start start 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe0548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe05f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe061ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5580fdfba0b0 con 0x5580fe0544e0 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580fdf61ab0 con 0x5580fe05f6c0 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5580fdfb6070 con 0x5580fe054e00 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe0548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e89800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe05f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe0548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47324/0 (socket says 172.21.15.150:47324) 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 -- 172.21.15.150:0/2694790862 learned_addr learned my addr 172.21.15.150:0/2694790862 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:51.625 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e88e00640 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe061ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 -- 172.21.15.150:0/2694790862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 msgr2=0x5580fe05f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe05f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 -- 172.21.15.150:0/2694790862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 msgr2=0x5580fe061ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe061ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e8a200640 1 -- 172.21.15.150:0/2694790862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580fdf6e4a0 con 0x5580fe0544e0 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.623+0000 7f3e88e00640 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe061ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e82000640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3e6c0a3240 0x7f3e6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e8a200640 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe0548c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c011790 tx=0x7f3e7c011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1d204291f17223 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:51.627 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e82000640 1 -- 172.21.15.150:0/3655337865 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3e700cfd90 con 0x7f3e841047e0 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e76a00640 1 -- 172.21.15.150:0/2694790862 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c004d20 con 0x5580fe0544e0 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e76a00640 1 -- 172.21.15.150:0/2694790862 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e7c003970 con 0x5580fe0544e0 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e89800640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3e6c0a3240 0x7f3e6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.624+0000 7f3e76a00640 1 -- 172.21.15.150:0/2694790862 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0045c0 con 0x5580fe0544e0 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2694790862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 msgr2=0x5580fe0548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e89800640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3e6c0a3240 0x7f3e6c0a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e7802a930 tx=0x7f3e780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe0548c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c011790 tx=0x7f3e7c011c50 comp rx=0 tx=0).stop 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2694790862 shutdown_connections 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe061ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe05f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2694790862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe0548c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2694790862 >> 172.21.15.150:0/2694790862 conn(0x5580fe050a70 msgr2=0x5580fe050e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:51.628 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2694790862 shutdown_connections 2024-09-15T22:11:51.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.625+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2694790862 wait complete. 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 -- start start 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 Processor -- start 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe0544e0 0x5580fe05c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe054e00 0x5580fe05ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe05cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5580fe062330 con 0x5580fe05f6c0 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580fdf42920 con 0x5580fe054e00 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5580fe0624b0 con 0x5580fe0544e0 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.626+0000 7f3e8ee77740 10 client.0 _ll_register_callbacks cb 0x5580fdf668a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e8a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe05cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e8a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe05cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47330/0 (socket says 172.21.15.150:47330) 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e8a200640 1 -- 172.21.15.150:0/2524205975 learned_addr learned my addr 172.21.15.150:0/2524205975 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe054e00 0x5580fe05ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e89800640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe0544e0 0x5580fe05c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 -- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe0544e0 msgr2=0x5580fe05c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe0544e0 0x5580fe05c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 -- 172.21.15.150:0/2524205975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 msgr2=0x5580fe05cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe05cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 -- 172.21.15.150:0/2524205975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580fdd2b2b0 con 0x5580fe054e00 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e88e00640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe054e00 0x5580fe05ca80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5580fe051df0 tx=0x7f3e70098700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be28049d72047d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e6b400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.627+0000 7f3e6b400640 1 -- 172.21.15.150:0/2524205975 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e700a4dc0 con 0x5580fe054e00 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e6b400640 1 -- 172.21.15.150:0/2524205975 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3e7009b830 con 0x5580fe054e00 2024-09-15T22:11:51.632 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e7c003970 con 0x5580fe054e00 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e6b400640 1 -- 172.21.15.150:0/2524205975 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e7009cae0 con 0x5580fe054e00 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e8ee77740 10 client.25112 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580fe06e020 con 0x5580fe054e00 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e6b400640 1 -- 172.21.15.150:0/2524205975 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e7c003970 con 0x5580fe054e00 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.628+0000 7f3e6b400640 1 -- 172.21.15.150:0/2524205975 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3e70098130 con 0x5580fe054e00 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e8ee77740 10 client.25112 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e8ee77740 10 client.25112 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e8ee77740 20 client.25112 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0705c0 0x5580fe071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e8ee77740 4 client.25112 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 --> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580fdfc7620 con 0x5580fe0705c0 2024-09-15T22:11:51.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.629+0000 7f3e89800640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0705c0 0x5580fe071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.630+0000 7f3e6b400640 10 client.25112 ms_handle_connect on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:51.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.630+0000 7f3e89800640 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0705c0 0x5580fe071a30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d3cff8baa69310 server_cookie=4b43f59b8854e540 in_seq=0 out_seq=0 2024-09-15T22:11:51.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e6b400640 1 -- 172.21.15.150:0/2524205975 <== mds.2 v2:172.21.15.169:6838/2442112974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580fdfc7620 con 0x5580fe0705c0 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e6b400640 10 client.25112 handle_command_reply: tid=0 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 client.25112 shutdown 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe054e00 msgr2=0x5580fe05ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe054e00 0x5580fe05ca80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5580fe051df0 tx=0x7f3e70098700 comp rx=0 tx=0).stop 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 shutdown_connections 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe05cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe054e00 0x5580fe05ca80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0705c0 0x5580fe071a30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/2524205975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe0544e0 0x5580fe05c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e6b400640 0 client.25112 ms_handle_reset on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 >> 172.21.15.150:0/2524205975 conn(0x5580fe050a70 msgr2=0x5580fe056750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:51.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 shutdown_connections 2024-09-15T22:11:51.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.631+0000 7f3e8ee77740 1 -- 172.21.15.150:0/2524205975 wait complete. 2024-09-15T22:11:51.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.632+0000 7f3e8ee77740 20 client.25112 trim_cache size 0 max 16384 2024-09-15T22:11:51.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.650+0000 7f3e8ee77740 1 Processor -- start 2024-09-15T22:11:51.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.650+0000 7f3e8ee77740 1 -- start start 2024-09-15T22:11:51.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe0544e0 0x5580fe06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.652 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe056f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe0597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5580fe06fd70 con 0x5580fe05f6c0 2024-09-15T22:11:51.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580fe070440 con 0x5580fe0544e0 2024-09-15T22:11:51.653 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5580fe070b10 con 0x5580fe054e00 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe0597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe0597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47336/0 (socket says 172.21.15.150:47336) 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8a200640 1 -- 172.21.15.150:0/1583266109 learned_addr learned my addr 172.21.15.150:0/1583266109 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e89800640 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe0544e0 0x5580fe06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e88e00640 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe056f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e89800640 1 -- 172.21.15.150:0/1583266109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 msgr2=0x5580fe056f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e89800640 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe056f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e89800640 1 -- 172.21.15.150:0/1583266109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 msgr2=0x5580fe0597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.654 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e89800640 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe0597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e89800640 1 -- 172.21.15.150:0/1583266109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580fe05eeb0 con 0x5580fe0544e0 2024-09-15T22:11:51.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.651+0000 7f3e8a200640 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe0597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:51.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.652+0000 7f3e89800640 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe0544e0 0x5580fe06fef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e78005940 tx=0x7f3e7803d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9160bb32886334 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:51.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.652+0000 7f3e76000640 1 -- 172.21.15.150:0/1583266109 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78037040 con 0x5580fe0544e0 2024-09-15T22:11:51.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.652+0000 7f3e76000640 1 -- 172.21.15.150:0/1583266109 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e78030810 con 0x5580fe0544e0 2024-09-15T22:11:51.655 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.652+0000 7f3e76000640 1 -- 172.21.15.150:0/1583266109 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7804b910 con 0x5580fe0544e0 2024-09-15T22:11:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 -- 172.21.15.150:0/1583266109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe0544e0 msgr2=0x5580fe06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe0544e0 0x5580fe06fef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e78005940 tx=0x7f3e7803d000 comp rx=0 tx=0).stop 2024-09-15T22:11:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 -- 172.21.15.150:0/1583266109 shutdown_connections 2024-09-15T22:11:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe05f6c0 0x5580fe0597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe056f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.657 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/1583266109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe0544e0 0x5580fe06fef0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 -- 172.21.15.150:0/1583266109 >> 172.21.15.150:0/1583266109 conn(0x5580fe050a70 msgr2=0x5580fe05ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 -- 172.21.15.150:0/1583266109 shutdown_connections 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 -- 172.21.15.150:0/1583266109 wait complete. 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 -- start start 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.653+0000 7f3e8ee77740 1 Processor -- start 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe073c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe074170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe0746b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5580fe0718b0 con 0x5580fe0544e0 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580fe0711e0 con 0x5580fe05f6c0 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5580fe071f80 con 0x5580fe054e00 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8ee77740 10 client.0 _ll_register_callbacks cb 0x7f3e7000ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:51.658 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e89800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e89800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe073c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47352/0 (socket says 172.21.15.150:47352) 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e89800640 1 -- 172.21.15.150:0/3830339815 learned_addr learned my addr 172.21.15.150:0/3830339815 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e88e00640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.654+0000 7f3e8a200640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe0746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e89800640 1 -- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 msgr2=0x5580fe074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e89800640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe074170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e89800640 1 -- 172.21.15.150:0/3830339815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 msgr2=0x5580fe0746b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e89800640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe0746b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e89800640 1 -- 172.21.15.150:0/3830339815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580fe078550 con 0x5580fe0544e0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e89800640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe073c30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e7802a380 tx=0x7f3e78005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc92ab7f904ec87 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e6b400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e6b400640 1 -- 172.21.15.150:0/3830339815 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78037050 con 0x5580fe0544e0 2024-09-15T22:11:51.659 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e6b400640 1 -- 172.21.15.150:0/3830339815 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3e7804b690 con 0x5580fe0544e0 2024-09-15T22:11:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e78030810 con 0x5580fe0544e0 2024-09-15T22:11:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e6b400640 1 -- 172.21.15.150:0/3830339815 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e7804b890 con 0x5580fe0544e0 2024-09-15T22:11:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e8ee77740 10 client.15087 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:51.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.655+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580fe0db140 con 0x5580fe0544e0 2024-09-15T22:11:51.661 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e6b400640 1 -- 172.21.15.150:0/3830339815 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e78030810 con 0x5580fe0544e0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e6b400640 1 -- 172.21.15.150:0/3830339815 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3e78066070 con 0x5580fe0544e0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e8ee77740 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e8ee77740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e8ee77740 20 client.15087 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0df7b0 0x5580fe0de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e8ee77740 4 client.15087 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 --> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] -- command(tid 0: {"prefix": "status"}) -- 0x5580fe06fbc0 con 0x5580fe0df7b0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.656+0000 7f3e88e00640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0df7b0 0x5580fe0de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e88e00640 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0df7b0 0x5580fe0de4c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c9a8fbebc3e6455 server_cookie=e5526e2378333ae in_seq=0 out_seq=0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e6b400640 10 client.15087 ms_handle_connect on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e6b400640 1 -- 172.21.15.150:0/3830339815 <== mds.2 v2:172.21.15.169:6838/2442112974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5580fe06fbc0 con 0x5580fe0df7b0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e6b400640 10 client.15087 handle_command_reply: tid=0 2024-09-15T22:11:51.662 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 client.15087 shutdown 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 msgr2=0x5580fe073c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe073c30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e7802a380 tx=0x7f3e78005fa0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 shutdown_connections 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580fe05f6c0 0x5580fe0746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:6838/2442112974,v1:172.21.15.169:6839/2442112974] conn(0x5580fe0df7b0 0x5580fe0de4c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5580fe054e00 0x5580fe074170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 --2- 172.21.15.150:0/3830339815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5580fe0544e0 0x5580fe073c30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 >> 172.21.15.150:0/3830339815 conn(0x5580fe050a70 msgr2=0x5580fe05b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.657+0000 7f3e6b400640 0 client.15087 ms_handle_reset on v2:172.21.15.169:6838/2442112974 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 shutdown_connections 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ee77740 1 -- 172.21.15.150:0/3830339815 wait complete. 2024-09-15T22:11:51.663 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ee77740 20 client.15087 trim_cache size 0 max 16384 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 2, 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24523, 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 103.905727687, 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 84, 2024-09-15T22:11:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 137.847666436 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3e6c0a3240 msgr2=0x7f3e6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3e6c0a3240 0x7f3e6c0a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e7802a930 tx=0x7f3e780058d0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 msgr2=0x7f3e8419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.658+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 0x7f3e8419a9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000e9f0 tx=0x7f3e7000edf0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.665 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 shutdown_connections 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e84108f60 0x7f3e8419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3e6c0a3240 0x7f3e6c0a5700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e841047e0 0x7f3e8419a9e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 --2- 172.21.15.150:0/3655337865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e84103e30 0x7f3e8419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 >> 172.21.15.150:0/3655337865 conn(0x7f3e840ff8d0 msgr2=0x7f3e84100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 shutdown_connections 2024-09-15T22:11:51.666 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:51.659+0000 7f3e8ac00640 1 -- 172.21.15.150:0/3655337865 wait complete. 2024-09-15T22:11:52.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:52 smithi150 ceph-mon[30886]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:52.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-15T22:11:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:52 smithi154 ceph-mon[34853]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:52 smithi169 ceph-mon[35850]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:52.868 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:53.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 -- 172.21.15.150:0/3529554570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404112a30 msgr2=0x7ff404114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 --2- 172.21.15.150:0/3529554570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404112a30 0x7ff404114e20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009ca0 tx=0x7ff3fc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.403 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 -- 172.21.15.150:0/3529554570 shutdown_connections 2024-09-15T22:11:53.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 --2- 172.21.15.150:0/3529554570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404112a30 0x7ff404114e20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 --2- 172.21.15.150:0/3529554570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 0x7ff4041124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 --2- 172.21.15.150:0/3529554570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404076720 0x7ff404076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 -- 172.21.15.150:0/3529554570 >> 172.21.15.150:0/3529554570 conn(0x7ff4040ffa90 msgr2=0x7ff404101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:53.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 -- 172.21.15.150:0/3529554570 shutdown_connections 2024-09-15T22:11:53.404 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.401+0000 7ff409e00640 1 -- 172.21.15.150:0/3529554570 wait complete. 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.402+0000 7ff409e00640 1 Processor -- start 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.402+0000 7ff409e00640 1 -- start start 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 0x7ff4041a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff409e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 0x7ff4041a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff409e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404112a30 0x7ff40419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff409e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4041185d0 con 0x7ff404076720 2024-09-15T22:11:53.406 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff409e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff404118450 con 0x7ff404077040 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff409e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff404118750 con 0x7ff404112a30 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 0x7ff4041a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 0x7ff4041a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47366/0 (socket says 172.21.15.150:47366) 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 -- 172.21.15.150:0/2152934164 learned_addr learned my addr 172.21.15.150:0/2152934164 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402000640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 0x7ff4041a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff403400640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404112a30 0x7ff40419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 -- 172.21.15.150:0/2152934164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404112a30 msgr2=0x7ff40419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404112a30 0x7ff40419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 -- 172.21.15.150:0/2152934164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 msgr2=0x7ff4041a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 0x7ff4041a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402a00640 1 -- 172.21.15.150:0/2152934164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40419efa0 con 0x7ff404076720 2024-09-15T22:11:53.407 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.403+0000 7ff402000640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 0x7ff4041a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.404+0000 7ff402a00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 0x7ff4041a46b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400e9f0 tx=0x7ff3f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.404+0000 7ff408a00640 1 -- 172.21.15.150:0/2152934164 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400cd80 con 0x7ff404076720 2024-09-15T22:11:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.404+0000 7ff408a00640 1 -- 172.21.15.150:0/2152934164 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3f4005500 con 0x7ff404076720 2024-09-15T22:11:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.404+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40419f290 con 0x7ff404076720 2024-09-15T22:11:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.404+0000 7ff408a00640 1 -- 172.21.15.150:0/2152934164 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4010690 con 0x7ff404076720 2024-09-15T22:11:53.408 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.404+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4041ab580 con 0x7ff404076720 2024-09-15T22:11:53.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.407+0000 7ff408a00640 1 -- 172.21.15.150:0/2152934164 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7ff3f40046c0 con 0x7ff404076720 2024-09-15T22:11:53.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.407+0000 7ff40c7fd740 1 Processor -- start 2024-09-15T22:11:53.409 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.407+0000 7ff40c7fd740 1 -- start start 2024-09-15T22:11:53.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddcafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.410 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddcd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b57dd260b0 con 0x55b57ddcb510 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b57dccdab0 con 0x55b57ddc0c50 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b57dd22070 con 0x55b57ddc0330 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff402a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddcafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff402000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddcd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff403400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff402a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddcafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36670/0 (socket says 172.21.15.150:36670) 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff402000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddcd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47378/0 (socket says 172.21.15.150:47378) 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.408+0000 7ff402a00640 1 -- 172.21.15.150:0/3820584237 learned_addr learned my addr 172.21.15.150:0/3820584237 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402a00640 1 -- 172.21.15.150:0/3820584237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 msgr2=0x55b57ddc0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402a00640 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.411 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402a00640 1 -- 172.21.15.150:0/3820584237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 msgr2=0x55b57ddcd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402a00640 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddcd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402a00640 1 -- 172.21.15.150:0/3820584237 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b57dcda4a0 con 0x55b57ddc0c50 2024-09-15T22:11:53.412 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402000640 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddcd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff408a00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff3e80a32c0 0x7ff3e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.413 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff408a00640 1 -- 172.21.15.150:0/2152934164 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7ff3f40cfdd0 con 0x7ff404076720 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff402a00640 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddcafd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40d3d70 tx=0x7ff3f40d3e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=502be1af212d226b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff403400640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff3e80a32c0 0x7ff3e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.409+0000 7ff3efe00640 1 -- 172.21.15.150:0/3820584237 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40bc030 con 0x55b57ddc0c50 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff3efe00640 1 -- 172.21.15.150:0/3820584237 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3f409ca60 con 0x55b57ddc0c50 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff3efe00640 1 -- 172.21.15.150:0/3820584237 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f409bea0 con 0x55b57ddc0c50 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3820584237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 msgr2=0x55b57ddcafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff403400640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff3e80a32c0 0x7ff3e80a5780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc006010 tx=0x7ff3fc02f390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddcafd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40d3d70 tx=0x7ff3f40d3e60 comp rx=0 tx=0).stop 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3820584237 shutdown_connections 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddcd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddcafd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.414 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3820584237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.410+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3820584237 >> 172.21.15.150:0/3820584237 conn(0x55b57ddbc8c0 msgr2=0x55b57ddbcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.411+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3820584237 shutdown_connections 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.411+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3820584237 wait complete. 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.411+0000 7ff40c7fd740 1 -- start start 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.411+0000 7ff40c7fd740 1 Processor -- start 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddc90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b57ddce060 con 0x55b57ddcb510 2024-09-15T22:11:53.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b57dcae920 con 0x55b57ddc0c50 2024-09-15T22:11:53.416 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b57ddce1e0 con 0x55b57ddc0330 2024-09-15T22:11:53.417 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff40c7fd740 10 client.0 _ll_register_callbacks cb 0x55b57dcd28a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:53.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff403400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddc90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff403400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddc90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47384/0 (socket says 172.21.15.150:47384) 2024-09-15T22:11:53.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff403400640 1 -- 172.21.15.150:0/2276314735 learned_addr learned my addr 172.21.15.150:0/2276314735 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:53.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff402000640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.420 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.412+0000 7ff402a00640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff402000640 1 -- 172.21.15.150:0/2276314735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 msgr2=0x55b57ddc8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff402000640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff402000640 1 -- 172.21.15.150:0/2276314735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 msgr2=0x55b57ddc90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff402000640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddc90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff402000640 1 -- 172.21.15.150:0/2276314735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b57da972b0 con 0x55b57ddc0c50 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff403400640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddc90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff402000640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4040792b0 tx=0x7ff3f000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfb2e94d37475b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff3ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff3ecc00640 1 -- 172.21.15.150:0/2276314735 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00120d0 con 0x55b57ddc0c50 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3f409ca60 con 0x55b57ddc0c50 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff3ecc00640 1 -- 172.21.15.150:0/2276314735 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7ff3f0004020 con 0x55b57ddc0c50 2024-09-15T22:11:53.421 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff3ecc00640 1 -- 172.21.15.150:0/2276314735 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff3f0012270 con 0x55b57ddc0c50 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff40c7fd740 10 client.25130 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.413+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b57ddd9f80 con 0x55b57ddc0c50 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff3ecc00640 1 -- 172.21.15.150:0/2276314735 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3f409ca60 con 0x55b57ddc0c50 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff3ecc00640 1 -- 172.21.15.150:0/2276314735 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff3f0025070 con 0x55b57ddc0c50 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff40c7fd740 10 client.25130 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff40c7fd740 10 client.25130 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff40c7fd740 20 client.25130 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57dddc5a0 0x55b57dddda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff40c7fd740 4 client.25130 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.414+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 --> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b57dd33620 con 0x55b57dddc5a0 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.415+0000 7ff402a00640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57dddc5a0 0x55b57dddda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.422 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.415+0000 7ff402a00640 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57dddc5a0 0x55b57dddda10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=663b170249dc5daf server_cookie=5719726b32e97584 in_seq=0 out_seq=0 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.415+0000 7ff3ecc00640 10 client.25130 ms_handle_connect on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff3ecc00640 1 -- 172.21.15.150:0/2276314735 <== mds.1 v2:172.21.15.154:6836/1010193359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b57dd33620 con 0x55b57dddc5a0 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff3ecc00640 10 client.25130 handle_command_reply: tid=0 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 client.25130 shutdown 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 msgr2=0x55b57ddc8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4040792b0 tx=0x7ff3f000f790 comp rx=0 tx=0).stop 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 shutdown_connections 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57dddc5a0 0x55b57dddda10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddcb510 0x55b57ddc90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8b80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2276314735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddc0330 0x55b57ddc8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.423 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff3ecc00640 0 client.25130 ms_handle_reset on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:53.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 >> 172.21.15.150:0/2276314735 conn(0x55b57ddbc8c0 msgr2=0x55b57ddc25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:53.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 shutdown_connections 2024-09-15T22:11:53.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2276314735 wait complete. 2024-09-15T22:11:53.424 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.416+0000 7ff40c7fd740 20 client.25130 trim_cache size 0 max 16384 2024-09-15T22:11:53.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 Processor -- start 2024-09-15T22:11:53.436 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 -- start start 2024-09-15T22:11:53.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0330 0x55b57ddbcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.437 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b57dddbd50 con 0x55b57ddc0c50 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b57dddc420 con 0x55b57ddc0330 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b57dddcaf0 con 0x55b57ddcb510 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff402000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff402000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47386/0 (socket says 172.21.15.150:47386) 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff402000640 1 -- 172.21.15.150:0/2975951597 learned_addr learned my addr 172.21.15.150:0/2975951597 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff402a00640 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0330 0x55b57ddbcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.435+0000 7ff403400640 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff402a00640 1 -- 172.21.15.150:0/2975951597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 msgr2=0x55b57ddc2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff402a00640 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.438 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff402a00640 1 -- 172.21.15.150:0/2975951597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0c50 msgr2=0x55b57ddc8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff402a00640 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff402a00640 1 -- 172.21.15.150:0/2975951597 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b57ddc75f0 con 0x55b57ddc0330 2024-09-15T22:11:53.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff402a00640 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0330 0x55b57ddbcca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55b57ddbd720 tx=0x7ff3f4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1dd201bf15c0dab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:53.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff3ef400640 1 -- 172.21.15.150:0/2975951597 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40ae020 con 0x55b57ddc0330 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff3ef400640 1 -- 172.21.15.150:0/2975951597 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3f409ca60 con 0x55b57ddc0330 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.436+0000 7ff3ef400640 1 -- 172.21.15.150:0/2975951597 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f409bcc0 con 0x55b57ddc0330 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2975951597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0330 msgr2=0x55b57ddbcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0330 0x55b57ddbcca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55b57ddbd720 tx=0x7ff3f4004a40 comp rx=0 tx=0).stop 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2975951597 shutdown_connections 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0c50 0x55b57ddc8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/2975951597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0330 0x55b57ddbcca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2975951597 >> 172.21.15.150:0/2975951597 conn(0x55b57ddbc8c0 msgr2=0x55b57ddc8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2975951597 shutdown_connections 2024-09-15T22:11:53.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 -- 172.21.15.150:0/2975951597 wait complete. 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 -- start start 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.437+0000 7ff40c7fd740 1 Processor -- start 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 0x55b57ddc5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b57dddd890 con 0x55b57ddc0330 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b57dddd1c0 con 0x55b57ddc0c50 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b57ddddf60 con 0x55b57ddcb510 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff40c7fd740 10 client.0 _ll_register_callbacks cb 0x7ff3f0012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff402a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 0x55b57ddc5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff402a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 0x55b57ddc5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47402/0 (socket says 172.21.15.150:47402) 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff402a00640 1 -- 172.21.15.150:0/3671196683 learned_addr learned my addr 172.21.15.150:0/3671196683 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff403400640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.442 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.438+0000 7ff402000640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff403400640 1 -- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 msgr2=0x55b57ddc5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff403400640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff403400640 1 -- 172.21.15.150:0/3671196683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 msgr2=0x55b57ddc5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff403400640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 0x55b57ddc5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff403400640 1 -- 172.21.15.150:0/3671196683 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b57dde4320 con 0x55b57ddcb510 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff402a00640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 0x55b57ddc5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff403400640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc61e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55b57ddcb4e0 tx=0x7ff3fc02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc3836292c001c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:53.443 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff3ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:11:53.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff3ecc00640 1 -- 172.21.15.150:0/3671196683 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc059060 con 0x55b57ddcb510 2024-09-15T22:11:53.445 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff3ecc00640 1 -- 172.21.15.150:0/3671196683 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7ff3fc0317e0 con 0x55b57ddcb510 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.439+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3f409ca60 con 0x55b57ddcb510 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff3ecc00640 1 -- 172.21.15.150:0/3671196683 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff3fc0319e0 con 0x55b57ddcb510 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 10 client.25105 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b57de47050 con 0x55b57ddcb510 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff3ecc00640 1 -- 172.21.15.150:0/3671196683 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3f409ca60 con 0x55b57ddcb510 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff3ecc00640 1 -- 172.21.15.150:0/3671196683 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff3fc053030 con 0x55b57ddcb510 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 10 client.25105 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 10 client.25105 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 20 client.25105 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57de4bc60 0x55b57de4a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.440+0000 7ff40c7fd740 4 client.25105 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 --> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] -- command(tid 0: {"prefix": "status"}) -- 0x55b57dd2db30 con 0x55b57de4bc60 2024-09-15T22:11:53.446 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff402a00640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57de4bc60 0x55b57de4a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff402a00640 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57de4bc60 0x55b57de4a970 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9849f5a55e171a18 server_cookie=4b8a22a105a7b99f in_seq=0 out_seq=0 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff3ecc00640 10 client.25105 ms_handle_connect on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff3ecc00640 1 -- 172.21.15.150:0/3671196683 <== mds.1 v2:172.21.15.154:6836/1010193359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55b57dd2db30 con 0x55b57de4bc60 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff3ecc00640 10 client.25105 handle_command_reply: tid=0 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.441+0000 7ff40c7fd740 1 client.25105 shutdown 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 msgr2=0x55b57ddc61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc61e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55b57ddcb4e0 tx=0x7ff3fc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 shutdown_connections 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:6836/1010193359,v1:172.21.15.154:6837/1010193359] conn(0x55b57de4bc60 0x55b57de4a970 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b57ddcb510 0x55b57ddc61e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b57ddc0c50 0x55b57ddc5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.447 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff3ecc00640 0 client.25105 ms_handle_reset on v2:172.21.15.154:6836/1010193359 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 --2- 172.21.15.150:0/3671196683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b57ddc0330 0x55b57ddc5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 >> 172.21.15.150:0/3671196683 conn(0x55b57ddbc8c0 msgr2=0x55b57ddd6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 shutdown_connections 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 1 -- 172.21.15.150:0/3671196683 wait complete. 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.442+0000 7ff40c7fd740 20 client.25105 trim_cache size 0 max 16384 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 1, 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24539, 2024-09-15T22:11:53.448 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 106.704449154, 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 84, 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 142.026613489 2024-09-15T22:11:53.449 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff3e80a32c0 msgr2=0x7ff3e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff3e80a32c0 0x7ff3e80a5780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc006010 tx=0x7ff3fc02f390 comp rx=0 tx=0).stop 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 msgr2=0x7ff4041a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 0x7ff4041a46b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400e9f0 tx=0x7ff3f400edf0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 shutdown_connections 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404112a30 0x7ff40419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff404077040 0x7ff4041a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff3e80a32c0 0x7ff3e80a5780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 --2- 172.21.15.150:0/2152934164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff404076720 0x7ff4041a46b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 >> 172.21.15.150:0/2152934164 conn(0x7ff4040ffa90 msgr2=0x7ff404101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:53.450 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 shutdown_connections 2024-09-15T22:11:53.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:53.443+0000 7ff409e00640 1 -- 172.21.15.150:0/2152934164 wait complete. 2024-09-15T22:11:54.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:11:54.512 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:54 smithi169 ceph-mon[35850]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 517 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:54 smithi154 ceph-mon[34853]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 517 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:54.626 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:54.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:54 smithi150 ceph-mon[30886]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 517 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:55.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.160+0000 7f3e15e00640 1 -- 172.21.15.150:0/3190032383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 msgr2=0x7f3e10074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.160+0000 7f3e15e00640 1 --2- 172.21.15.150:0/3190032383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e10074a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009900 tx=0x7f3e0002a480 comp rx=0 tx=0).stop 2024-09-15T22:11:55.163 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 -- 172.21.15.150:0/3190032383 shutdown_connections 2024-09-15T22:11:55.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 --2- 172.21.15.150:0/3190032383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e1010e3c0 0x7f3e10110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 --2- 172.21.15.150:0/3190032383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e10074f40 0x7f3e1010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 --2- 172.21.15.150:0/3190032383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e10074a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 -- 172.21.15.150:0/3190032383 >> 172.21.15.150:0/3190032383 conn(0x7f3e100fd8c0 msgr2=0x7f3e100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:55.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 -- 172.21.15.150:0/3190032383 shutdown_connections 2024-09-15T22:11:55.164 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.161+0000 7f3e15e00640 1 -- 172.21.15.150:0/3190032383 wait complete. 2024-09-15T22:11:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 Processor -- start 2024-09-15T22:11:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 -- start start 2024-09-15T22:11:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e1019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e10074f40 0x7f3e1019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e1010e3c0 0x7f3e1019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101141c0 con 0x7f3e10074f40 2024-09-15T22:11:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10114040 con 0x7f3e1010e3c0 2024-09-15T22:11:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e15e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10114340 con 0x7f3e10074620 2024-09-15T22:11:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e0ea00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e1019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.169 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e06000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e10074f40 0x7f3e1019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e0ea00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e1019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43012/0 (socket says 172.21.15.150:43012) 2024-09-15T22:11:55.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.162+0000 7f3e0ea00640 1 -- 172.21.15.150:0/2127791503 learned_addr learned my addr 172.21.15.150:0/2127791503 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:55.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0f400640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e1010e3c0 0x7f3e1019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0ea00640 1 -- 172.21.15.150:0/2127791503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e1010e3c0 msgr2=0x7f3e1019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e1010e3c0 0x7f3e1019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.170 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0ea00640 1 -- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e10074f40 msgr2=0x7f3e1019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e10074f40 0x7f3e1019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0ea00640 1 -- 172.21.15.150:0/2127791503 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1019f670 con 0x7f3e10074620 2024-09-15T22:11:55.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e06000640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e10074f40 0x7f3e1019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:55.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e1019a6c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e00004770 tx=0x7f3e00003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:55.171 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e14a00640 1 -- 172.21.15.150:0/2127791503 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0003f070 con 0x7f3e10074620 2024-09-15T22:11:55.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1019f900 con 0x7f3e10074620 2024-09-15T22:11:55.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.163+0000 7f3e14a00640 1 -- 172.21.15.150:0/2127791503 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e00031ca0 con 0x7f3e10074620 2024-09-15T22:11:55.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.164+0000 7f3e14a00640 1 -- 172.21.15.150:0/2127791503 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00035030 con 0x7f3e10074620 2024-09-15T22:11:55.172 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.164+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101a7240 con 0x7f3e10074620 2024-09-15T22:11:55.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 Processor -- start 2024-09-15T22:11:55.180 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 -- start start 2024-09-15T22:11:55.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38330 0x56032fd38710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38c50 0x56032fd42fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd45900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e14a00640 1 -- 172.21.15.150:0/2127791503 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f3e00042070 con 0x7f3e10074620 2024-09-15T22:11:55.181 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56032fc9e0b0 con 0x56032fd43510 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56032fc45ab0 con 0x56032fd38c50 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e188ac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56032fc9a070 con 0x56032fd38330 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e06000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd45900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e0f400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38330 0x56032fd38710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e06000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd45900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47414/0 (socket says 172.21.15.150:47414) 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e06000640 1 -- 172.21.15.150:0/1443943960 learned_addr learned my addr 172.21.15.150:0/1443943960 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:55.182 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.167+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38c50 0x56032fd42fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0f400640 1 -- 172.21.15.150:0/1443943960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38c50 msgr2=0x56032fd42fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0f400640 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38c50 0x56032fd42fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0f400640 1 -- 172.21.15.150:0/1443943960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 msgr2=0x56032fd45900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0f400640 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd45900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0f400640 1 -- 172.21.15.150:0/1443943960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032fc524a0 con 0x56032fd38330 2024-09-15T22:11:55.183 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38c50 0x56032fd42fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3e0f400640 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38330 0x56032fd38710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009f00 tx=0x7f3e08011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7e044b38a352fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3dffe00640 1 -- 172.21.15.150:0/1443943960 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08004d20 con 0x56032fd38330 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3dffe00640 1 -- 172.21.15.150:0/1443943960 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e08004050 con 0x56032fd38330 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.168+0000 7f3dffe00640 1 -- 172.21.15.150:0/1443943960 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08005240 con 0x56032fd38330 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 -- 172.21.15.150:0/1443943960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38330 msgr2=0x56032fd38710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38330 0x56032fd38710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009f00 tx=0x7f3e08011810 comp rx=0 tx=0).stop 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e14a00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3df40a3240 0x7f3df40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 -- 172.21.15.150:0/1443943960 shutdown_connections 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd45900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.184 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38c50 0x56032fd42fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1443943960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38330 0x56032fd38710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.169+0000 7f3e188ac740 1 -- 172.21.15.150:0/1443943960 >> 172.21.15.150:0/1443943960 conn(0x56032fd348c0 msgr2=0x56032fd34ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e14a00640 1 -- 172.21.15.150:0/2127791503 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3e000eff80 con 0x7f3e10074620 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e188ac740 1 -- 172.21.15.150:0/1443943960 shutdown_connections 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e0f400640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3df40a3240 0x7f3df40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e188ac740 1 -- 172.21.15.150:0/1443943960 wait complete. 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e188ac740 1 -- start start 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e0f400640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3df40a3240 0x7f3df40a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d40 tx=0x7f3e08003f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.170+0000 7f3e188ac740 1 Processor -- start 2024-09-15T22:11:55.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd40a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd40f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56032fd46060 con 0x56032fd38c50 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56032fc26920 con 0x56032fd38330 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56032fd461e0 con 0x56032fd43510 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e188ac740 10 client.0 _ll_register_callbacks cb 0x56032fc4a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e0ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e0ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36734/0 (socket says 172.21.15.150:36734) 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e0ea00640 1 -- 172.21.15.150:0/1226898102 learned_addr learned my addr 172.21.15.150:0/1226898102 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e06000640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd40a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.171+0000 7f3e0f400640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd40f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0ea00640 1 -- 172.21.15.150:0/1226898102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 msgr2=0x56032fd40f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd40f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0ea00640 1 -- 172.21.15.150:0/1226898102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 msgr2=0x56032fd40a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd40a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0ea00640 1 -- 172.21.15.150:0/1226898102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56032fa0f2b0 con 0x56032fd38330 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e06000640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd40a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0f400640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd40f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd404e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000c00 tx=0x7f3e000b89e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569d49a606289b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3dfcc00640 1 -- 172.21.15.150:0/1226898102 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00049070 con 0x56032fd38330 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3dfcc00640 1 -- 172.21.15.150:0/1226898102 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3e000b8cf0 con 0x56032fd38330 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e08004050 con 0x56032fd38330 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3dfcc00640 1 -- 172.21.15.150:0/1226898102 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e000bbfe0 con 0x56032fd38330 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e188ac740 10 client.25148 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:55.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56032fd46060 con 0x56032fd38330 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.172+0000 7f3dfcc00640 1 -- 172.21.15.150:0/1226898102 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e08004050 con 0x56032fd38330 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3dfcc00640 1 -- 172.21.15.150:0/1226898102 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3e0003b4f0 con 0x56032fd38330 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e188ac740 10 client.25148 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e188ac740 10 client.25148 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e188ac740 20 client.25148 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fd54410 0x56032fd55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e188ac740 4 client.25148 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56032fcab620 con 0x56032fd54410 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.173+0000 7f3e06000640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fd54410 0x56032fd55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.174+0000 7f3e06000640 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fd54410 0x56032fd55880 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ecadc941590e3b server_cookie=a510dda9d8508600 in_seq=0 out_seq=0 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.174+0000 7f3dfcc00640 10 client.25148 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:55.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.174+0000 7f3dfcc00640 1 -- 172.21.15.150:0/1226898102 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56032fcab620 con 0x56032fd54410 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.174+0000 7f3dfcc00640 10 client.25148 handle_command_reply: tid=0 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.174+0000 7f3e188ac740 1 client.25148 shutdown 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 msgr2=0x56032fd404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd404e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000c00 tx=0x7f3e000b89e0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 shutdown_connections 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fd54410 0x56032fd55880 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd40f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd40a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 --2- 172.21.15.150:0/1226898102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd404e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3dfcc00640 0 client.25148 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 >> 172.21.15.150:0/1226898102 conn(0x56032fd348c0 msgr2=0x56032fd3a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 shutdown_connections 2024-09-15T22:11:55.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 1 -- 172.21.15.150:0/1226898102 wait complete. 2024-09-15T22:11:55.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.175+0000 7f3e188ac740 20 client.25148 trim_cache size 0 max 16384 2024-09-15T22:11:55.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 Processor -- start 2024-09-15T22:11:55.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 -- start start 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd53d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38c50 0x56032fd535f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd5db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56032fd53bc0 con 0x56032fd43510 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56032fd54290 con 0x56032fd38330 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.193+0000 7f3e188ac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56032fd54960 con 0x56032fd38c50 2024-09-15T22:11:55.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e0f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd5db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e0f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd5db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47434/0 (socket says 172.21.15.150:47434) 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e0f400640 1 -- 172.21.15.150:0/2996531630 learned_addr learned my addr 172.21.15.150:0/2996531630 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38c50 0x56032fd535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd53d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 -- 172.21.15.150:0/2996531630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 msgr2=0x56032fd53d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd53d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 -- 172.21.15.150:0/2996531630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 msgr2=0x56032fd5db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd5db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 -- 172.21.15.150:0/2996531630 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032fd3f4f0 con 0x56032fd38c50 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e0f400640 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd5db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:11:55.197 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.194+0000 7f3e06000640 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38c50 0x56032fd535f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x56032fc26a50 tx=0x7f3df8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85b9be9cb46ec00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:55.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3dff400640 1 -- 172.21.15.150:0/2996531630 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8022030 con 0x56032fd38c50 2024-09-15T22:11:55.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3dff400640 1 -- 172.21.15.150:0/2996531630 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df8005020 con 0x56032fd38c50 2024-09-15T22:11:55.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3dff400640 1 -- 172.21.15.150:0/2996531630 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df800fb60 con 0x56032fd38c50 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3e188ac740 1 -- 172.21.15.150:0/2996531630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38c50 msgr2=0x56032fd535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3e188ac740 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38c50 0x56032fd535f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x56032fc26a50 tx=0x7f3df8005f90 comp rx=0 tx=0).stop 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3e188ac740 1 -- 172.21.15.150:0/2996531630 shutdown_connections 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3e188ac740 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd43510 0x56032fd5db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3e188ac740 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd38c50 0x56032fd535f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.195+0000 7f3e188ac740 1 --2- 172.21.15.150:0/2996531630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd53d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.196+0000 7f3e188ac740 1 -- 172.21.15.150:0/2996531630 >> 172.21.15.150:0/2996531630 conn(0x56032fd348c0 msgr2=0x56032fd52ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.196+0000 7f3e188ac740 1 -- 172.21.15.150:0/2996531630 shutdown_connections 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.196+0000 7f3e188ac740 1 -- 172.21.15.150:0/2996531630 wait complete. 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.196+0000 7f3e188ac740 1 -- start start 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.196+0000 7f3e188ac740 1 Processor -- start 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd5dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.200 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd5e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd58940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56032fd55700 con 0x56032fd38c50 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56032fd55030 con 0x56032fd38330 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56032fd55dd0 con 0x56032fd43510 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e188ac740 10 client.0 _ll_register_callbacks cb 0x7f3e00031e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd5dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e06000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd5e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd5dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36756/0 (socket says 172.21.15.150:36756) 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 -- 172.21.15.150:0/383553958 learned_addr learned my addr 172.21.15.150:0/383553958 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0f400640 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd58940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 -- 172.21.15.150:0/383553958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 msgr2=0x56032fd58940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd58940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.201 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 -- 172.21.15.150:0/383553958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 msgr2=0x56032fd5e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:11:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd5e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.197+0000 7f3e0ea00640 1 -- 172.21.15.150:0/383553958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56032fd59170 con 0x56032fd38330 2024-09-15T22:11:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3e0ea00640 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd5dd00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e000f02b0 tx=0x7f3e000c5140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20fe5b09321c90be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:11:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3dfcc00640 1 -- 172.21.15.150:0/383553958 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00049040 con 0x56032fd38330 2024-09-15T22:11:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3dfcc00640 1 -- 172.21.15.150:0/383553958 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3e000317c0 con 0x56032fd38330 2024-09-15T22:11:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df8005020 con 0x56032fd38330 2024-09-15T22:11:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3dfcc00640 1 -- 172.21.15.150:0/383553958 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e00005d50 con 0x56032fd38330 2024-09-15T22:11:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3e188ac740 10 client.25154 fetch_fsmap learned FSMap version 27 2024-09-15T22:11:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56032fdbf640 con 0x56032fd38330 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3dfcc00640 1 -- 172.21.15.150:0/383553958 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df8005020 con 0x56032fd38330 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.198+0000 7f3dfcc00640 1 -- 172.21.15.150:0/383553958 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3e000af030 con 0x56032fd38330 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e188ac740 10 client.25154 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e188ac740 10 client.25154 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e188ac740 20 client.25154 populate_metadata read hostname 'smithi150' 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e188ac740 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fdc40c0 0x56032fdc2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e188ac740 4 client.25154 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:11:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "status"}) -- 0x56032fca5b30 con 0x56032fdc40c0 2024-09-15T22:11:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e06000640 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fdc40c0 0x56032fdc2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3e06000640 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fdc40c0 0x56032fdc2dd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26bca9703d3df568 server_cookie=8e58bca18e2f88bd in_seq=0 out_seq=0 2024-09-15T22:11:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.199+0000 7f3dfcc00640 10 client.25154 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3dfcc00640 1 -- 172.21.15.150:0/383553958 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x56032fca5b30 con 0x56032fdc40c0 2024-09-15T22:11:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3dfcc00640 10 client.25154 handle_command_reply: tid=0 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 client.25154 shutdown 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 msgr2=0x56032fd5dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd5dd00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e000f02b0 tx=0x7f3e000c5140 comp rx=0 tx=0).stop 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 shutdown_connections 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56032fdc40c0 0x56032fdc2dd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56032fd43510 0x56032fd58940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56032fd38c50 0x56032fd5e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 --2- 172.21.15.150:0/383553958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56032fd38330 0x56032fd5dd00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3dfcc00640 0 client.25154 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 >> 172.21.15.150:0/383553958 conn(0x56032fd348c0 msgr2=0x56032fd39d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 shutdown_connections 2024-09-15T22:11:55.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 1 -- 172.21.15.150:0/383553958 wait complete. 2024-09-15T22:11:55.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.200+0000 7f3e188ac740 20 client.25154 trim_cache size 0 max 16384 2024-09-15T22:11:55.208 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:11:55.208 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "faa38c0e-73ad-11ef-bceb-c7b262605968", 2024-09-15T22:11:55.208 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 24578, 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs", 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 116.517326432, 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 27, 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 84, 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 80, 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 131.181902433 2024-09-15T22:11:55.209 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3df40a3240 msgr2=0x7f3df40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3df40a3240 0x7f3df40a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d40 tx=0x7f3e08003f40 comp rx=0 tx=0).stop 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 msgr2=0x7f3e1019a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e1019a6c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e00004770 tx=0x7f3e00003c10 comp rx=0 tx=0).stop 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 shutdown_connections 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e1010e3c0 0x7f3e1019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3df40a3240 0x7f3df40a5700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.210 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e10074f40 0x7f3e1019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 --2- 172.21.15.150:0/2127791503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e10074620 0x7f3e1019a6c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:55.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 >> 172.21.15.150:0/2127791503 conn(0x7f3e100fd8c0 msgr2=0x7f3e100fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:55.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 shutdown_connections 2024-09-15T22:11:55.211 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:55.201+0000 7f3e15e00640 1 -- 172.21.15.150:0/2127791503 wait complete. 2024-09-15T22:11:55.942 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:11:55.952 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:11:55.952 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:11:55.953 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:11:55.953 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:11:56.019 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:11:56.019 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-15T22:11:56.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:56.020 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-15T22:11:56.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:56.057 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-15T22:11:56.156 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-09-15T22:11:56.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:11:56.159 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-15T22:11:56.159 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:11:56.159 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:11:56.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:11:56.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:56 smithi150 ceph-mon[30886]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:56.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:56 smithi154 ceph-mon[34853]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:56.525 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:56 smithi169 ceph-mon[35850]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 -- 172.21.15.150:0/495109170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a01047e0 msgr2=0x7f52a0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:57.077 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 --2- 172.21.15.150:0/495109170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a01047e0 0x7f52a0108830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5290009900 tx=0x7f529002a410 comp rx=0 tx=0).stop 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 -- 172.21.15.150:0/495109170 shutdown_connections 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 --2- 172.21.15.150:0/495109170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a0108f60 0x7f52a0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 --2- 172.21.15.150:0/495109170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a01047e0 0x7f52a0108830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 --2- 172.21.15.150:0/495109170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 -- 172.21.15.150:0/495109170 >> 172.21.15.150:0/495109170 conn(0x7f52a00ff8d0 msgr2=0x7f52a0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 -- 172.21.15.150:0/495109170 shutdown_connections 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.075+0000 7f52a7200640 1 -- 172.21.15.150:0/495109170 wait complete. 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 Processor -- start 2024-09-15T22:11:57.078 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 -- start start 2024-09-15T22:11:57.079 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a01047e0 0x7f52a019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a0108f60 0x7f52a019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0114010 con 0x7f52a0108f60 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0113e90 con 0x7f52a01047e0 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.076+0000 7f52a7200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0114190 con 0x7f52a0103e30 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a01047e0 0x7f52a019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a0108f60 0x7f52a019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43070/0 (socket says 172.21.15.150:43070) 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 -- 172.21.15.150:0/352101765 learned_addr learned my addr 172.21.15.150:0/352101765 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:11:57.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5400640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a01047e0 0x7f52a019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36784/0 (socket says 172.21.15.150:36784) 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 -- 172.21.15.150:0/352101765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a01047e0 msgr2=0x7f52a019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a01047e0 0x7f52a019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 -- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a0108f60 msgr2=0x7f52a019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a0108f60 0x7f52a019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 -- 172.21.15.150:0/352101765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a019f420 con 0x7f52a0103e30 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.077+0000 7f52a5e00640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a019a470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f529400e9f0 tx=0x7f529400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.078+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529400cd80 con 0x7f52a0103e30 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.078+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a019f710 con 0x7f52a0103e30 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.078+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5294005500 con 0x7f52a0103e30 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.078+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294010690 con 0x7f52a0103e30 2024-09-15T22:11:57.081 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.078+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a01a6ff0 con 0x7f52a0103e30 2024-09-15T22:11:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.079+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a0104210 con 0x7f52a0103e30 2024-09-15T22:11:57.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.081+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f52940046c0 con 0x7f52a0103e30 2024-09-15T22:11:57.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.082+0000 7f529aa00640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52880a3240 0x7f52880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:57.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.082+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f52940cff50 con 0x7f52a0103e30 2024-09-15T22:11:57.084 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.082+0000 7f52a5400640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52880a3240 0x7f52880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:57.085 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.083+0000 7f52a5400640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52880a3240 0x7f52880a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5290000c00 tx=0x7f5290005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:57.086 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.084+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52940541b0 con 0x7f52a0103e30 2024-09-15T22:11:57.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.300+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f52a019b7d0 con 0x7f52a0103e30 2024-09-15T22:11:57.302 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.300+0000 7f529aa00640 1 -- 172.21.15.150:0/352101765 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f52a019b7d0 con 0x7f52a0103e30 2024-09-15T22:11:57.302 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:11:57.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52880a3240 msgr2=0x7f52880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:57.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52880a3240 0x7f52880a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5290000c00 tx=0x7f5290005b50 comp rx=0 tx=0).stop 2024-09-15T22:11:57.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 msgr2=0x7f52a019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:57.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a019a470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f529400e9f0 tx=0x7f529400edf0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 shutdown_connections 2024-09-15T22:11:57.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52880a3240 0x7f52880a5700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a0108f60 0x7f52a019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52a01047e0 0x7f52a019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 --2- 172.21.15.150:0/352101765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52a0103e30 0x7f52a019a470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:57.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 >> 172.21.15.150:0/352101765 conn(0x7f52a00ff8d0 msgr2=0x7f52a0100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:57.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 shutdown_connections 2024-09-15T22:11:57.306 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:57.303+0000 7f52a7200640 1 -- 172.21.15.150:0/352101765 wait complete. 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:11:58.011 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:11:58.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:58.012 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:11:58.047 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42143sec preferred_lft 42143sec 2024-09-15T22:11:58.048 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-15T22:11:58.049 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:11:58.050 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:11:58.050 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-15T22:11:58.168 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:11:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:11:58.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:58.458 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:11:58.509 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:58 smithi150 ceph-mon[30886]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:58.509 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:11:58 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/352101765' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:11:58.514 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-15T22:11:58.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:58.518 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-15T22:11:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:58 smithi154 ceph-mon[34853]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:58.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:11:58 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/352101765' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:11:58.592 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-15T22:11:58.592 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:11:58.592 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:11:58.592 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:11:58.592 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:11:58.593 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:11:58.593 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-15T22:11:58.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:11:58.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:11:58.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:11:58.593 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-15T22:11:58.671 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:11:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:58 smithi169 ceph-mon[35850]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:11:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:11:58 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/352101765' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:11:59.185 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:11:59.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:59.193 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-15T22:11:59.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:11:59.230 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-15T22:11:59.307 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:11:59.308 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-15T22:11:59.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:11:59.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:11:59.308 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-15T22:11:59.427 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:11:59.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:11:59.489 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:11:59.489 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-15T22:11:59.568 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:11:59.727 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:11:59.735 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:11:59.735 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-15T22:11:59.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-15T22:11:59.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:11:59.736 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-15T22:11:59.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:11:59.904 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:11:59.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:11:59.912 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:11:59.950 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:11:59.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:11:59.950 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:12:00.025 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-15T22:12:00.025 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-15T22:12:00.026 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/5c790d46-90ed-4cc0-952d-75772bb60645 2024-09-15T22:12:00.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:12:00.026 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/5c790d46-90ed-4cc0-952d-75772bb60645 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-15T22:12:00.171 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-15T22:12:00.171 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-15T22:12:00.171 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-15T22:12:00.423 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:00 smithi150 ceph-mon[30886]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-15T22:12:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:00 smithi154 ceph-mon[34853]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-15T22:12:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:00 smithi169 ceph-mon[35850]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-15T22:12:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-15T22:12:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-15T22:12:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2024-09-15T22:12:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.150:6789,172.21.15.154:6789,172.21.15.169:6789" 2024-09-15T22:12:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.150:6789,172.21.15.154:6789,172.21.15.169:6789:/volumes/qa/sv_1/5c790d46-90ed-4cc0-952d-75772bb60645 2024-09-15T22:12:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=faa38c0e-73ad-11ef-bceb-c7b262605968" will pass to kernel 2024-09-15T22:12:00.838 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:12:00.838 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:12:00.839 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:12:00.839 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:12:00.839 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:12:00.841 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:12:00.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:12:00.842 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:12:00.905 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:12:00.984 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:12:00.988 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:12:00.996 INFO:teuthology.orchestra.run.smithi150.stdout:client25163 2024-09-15T22:12:00.996 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:12:00.996 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:12:01.033 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:12:01.151 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:12:01.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:12:01.164 INFO:teuthology.orchestra.run.smithi150.stdout:client25163 2024-09-15T22:12:01.165 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:12:01.244 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:12:01.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:12:01.256 INFO:teuthology.orchestra.run.smithi150.stdout:client25163 2024-09-15T22:12:01.256 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968.client25163/status') 2024-09-15T22:12:01.338 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:12:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:instance: client.25163 (3)172.21.15.150:0/616269404 2024-09-15T22:12:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:blocklisted: false 2024-09-15T22:12:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2024-09-15T22:12:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2024-09-15T22:12:01.360 INFO:teuthology.orchestra.run.smithi150.stderr:71 bytes copied, 7.0259e-05 s, 1.0 MB/s 2024-09-15T22:12:01.362 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:12:01.371 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T22:12:01.386 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:12:01.386 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:12:01.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-15T22:12:01.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 -- 172.21.15.150:0/4293793211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff10074680 msgr2=0x7eff10074a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:01.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 --2- 172.21.15.150:0/4293793211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff10074680 0x7eff10074a80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff00009900 tx=0x7eff0002a400 comp rx=0 tx=0).stop 2024-09-15T22:12:01.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 -- 172.21.15.150:0/4293793211 shutdown_connections 2024-09-15T22:12:01.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 --2- 172.21.15.150:0/4293793211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10105320 0x7eff10110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:01.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 --2- 172.21.15.150:0/4293793211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff10074fc0 0x7eff1010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:01.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 --2- 172.21.15.150:0/4293793211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff10074680 0x7eff10074a80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:01.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 -- 172.21.15.150:0/4293793211 >> 172.21.15.150:0/4293793211 conn(0x7eff100fd0d0 msgr2=0x7eff100ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:01.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 -- 172.21.15.150:0/4293793211 shutdown_connections 2024-09-15T22:12:01.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.539+0000 7eff0fe00640 1 -- 172.21.15.150:0/4293793211 wait complete. 2024-09-15T22:12:01.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 Processor -- start 2024-09-15T22:12:01.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 -- start start 2024-09-15T22:12:01.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 0x7eff1019e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:01.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff10074fc0 0x7eff1019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:01.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff101a3950 0x7eff101a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7eff10113d70 con 0x7eff101a3950 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff10113bf0 con 0x7eff10074680 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.540+0000 7eff0fe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7eff10113ef0 con 0x7eff10074fc0 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 0x7eff1019e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 0x7eff1019e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:42746/0 (socket says 172.21.15.150:42746) 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 -- 172.21.15.150:0/111859960 learned_addr learned my addr 172.21.15.150:0/111859960 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0f400640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff101a3950 0x7eff101a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff06000640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff10074fc0 0x7eff1019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:01.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 -- 172.21.15.150:0/111859960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff10074fc0 msgr2=0x7eff1019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff10074fc0 0x7eff1019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 -- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff101a3950 msgr2=0x7eff101a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff101a3950 0x7eff101a5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 -- 172.21.15.150:0/111859960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff101a63b0 con 0x7eff10074680 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0f400640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff101a3950 0x7eff101a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.541+0000 7eff0ea00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 0x7eff1019e3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff00031440 tx=0x7eff00032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.542+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0003f030 con 0x7eff10074680 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.542+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff00003ce0 con 0x7eff10074680 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.542+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101a6640 con 0x7eff10074680 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.542+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00035070 con 0x7eff10074680 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.542+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff101a6b80 con 0x7eff10074680 2024-09-15T22:12:01.549 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.543+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10074a80 con 0x7eff10074680 2024-09-15T22:12:01.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.545+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7eff00042030 con 0x7eff10074680 2024-09-15T22:12:01.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.546+0000 7eff07e00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efef40a32c0 0x7efef40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:01.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.546+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7eff000efef0 con 0x7eff10074680 2024-09-15T22:12:01.550 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.546+0000 7eff06000640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efef40a32c0 0x7efef40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:01.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.547+0000 7eff06000640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efef40a32c0 0x7efef40a5780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff1019f8c0 tx=0x7efef8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:01.551 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.548+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff000bc530 con 0x7eff10074680 2024-09-15T22:12:01.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:01.762+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7eff101038c0 con 0x7eff10074680 2024-09-15T22:12:02.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.244+0000 7eff07e00640 1 -- 172.21.15.150:0/111859960 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7eff000c0830 con 0x7eff10074680 2024-09-15T22:12:02.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efef40a32c0 msgr2=0x7efef40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:02.248 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efef40a32c0 0x7efef40a5780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7eff1019f8c0 tx=0x7efef8005f90 comp rx=0 tx=0).stop 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 msgr2=0x7eff1019e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 0x7eff1019e3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff00031440 tx=0x7eff00032ce0 comp rx=0 tx=0).stop 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 shutdown_connections 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7efef40a32c0 0x7efef40a5780 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff101a3950 0x7eff101a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff10074fc0 0x7eff1019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 --2- 172.21.15.150:0/111859960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff10074680 0x7eff1019e3b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.246+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 >> 172.21.15.150:0/111859960 conn(0x7eff100fd0d0 msgr2=0x7eff10110130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.247+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 shutdown_connections 2024-09-15T22:12:02.249 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:12:02.247+0000 7eff0fe00640 1 -- 172.21.15.150:0/111859960 wait complete. 2024-09-15T22:12:02.265 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T22:12:02.275 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-15T22:12:02.316 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:12:02.317 DEBUG:teuthology.orchestra.run.smithi150:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-15T22:12:02.321 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T22:12:02.371 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:12:02.372 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T22:12:02.372 INFO:tasks.workunit:timeout=3h 2024-09-15T22:12:02.372 INFO:tasks.workunit:cleanup=True 2024-09-15T22:12:02.372 DEBUG:teuthology.orchestra.run.smithi150:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-15 22:10:18.773313198 +0000 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-15 22:10:18.773313198 +0000 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-15 22:12:00.893557785 +0000 2024-09-15T22:12:02.409 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-15 22:10:18.773313198 +0000 2024-09-15T22:12:02.409 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T22:12:02.410 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T22:12:02.497 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:02 smithi150 ceph-mon[30886]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-15T22:12:02.497 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:02 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/111859960' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:12:02.497 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:02 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:12:02.516 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:12:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:02 smithi154 ceph-mon[34853]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-15T22:12:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:02 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/111859960' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:12:02.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:02 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:12:02.554 INFO:tasks.workunit.client.0.smithi150.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T22:12:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:02 smithi169 ceph-mon[35850]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-15T22:12:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:02 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/111859960' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:12:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:02 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:12:03.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:03 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:12:03.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:03 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:12:03.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:03 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:12:03.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:03 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:12:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:03 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:12:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:03 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:12:04.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:04 smithi154 ceph-mon[34853]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-15T22:12:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:04 smithi150 ceph-mon[30886]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-15T22:12:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:04 smithi169 ceph-mon[35850]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-15T22:12:06.516 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:06 smithi169 ceph-mon[35850]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-15T22:12:06.516 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:06 smithi154 ceph-mon[34853]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-15T22:12:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:06.548 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:06 smithi150 ceph-mon[30886]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-15T22:12:06.548 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:08.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: pgmap v356: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:12:08.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: pgmap v356: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:12:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: pgmap v356: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:12:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:08.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:09.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:09.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:09.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:09.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:09.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:09.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:12:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:10 smithi150 ceph-mon[30886]: pgmap v357: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:12:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:10 smithi169 ceph-mon[35850]: pgmap v357: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:12:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:10 smithi154 ceph-mon[34853]: pgmap v357: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:12:12.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:12 smithi154 ceph-mon[34853]: pgmap v358: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:12:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:12 smithi150 ceph-mon[30886]: pgmap v358: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:12:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:12 smithi169 ceph-mon[35850]: pgmap v358: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-15T22:12:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:14 smithi154 ceph-mon[34853]: pgmap v359: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:12:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:14 smithi150 ceph-mon[30886]: pgmap v359: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:12:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:14 smithi169 ceph-mon[35850]: pgmap v359: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.519+0000 7fa5fd600640 1 -- 172.21.15.150:0/2754306635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 msgr2=0x7fa5f8104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.519+0000 7fa5fd600640 1 --2- 172.21.15.150:0/2754306635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8104160 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009900 tx=0x7fa5e802a410 comp rx=0 tx=0).stop 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 -- 172.21.15.150:0/2754306635 shutdown_connections 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 --2- 172.21.15.150:0/2754306635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f8105910 0x7fa5f810c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 --2- 172.21.15.150:0/2754306635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8104f50 0x7fa5f81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 --2- 172.21.15.150:0/2754306635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8104160 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 -- 172.21.15.150:0/2754306635 >> 172.21.15.150:0/2754306635 conn(0x7fa5f80ff4e0 msgr2=0x7fa5f8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 -- 172.21.15.150:0/2754306635 shutdown_connections 2024-09-15T22:12:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.520+0000 7fa5fd600640 1 -- 172.21.15.150:0/2754306635 wait complete. 2024-09-15T22:12:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.521+0000 7fa5fd600640 1 Processor -- start 2024-09-15T22:12:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.521+0000 7fa5fd600640 1 -- start start 2024-09-15T22:12:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5fd600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5fd600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8104f50 0x7fa5f819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5fd600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f8105910 0x7fa5f81a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5fd600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f810f9e0 con 0x7fa5f8103d60 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5fd600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f810f860 con 0x7fa5f8104f50 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5fd600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f810fb60 con 0x7fa5f8105910 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41674/0 (socket says 172.21.15.150:41674) 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 -- 172.21.15.150:0/1733104259 learned_addr learned my addr 172.21.15.150:0/1733104259 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f7400640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f8105910 0x7fa5f81a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5ee000640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8104f50 0x7fa5f819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 -- 172.21.15.150:0/1733104259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f8105910 msgr2=0x7fa5f81a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f8105910 0x7fa5f81a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 -- 172.21.15.150:0/1733104259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8104f50 msgr2=0x7fa5f819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8104f50 0x7fa5f819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.522+0000 7fa5f6a00640 1 -- 172.21.15.150:0/1733104259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f81a1bd0 con 0x7fa5f8103d60 2024-09-15T22:12:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.523+0000 7fa5f6a00640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8199fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8031610 tx=0x7fa5e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.523+0000 7fa5efe00640 1 -- 172.21.15.150:0/1733104259 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e803f030 con 0x7fa5f8103d60 2024-09-15T22:12:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.523+0000 7fa5efe00640 1 -- 172.21.15.150:0/1733104259 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5e8003ad0 con 0x7fa5f8103d60 2024-09-15T22:12:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.523+0000 7fa5efe00640 1 -- 172.21.15.150:0/1733104259 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8035070 con 0x7fa5f8103d60 2024-09-15T22:12:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.523+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f81a1e60 con 0x7fa5f8103d60 2024-09-15T22:12:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.523+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f81a22c0 con 0x7fa5f8103d60 2024-09-15T22:12:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa5efe00640 1 -- 172.21.15.150:0/1733104259 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa5e8042030 con 0x7fa5f8103d60 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 Processor -- start 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 -- start start 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a29490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a2e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a30f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c83598e100 con 0x55c835a299d0 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8359361b0 con 0x55c835a2ea60 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.526+0000 7fa60044f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c83598a0c0 con 0x55c835a29090 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a29490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a29490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:52878/0 (socket says 172.21.15.150:52878) 2024-09-15T22:12:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a2e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 -- 172.21.15.150:0/2561115899 learned_addr learned my addr 172.21.15.150:0/2561115899 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5ee000640 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a30f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 -- 172.21.15.150:0/2561115899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 msgr2=0x55c835a30f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a30f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 -- 172.21.15.150:0/2561115899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 msgr2=0x55c835a2e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a2e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5f7400640 1 -- 172.21.15.150:0/2561115899 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8356a1210 con 0x55c835a29090 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.527+0000 7fa5efe00640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa5dc0a3370 0x7fa5dc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.528+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a29490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009fd0 tx=0x7fa5f00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddd7ea469d4f8192 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.528+0000 7fa5efe00640 1 -- 172.21.15.150:0/1733104259 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa5e80efc60 con 0x7fa5f8103d60 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.528+0000 7fa5f6a00640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa5dc0a3370 0x7fa5dc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.528+0000 7fa5e7400640 1 -- 172.21.15.150:0/2561115899 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0004d20 con 0x55c835a29090 2024-09-15T22:12:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.528+0000 7fa5e7400640 1 -- 172.21.15.150:0/2561115899 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f0004050 con 0x55c835a29090 2024-09-15T22:12:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.528+0000 7fa5e7400640 1 -- 172.21.15.150:0/2561115899 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0005280 con 0x55c835a29090 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 -- 172.21.15.150:0/2561115899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 msgr2=0x55c835a29490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a29490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009fd0 tx=0x7fa5f00118d0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa5f6a00640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa5dc0a3370 0x7fa5dc0a5830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80b8c70 tx=0x7fa5e80f38b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 -- 172.21.15.150:0/2561115899 shutdown_connections 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a30f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a2e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 --2- 172.21.15.150:0/2561115899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a29490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 -- 172.21.15.150:0/2561115899 >> 172.21.15.150:0/2561115899 conn(0x55c835a24700 msgr2=0x55c835a24b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 -- 172.21.15.150:0/2561115899 shutdown_connections 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 -- 172.21.15.150:0/2561115899 wait complete. 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.529+0000 7fa60044f740 1 -- start start 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 Processor -- start 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a33270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a299d0 0x55c835a337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a2ea60 0x55c835a3a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c835a31a30 con 0x55c835a29090 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c835917090 con 0x55c835a299d0 2024-09-15T22:12:15.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c835a31bb0 con 0x55c835a2ea60 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa60044f740 10 client.0 _ll_register_callbacks cb 0x55c83596bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa5f7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a33270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa5f7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a33270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41694/0 (socket says 172.21.15.150:41694) 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa5f7400640 1 -- 172.21.15.150:0/3669270766 learned_addr learned my addr 172.21.15.150:0/3669270766 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.530+0000 7fa5ee000640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a299d0 0x55c835a337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a2ea60 0x55c835a3a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 -- 172.21.15.150:0/3669270766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a2ea60 msgr2=0x55c835a3a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a2ea60 0x55c835a3a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 -- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a299d0 msgr2=0x55c835a337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a299d0 0x55c835a337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 -- 172.21.15.150:0/3669270766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83576d620 con 0x55c835a29090 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5f7400640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a33270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00047f0 tx=0x7fa5f0004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680d2a6bd084f88c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:15.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5dbe00640 1 -- 172.21.15.150:0/3669270766 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003d30 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa5dbe00640 1 -- 172.21.15.150:0/3669270766 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa5f000f4e0 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.531+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f0004050 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa5dbe00640 1 -- 172.21.15.150:0/3669270766 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa5f000f6e0 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 10 client.15147 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c835a3d5e0 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa5dbe00640 1 -- 172.21.15.150:0/3669270766 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f0004050 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa5dbe00640 1 -- 172.21.15.150:0/3669270766 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa5f0028860 con 0x55c835a29090 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 10 client.15147 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 10 client.15147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 20 client.15147 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835a3eb80 0x55c835a40fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 4 client.15147 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:12:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.532+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c83599b830 con 0x55c835a3eb80 2024-09-15T22:12:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.533+0000 7fa5ee000640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835a3eb80 0x55c835a40fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.533+0000 7fa5ee000640 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835a3eb80 0x55c835a40fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=244ee56c5e353dc2 server_cookie=2110789cfc7bd999 in_seq=0 out_seq=0 2024-09-15T22:12:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.533+0000 7fa5dbe00640 10 client.15147 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa5dbe00640 1 -- 172.21.15.150:0/3669270766 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c83599b830 con 0x55c835a3eb80 2024-09-15T22:12:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa5dbe00640 10 client.15147 handle_command_reply: tid=0 2024-09-15T22:12:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 client.15147 shutdown 2024-09-15T22:12:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 msgr2=0x55c835a33270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a33270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00047f0 tx=0x7fa5f0004850 comp rx=0 tx=0).stop 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 shutdown_connections 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835a3eb80 0x55c835a40fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a2ea60 0x55c835a3a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a299d0 0x55c835a337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 --2- 172.21.15.150:0/3669270766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a33270 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 >> 172.21.15.150:0/3669270766 conn(0x55c835a24700 msgr2=0x55c835a25f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa5dbe00640 0 client.15147 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.534+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 shutdown_connections 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.535+0000 7fa60044f740 1 -- 172.21.15.150:0/3669270766 wait complete. 2024-09-15T22:12:15.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.535+0000 7fa60044f740 20 client.15147 trim_cache size 0 max 16384 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.549+0000 7fa60044f740 1 Processor -- start 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 -- start start 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a33730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a3a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a1f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81ab240 con 0x55c835a299d0 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81acd80 con 0x55c835a2ea60 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa60044f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81ab910 con 0x55c835a29090 2024-09-15T22:12:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a3a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a3a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41704/0 (socket says 172.21.15.150:41704) 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 -- 172.21.15.150:0/112931504 learned_addr learned my addr 172.21.15.150:0/112931504 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5f7400640 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a33730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5f7400640 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a1f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 -- 172.21.15.150:0/112931504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 msgr2=0x55c835a33730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a33730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 -- 172.21.15.150:0/112931504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 msgr2=0x55c835a1f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a1f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.550+0000 7fa5ee000640 1 -- 172.21.15.150:0/112931504 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c835a322e0 con 0x55c835a299d0 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.551+0000 7fa5f7400640 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a1f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.551+0000 7fa5ee000640 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a3a780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000c00 tx=0x7fa5e0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21834318db479441 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.551+0000 7fa5e6a00640 1 -- 172.21.15.150:0/112931504 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0022070 con 0x55c835a299d0 2024-09-15T22:12:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.551+0000 7fa5e6a00640 1 -- 172.21.15.150:0/112931504 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5e0003d20 con 0x55c835a299d0 2024-09-15T22:12:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.551+0000 7fa5e6a00640 1 -- 172.21.15.150:0/112931504 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0010960 con 0x55c835a299d0 2024-09-15T22:12:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 -- 172.21.15.150:0/112931504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 msgr2=0x55c835a3a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a3a780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000c00 tx=0x7fa5e0005f90 comp rx=0 tx=0).stop 2024-09-15T22:12:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 -- 172.21.15.150:0/112931504 shutdown_connections 2024-09-15T22:12:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a1f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a299d0 0x55c835a3a780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 --2- 172.21.15.150:0/112931504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a29090 0x55c835a33730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 -- 172.21.15.150:0/112931504 >> 172.21.15.150:0/112931504 conn(0x55c835a24700 msgr2=0x55c835a33020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 -- 172.21.15.150:0/112931504 shutdown_connections 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 -- 172.21.15.150:0/112931504 wait complete. 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 -- start start 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.552+0000 7fa60044f740 1 Processor -- start 2024-09-15T22:12:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a37c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a299d0 0x55c835a38190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a39130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81ac6b0 con 0x55c835a29090 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81abfe0 con 0x55c835a2ea60 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81a9220 con 0x55c835a299d0 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa60044f740 10 client.0 _ll_register_callbacks cb 0x7fa5e80f3780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa5f7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a37c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa5f7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a37c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41712/0 (socket says 172.21.15.150:41712) 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa5f7400640 1 -- 172.21.15.150:0/2002008287 learned_addr learned my addr 172.21.15.150:0/2002008287 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa5ee000640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a299d0 0x55c835a38190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.553+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a39130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5f7400640 1 -- 172.21.15.150:0/2002008287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a299d0 msgr2=0x55c835a38190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a299d0 0x55c835a38190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5f7400640 1 -- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 msgr2=0x55c835a39130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a39130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5f7400640 1 -- 172.21.15.150:0/2002008287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c835a39740 con 0x55c835a29090 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5f7400640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a37c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006010 tx=0x7fa5f0004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a754d4b1475ec6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5dbe00640 1 -- 172.21.15.150:0/2002008287 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003cb0 con 0x55c835a29090 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5e0003d20 con 0x55c835a29090 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5dbe00640 1 -- 172.21.15.150:0/2002008287 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa5f0003e50 con 0x55c835a29090 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa5dbe00640 1 -- 172.21.15.150:0/2002008287 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa5f0046030 con 0x55c835a29090 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa60044f740 10 client.15153 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.554+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c835a3a9c0 con 0x55c835a29090 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa5dbe00640 1 -- 172.21.15.150:0/2002008287 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5e0003d20 con 0x55c835a29090 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa5dbe00640 1 -- 172.21.15.150:0/2002008287 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa5f004b430 con 0x55c835a29090 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa60044f740 10 client.15153 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa60044f740 10 client.15153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa60044f740 20 client.15153 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa60044f740 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835aa9db0 0x55c835aac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa60044f740 4 client.15153 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c835a1fd80 con 0x55c835aa9db0 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.555+0000 7fa5ee000640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835aa9db0 0x55c835aac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.556+0000 7fa5ee000640 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835aa9db0 0x55c835aac1a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b282155c2a8b04f server_cookie=69ee329402be0faf in_seq=0 out_seq=0 2024-09-15T22:12:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.556+0000 7fa5dbe00640 10 client.15153 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa5dbe00640 1 -- 172.21.15.150:0/2002008287 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c835a1fd80 con 0x55c835aa9db0 2024-09-15T22:12:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa5dbe00640 10 client.15153 handle_command_reply: tid=0 2024-09-15T22:12:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 client.15153 shutdown 2024-09-15T22:12:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 msgr2=0x55c835a37c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a37c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006010 tx=0x7fa5f0004850 comp rx=0 tx=0).stop 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 shutdown_connections 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c835aa9db0 0x55c835aac1a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c835a2ea60 0x55c835a39130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c835a299d0 0x55c835a38190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 --2- 172.21.15.150:0/2002008287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c835a29090 0x55c835a37c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa5dbe00640 0 client.15153 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 >> 172.21.15.150:0/2002008287 conn(0x55c835a24700 msgr2=0x55c835a23060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 shutdown_connections 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.568+0000 7fa60044f740 1 -- 172.21.15.150:0/2002008287 wait complete. 2024-09-15T22:12:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa60044f740 20 client.15153 trim_cache size 0 max 16384 2024-09-15T22:12:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:12:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:12:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:12:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa5dc0a3370 msgr2=0x7fa5dc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa5dc0a3370 0x7fa5dc0a5830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80b8c70 tx=0x7fa5e80f38b0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 msgr2=0x7fa5f8199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8199fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8031610 tx=0x7fa5e8004270 comp rx=0 tx=0).stop 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 shutdown_connections 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f8105910 0x7fa5f81a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8104f50 0x7fa5f819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa5dc0a3370 0x7fa5dc0a5830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 --2- 172.21.15.150:0/1733104259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5f8103d60 0x7fa5f8199fb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 >> 172.21.15.150:0/1733104259 conn(0x7fa5f80ff4e0 msgr2=0x7fa5f8108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.569+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 shutdown_connections 2024-09-15T22:12:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:15.570+0000 7fa5fd600640 1 -- 172.21.15.150:0/1733104259 wait complete. 2024-09-15T22:12:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:16 smithi154 ceph-mon[34853]: pgmap v360: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-15T22:12:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:16 smithi150 ceph-mon[30886]: pgmap v360: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-15T22:12:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:16 smithi169 ceph-mon[35850]: pgmap v360: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-15T22:12:18.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:18 smithi154 ceph-mon[34853]: pgmap v361: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:12:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:18 smithi150 ceph-mon[30886]: pgmap v361: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:12:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:18 smithi169 ceph-mon[35850]: pgmap v361: 97 pgs: 97 active+clean; 653 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:12:20.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:20 smithi154 ceph-mon[34853]: pgmap v362: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-15T22:12:20.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:20 smithi150 ceph-mon[30886]: pgmap v362: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-15T22:12:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:20 smithi169 ceph-mon[35850]: pgmap v362: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-15T22:12:22.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:22 smithi154 ceph-mon[34853]: pgmap v363: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-15T22:12:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:22 smithi150 ceph-mon[30886]: pgmap v363: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-15T22:12:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:22 smithi169 ceph-mon[35850]: pgmap v363: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-15T22:12:24.511 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:24 smithi169 ceph-mon[35850]: pgmap v364: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-15T22:12:24.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:24 smithi154 ceph-mon[34853]: pgmap v364: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-15T22:12:24.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:24 smithi150 ceph-mon[30886]: pgmap v364: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-15T22:12:26.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:26 smithi154 ceph-mon[34853]: pgmap v365: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2024-09-15T22:12:26.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:26 smithi150 ceph-mon[30886]: pgmap v365: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2024-09-15T22:12:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:26 smithi169 ceph-mon[35850]: pgmap v365: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2024-09-15T22:12:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:28 smithi154 ceph-mon[34853]: pgmap v366: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-15T22:12:28.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:28 smithi150 ceph-mon[30886]: pgmap v366: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 -- 172.21.15.150:0/1831591907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8103050 msgr2=0x7fa8d8103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 --2- 172.21.15.150:0/1831591907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8103050 0x7fa8d8103450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009900 tx=0x7fa8cc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 -- 172.21.15.150:0/1831591907 shutdown_connections 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 --2- 172.21.15.150:0/1831591907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8101f40 0x7fa8d8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 --2- 172.21.15.150:0/1831591907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101580 0x7fa8d8101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 --2- 172.21.15.150:0/1831591907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8103050 0x7fa8d8103450 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 -- 172.21.15.150:0/1831591907 >> 172.21.15.150:0/1831591907 conn(0x7fa8d80fd0d0 msgr2=0x7fa8d80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 -- 172.21.15.150:0/1831591907 shutdown_connections 2024-09-15T22:12:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.688+0000 7fa8de000640 1 -- 172.21.15.150:0/1831591907 wait complete. 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 Processor -- start 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 -- start start 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8101580 0x7fa8d819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 0x7fa8d819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8103050 0x7fa8d81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d810d740 con 0x7fa8d8101580 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d810d5c0 con 0x7fa8d8103050 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8de000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d810d8c0 con 0x7fa8d8101f40 2024-09-15T22:12:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8dcc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8101580 0x7fa8d819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 0x7fa8d819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 0x7fa8d819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37948/0 (socket says 172.21.15.150:37948) 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.689+0000 7fa8d7e00640 1 -- 172.21.15.150:0/2567705723 learned_addr learned my addr 172.21.15.150:0/2567705723 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8dd600640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8103050 0x7fa8d81a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d7e00640 1 -- 172.21.15.150:0/2567705723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8103050 msgr2=0x7fa8d81a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8103050 0x7fa8d81a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d7e00640 1 -- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8101580 msgr2=0x7fa8d819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8101580 0x7fa8d819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d7e00640 1 -- 172.21.15.150:0/2567705723 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d81a1c70 con 0x7fa8d8101f40 2024-09-15T22:12:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 0x7fa8d819a590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400e9f0 tx=0x7fa8c400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.690+0000 7fa8d5600640 1 -- 172.21.15.150:0/2567705723 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400cd80 con 0x7fa8d8101f40 2024-09-15T22:12:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.691+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d81a1f60 con 0x7fa8d8101f40 2024-09-15T22:12:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.691+0000 7fa8d5600640 1 -- 172.21.15.150:0/2567705723 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c4005500 con 0x7fa8d8101f40 2024-09-15T22:12:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.691+0000 7fa8d5600640 1 -- 172.21.15.150:0/2567705723 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4010690 con 0x7fa8d8101f40 2024-09-15T22:12:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.691+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d81a23d0 con 0x7fa8d8101f40 2024-09-15T22:12:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.694+0000 7fa8e2412740 1 Processor -- start 2024-09-15T22:12:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 -- start start 2024-09-15T22:12:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 0x560659ef6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6ba0 0x560659efb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659efbc30 0x560659efe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560659e5b100 con 0x560659ef6ba0 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560659e031b0 con 0x560659ef6260 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8e2412740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560659e570c0 con 0x560659efbc30 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.695+0000 7fa8d5600640 1 -- 172.21.15.150:0/2567705723 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa8c40046c0 con 0x7fa8d8101f40 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 0x560659ef6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dcc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6ba0 0x560659efb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 0x560659ef6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:59656/0 (socket says 172.21.15.150:59656) 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 -- 172.21.15.150:0/1531675530 learned_addr learned my addr 172.21.15.150:0/1531675530 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659efbc30 0x560659efe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 -- 172.21.15.150:0/1531675530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659efbc30 msgr2=0x560659efe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659efbc30 0x560659efe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 -- 172.21.15.150:0/1531675530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6ba0 msgr2=0x560659efb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6ba0 0x560659efb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 -- 172.21.15.150:0/1531675530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560659b6e210 con 0x560659ef6260 2024-09-15T22:12:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659efbc30 0x560659efe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:12:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.696+0000 7fa8dd600640 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 0x560659ef6660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00039f0 tx=0x7fa8d0003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2857e9dda6169f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:28.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.697+0000 7fa8c9c00640 1 -- 172.21.15.150:0/1531675530 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d001a470 con 0x560659ef6260 2024-09-15T22:12:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.697+0000 7fa8c9c00640 1 -- 172.21.15.150:0/1531675530 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d0015070 con 0x560659ef6260 2024-09-15T22:12:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.697+0000 7fa8c9c00640 1 -- 172.21.15.150:0/1531675530 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0010900 con 0x560659ef6260 2024-09-15T22:12:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.698+0000 7fa8e2412740 1 -- 172.21.15.150:0/1531675530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 msgr2=0x560659ef6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.698+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 0x560659ef6660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00039f0 tx=0x7fa8d0003eb0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 -- 172.21.15.150:0/1531675530 shutdown_connections 2024-09-15T22:12:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659efbc30 0x560659efe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6ba0 0x560659efb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1531675530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6260 0x560659ef6660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 -- 172.21.15.150:0/1531675530 >> 172.21.15.150:0/1531675530 conn(0x560659ef18d0 msgr2=0x560659ef1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 -- 172.21.15.150:0/1531675530 shutdown_connections 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8e2412740 1 -- 172.21.15.150:0/1531675530 wait complete. 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8d5600640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8c00a3190 0x7fa8c00a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.699+0000 7fa8d5600640 1 -- 172.21.15.150:0/2567705723 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa8c40cfd70 con 0x7fa8d8101f40 2024-09-15T22:12:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.700+0000 7fa8e2412740 1 -- start start 2024-09-15T22:12:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.700+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8c00a3190 0x7fa8c00a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.700+0000 7fa8e2412740 1 Processor -- start 2024-09-15T22:12:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8c00a3190 0x7fa8c00a5650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc02a9e0 tx=0x7fa8cc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f08c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f09140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f10180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560659efec00 con 0x560659ef6260 2024-09-15T22:12:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560659de4090 con 0x560659efbc30 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560659efed80 con 0x560659ef6ba0 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.701+0000 7fa8e2412740 10 client.0 _ll_register_callbacks cb 0x560659e38f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f09140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f09140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37968/0 (socket says 172.21.15.150:37968) 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 -- 172.21.15.150:0/3314534465 learned_addr learned my addr 172.21.15.150:0/3314534465 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8dd600640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f10180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f08c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 -- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 msgr2=0x560659f10180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f10180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 -- 172.21.15.150:0/3314534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 msgr2=0x560659f08c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f08c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8d7e00640 1 -- 172.21.15.150:0/3314534465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560659c3a620 con 0x560659ef6ba0 2024-09-15T22:12:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8dd600640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f10180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.702+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f08c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f09140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40cd7e0 tx=0x7fa8c409bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e089a973d984ce57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8be000640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8be000640 1 -- 172.21.15.150:0/3314534465 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40a06b0 con 0x560659ef6ba0 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8be000640 1 -- 172.21.15.150:0/3314534465 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa8c40a4ae0 con 0x560659ef6ba0 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d0015070 con 0x560659ef6ba0 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8be000640 1 -- 172.21.15.150:0/3314534465 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8c40a4f70 con 0x560659ef6ba0 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8e2412740 10 client.25162 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.703+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560659f12fa0 con 0x560659ef6ba0 2024-09-15T22:12:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8be000640 1 -- 172.21.15.150:0/3314534465 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d0015070 con 0x560659ef6ba0 2024-09-15T22:12:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8be000640 1 -- 172.21.15.150:0/3314534465 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa8c40bc0c0 con 0x560659ef6ba0 2024-09-15T22:12:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8e2412740 10 client.25162 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8e2412740 10 client.25162 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8e2412740 20 client.25162 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8e2412740 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f14620 0x560659f16a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8e2412740 4 client.25162 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560659e68830 con 0x560659f14620 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.704+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f14620 0x560659f16a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.705+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f14620 0x560659f16a30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe85aa9ff91924c server_cookie=fe86271438caa0a4 in_seq=0 out_seq=0 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.705+0000 7fa8be000640 10 client.25162 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8be000640 1 -- 172.21.15.150:0/3314534465 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560659e68830 con 0x560659f14620 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8be000640 10 client.25162 handle_command_reply: tid=0 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 client.25162 shutdown 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 msgr2=0x560659f09140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f09140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40cd7e0 tx=0x7fa8c409bec0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 shutdown_connections 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f14620 0x560659f16a30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f10180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f09140 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 --2- 172.21.15.150:0/3314534465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f08c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 >> 172.21.15.150:0/3314534465 conn(0x560659ef18d0 msgr2=0x560659ef30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8be000640 0 client.25162 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.706+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 shutdown_connections 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.707+0000 7fa8e2412740 1 -- 172.21.15.150:0/3314534465 wait complete. 2024-09-15T22:12:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.707+0000 7fa8e2412740 20 client.25162 trim_cache size 0 max 16384 2024-09-15T22:12:28.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:28 smithi169 ceph-mon[35850]: pgmap v366: 97 pgs: 97 active+clean; 655 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-15T22:12:28.724 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 Processor -- start 2024-09-15T22:12:28.724 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 -- start start 2024-09-15T22:12:28.724 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6260 0x560659eec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.724 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6ba0 0x560659f10140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.724 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 0x560659ef7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81a6cf0 con 0x560659efbc30 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81a8830 con 0x560659ef6ba0 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8e2412740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81a73c0 con 0x560659ef6260 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8dd600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 0x560659ef7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8dd600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 0x560659ef7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47940/0 (socket says 172.21.15.150:47940) 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8dd600640 1 -- 172.21.15.150:0/1711144739 learned_addr learned my addr 172.21.15.150:0/1711144739 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6260 0x560659eec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.725 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.723+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6ba0 0x560659f10140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8dd600640 1 -- 172.21.15.150:0/1711144739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6260 msgr2=0x560659eec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8dd600640 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6260 0x560659eec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8dd600640 1 -- 172.21.15.150:0/1711144739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6ba0 msgr2=0x560659f10140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8dd600640 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6ba0 0x560659f10140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8dd600640 1 -- 172.21.15.150:0/1711144739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560659f17080 con 0x560659efbc30 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6ba0 0x560659f10140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8dd600640 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 0x560659ef7db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00039f0 tx=0x7fa8d0005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8d45a2217b681c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8c9200640 1 -- 172.21.15.150:0/1711144739 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00059d0 con 0x560659efbc30 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8c9200640 1 -- 172.21.15.150:0/1711144739 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d0015040 con 0x560659efbc30 2024-09-15T22:12:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.724+0000 7fa8c9200640 1 -- 172.21.15.150:0/1711144739 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d001a8a0 con 0x560659efbc30 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 -- 172.21.15.150:0/1711144739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 msgr2=0x560659ef7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 0x560659ef7db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00039f0 tx=0x7fa8d0005e30 comp rx=0 tx=0).stop 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 -- 172.21.15.150:0/1711144739 shutdown_connections 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659efbc30 0x560659ef7db0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659ef6ba0 0x560659f10140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 --2- 172.21.15.150:0/1711144739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6260 0x560659eec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 -- 172.21.15.150:0/1711144739 >> 172.21.15.150:0/1711144739 conn(0x560659ef18d0 msgr2=0x560659efb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 -- 172.21.15.150:0/1711144739 shutdown_connections 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.725+0000 7fa8e2412740 1 -- 172.21.15.150:0/1711144739 wait complete. 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 -- start start 2024-09-15T22:12:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 Processor -- start 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f0fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f0c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f0ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81a8160 con 0x560659ef6260 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81a7a90 con 0x560659efbc30 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.726+0000 7fa8e2412740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81a4d10 con 0x560659ef6ba0 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8e2412740 10 client.0 _ll_register_callbacks cb 0x7fa8c4009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f0fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f0fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47956/0 (socket says 172.21.15.150:47956) 2024-09-15T22:12:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 -- 172.21.15.150:0/694110522 learned_addr learned my addr 172.21.15.150:0/694110522 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dd600640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f0ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f0c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 -- 172.21.15.150:0/694110522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 msgr2=0x560659f0c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f0c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 -- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 msgr2=0x560659f0ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f0ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.727+0000 7fa8dcc00640 1 -- 172.21.15.150:0/694110522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560659f0d510 con 0x560659ef6260 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8dcc00640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f0fe90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006010 tx=0x7fa8cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df66353260c7adbd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8be000640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8be000640 1 -- 172.21.15.150:0/694110522 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc035040 con 0x560659ef6260 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8be000640 1 -- 172.21.15.150:0/694110522 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa8cc0046c0 con 0x560659ef6260 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d0015040 con 0x560659ef6260 2024-09-15T22:12:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8be000640 1 -- 172.21.15.150:0/694110522 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8cc0048c0 con 0x560659ef6260 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8e2412740 10 client.15171 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560659f7e4b0 con 0x560659ef6260 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.728+0000 7fa8be000640 1 -- 172.21.15.150:0/694110522 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d0015040 con 0x560659ef6260 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8be000640 1 -- 172.21.15.150:0/694110522 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa8cc05b070 con 0x560659ef6260 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8e2412740 10 client.15171 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8e2412740 10 client.15171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8e2412740 20 client.15171 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8e2412740 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f7ee10 0x560659f81230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8e2412740 4 client.15171 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560659e62b80 con 0x560659f7ee10 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f7ee10 0x560659f81230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8d7e00640 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f7ee10 0x560659f81230 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ddece0d25d9df4a server_cookie=d5e475d7bc5b0454 in_seq=0 out_seq=0 2024-09-15T22:12:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.729+0000 7fa8be000640 10 client.15171 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8be000640 1 -- 172.21.15.150:0/694110522 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560659e62b80 con 0x560659f7ee10 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8be000640 10 client.15171 handle_command_reply: tid=0 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 client.15171 shutdown 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 msgr2=0x560659f0fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f0fe90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006010 tx=0x7fa8cc009260 comp rx=0 tx=0).stop 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 shutdown_connections 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560659f7ee10 0x560659f81230 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560659efbc30 0x560659f0ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560659ef6ba0 0x560659f0c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8be000640 0 client.15171 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 --2- 172.21.15.150:0/694110522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560659ef6260 0x560659f0fe90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.735+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 >> 172.21.15.150:0/694110522 conn(0x560659ef18d0 msgr2=0x560659efb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 shutdown_connections 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8e2412740 1 -- 172.21.15.150:0/694110522 wait complete. 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8e2412740 20 client.15171 trim_cache size 0 max 16384 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:12:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8c00a3190 msgr2=0x7fa8c00a5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8de000640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8c00a3190 0x7fa8c00a5650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc02a9e0 tx=0x7fa8cc000bc0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 msgr2=0x7fa8d819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.736+0000 7fa8de000640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 0x7fa8d819a590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400e9f0 tx=0x7fa8c400edf0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 shutdown_connections 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8103050 0x7fa8d81a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8d8101f40 0x7fa8d819a590 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8c00a3190 0x7fa8c00a5650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 --2- 172.21.15.150:0/2567705723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8101580 0x7fa8d819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 >> 172.21.15.150:0/2567705723 conn(0x7fa8d80fd0d0 msgr2=0x7fa8d8108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 shutdown_connections 2024-09-15T22:12:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:28.737+0000 7fa8de000640 1 -- 172.21.15.150:0/2567705723 wait complete. 2024-09-15T22:12:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:30 smithi150 ceph-mon[30886]: pgmap v367: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-15T22:12:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:30 smithi154 ceph-mon[34853]: pgmap v367: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-15T22:12:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:30 smithi169 ceph-mon[35850]: pgmap v367: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-15T22:12:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:32 smithi154 ceph-mon[34853]: pgmap v368: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:12:32.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:32 smithi150 ceph-mon[30886]: pgmap v368: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:12:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:32 smithi169 ceph-mon[35850]: pgmap v368: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:12:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:34 smithi154 ceph-mon[34853]: pgmap v369: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-15T22:12:34.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:34 smithi150 ceph-mon[30886]: pgmap v369: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-15T22:12:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:34 smithi169 ceph-mon[35850]: pgmap v369: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-15T22:12:36.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:36 smithi154 ceph-mon[34853]: pgmap v370: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-15T22:12:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:36 smithi150 ceph-mon[30886]: pgmap v370: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-15T22:12:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:36 smithi169 ceph-mon[35850]: pgmap v370: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-15T22:12:38.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:38 smithi154 ceph-mon[34853]: pgmap v371: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-15T22:12:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:38 smithi150 ceph-mon[30886]: pgmap v371: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-15T22:12:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:38 smithi169 ceph-mon[35850]: pgmap v371: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-15T22:12:40.546 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:40 smithi150 ceph-mon[30886]: pgmap v372: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-15T22:12:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:40 smithi169 ceph-mon[35850]: pgmap v372: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-15T22:12:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:40 smithi154 ceph-mon[34853]: pgmap v372: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.914+0000 7f3c32200640 1 -- 172.21.15.150:0/496713690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 msgr2=0x7f3c2c10c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.914+0000 7f3c32200640 1 --2- 172.21.15.150:0/496713690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 0x7f3c2c10c0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009ca0 tx=0x7f3c2402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 -- 172.21.15.150:0/496713690 shutdown_connections 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 --2- 172.21.15.150:0/496713690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 0x7f3c2c10c0e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 --2- 172.21.15.150:0/496713690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074f60 0x7f3c2c1097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 --2- 172.21.15.150:0/496713690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074620 0x7f3c2c074a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 -- 172.21.15.150:0/496713690 >> 172.21.15.150:0/496713690 conn(0x7f3c2c0fd0d0 msgr2=0x7f3c2c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 -- 172.21.15.150:0/496713690 shutdown_connections 2024-09-15T22:12:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.915+0000 7f3c32200640 1 -- 172.21.15.150:0/496713690 wait complete. 2024-09-15T22:12:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.916+0000 7f3c32200640 1 Processor -- start 2024-09-15T22:12:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.916+0000 7f3c32200640 1 -- start start 2024-09-15T22:12:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c32200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 0x7f3c2c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c32200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074f60 0x7f3c2c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c32200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 0x7f3c2c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c32200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c10f940 con 0x7f3c2c074f60 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c32200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c10f7c0 con 0x7f3c2c074620 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c32200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c10fac0 con 0x7f3c2c109cf0 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c2be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074f60 0x7f3c2c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c30e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 0x7f3c2c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c30e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 0x7f3c2c199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:41674/0 (socket says 172.21.15.150:41674) 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c30e00640 1 -- 172.21.15.150:0/510031505 learned_addr learned my addr 172.21.15.150:0/510031505 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c2be00640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074f60 0x7f3c2c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49790/0 (socket says 172.21.15.150:49790) 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.917+0000 7f3c31800640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 0x7f3c2c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c30e00640 1 -- 172.21.15.150:0/510031505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 msgr2=0x7f3c2c1a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c30e00640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 0x7f3c2c1a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c30e00640 1 -- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074f60 msgr2=0x7f3c2c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c30e00640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074f60 0x7f3c2c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c30e00640 1 -- 172.21.15.150:0/510031505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c1a1b90 con 0x7f3c2c074620 2024-09-15T22:12:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c30e00640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 0x7f3c2c199f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000ea60 tx=0x7f3c2000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c29600640 1 -- 172.21.15.150:0/510031505 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000cde0 con 0x7f3c2c074620 2024-09-15T22:12:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c29600640 1 -- 172.21.15.150:0/510031505 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c200035f0 con 0x7f3c2c074620 2024-09-15T22:12:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2c1a1e80 con 0x7f3c2c074620 2024-09-15T22:12:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c29600640 1 -- 172.21.15.150:0/510031505 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20010690 con 0x7f3c2c074620 2024-09-15T22:12:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.918+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2c1a22e0 con 0x7f3c2c074620 2024-09-15T22:12:41.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.922+0000 7f3c36674740 1 Processor -- start 2024-09-15T22:12:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 -- start start 2024-09-15T22:12:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faefe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3faf7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fa4c100 con 0x55fe3faf5440 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe3f9f41b0 con 0x55fe3faf03b0 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c36674740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fe3fa480c0 con 0x55fe3faefa70 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c31800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faefe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c31800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faefe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:50822/0 (socket says 172.21.15.150:50822) 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.923+0000 7f3c31800640 1 -- 172.21.15.150:0/2879000493 learned_addr learned my addr 172.21.15.150:0/2879000493 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c29600640 1 -- 172.21.15.150:0/510031505 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f3c200037a0 con 0x7f3c2c074620 2024-09-15T22:12:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c2be00640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3faf7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c30e00640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c31800640 1 -- 172.21.15.150:0/2879000493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 msgr2=0x55fe3faf4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c31800640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c31800640 1 -- 172.21.15.150:0/2879000493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 msgr2=0x55fe3faf7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c31800640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3faf7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c31800640 1 -- 172.21.15.150:0/2879000493 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3f75f210 con 0x55fe3faefa70 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c30e00640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.924+0000 7f3c2be00640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3faf7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.925+0000 7f3c31800640 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faefe70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009ca0 tx=0x7f3c240093c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87be71c031447848 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.925+0000 7f3c1e000640 1 -- 172.21.15.150:0/2879000493 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24031650 con 0x55fe3faefa70 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.925+0000 7f3c1e000640 1 -- 172.21.15.150:0/2879000493 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c24036030 con 0x55fe3faefa70 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.925+0000 7f3c1e000640 1 -- 172.21.15.150:0/2879000493 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24004740 con 0x55fe3faefa70 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c29600640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3c140a32c0 0x7f3c140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c29600640 1 -- 172.21.15.150:0/510031505 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3c200cfc20 con 0x7f3c2c074620 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c30e00640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3c140a32c0 0x7f3c140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 -- 172.21.15.150:0/2879000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 msgr2=0x55fe3faefe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faefe70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009ca0 tx=0x7f3c240093c0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 -- 172.21.15.150:0/2879000493 shutdown_connections 2024-09-15T22:12:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3faf7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 --2- 172.21.15.150:0/2879000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faefe70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.926+0000 7f3c36674740 1 -- 172.21.15.150:0/2879000493 >> 172.21.15.150:0/2879000493 conn(0x55fe3faeb0e0 msgr2=0x55fe3faeb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.927+0000 7f3c30e00640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3c140a32c0 0x7f3c140a5780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c2009beb0 tx=0x7f3c2000ef90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.927+0000 7f3c36674740 1 -- 172.21.15.150:0/2879000493 shutdown_connections 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.927+0000 7f3c36674740 1 -- 172.21.15.150:0/2879000493 wait complete. 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 -- start start 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 Processor -- start 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faf9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3fb01020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fe3faf8230 con 0x55fe3faf5440 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe3f9d5090 con 0x55fe3faf03b0 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fe3faf83b0 con 0x55fe3faefa70 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.928+0000 7f3c36674740 10 client.0 _ll_register_callbacks cb 0x55fe3fa29f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faf9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3fb01020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3fb01020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49804/0 (socket says 172.21.15.150:49804) 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 -- 172.21.15.150:0/211202349 learned_addr learned my addr 172.21.15.150:0/211202349 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c2be00640 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 -- 172.21.15.150:0/211202349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 msgr2=0x55fe3faf9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faf9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 -- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 msgr2=0x55fe3faf9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.929+0000 7f3c31800640 1 -- 172.21.15.150:0/211202349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3f82b620 con 0x55fe3faf5440 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c31800640 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3fb01020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55fe3faf9070 tx=0x7f3c2402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38304bf0f50753f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c12a00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:12:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c12a00640 1 -- 172.21.15.150:0/211202349 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24059060 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c12a00640 1 -- 172.21.15.150:0/211202349 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3c24003c30 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c24036030 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c12a00640 1 -- 172.21.15.150:0/211202349 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c2404a040 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c36674740 10 client.15183 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.930+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe3faf8230 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c12a00640 1 -- 172.21.15.150:0/211202349 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c24036030 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c12a00640 1 -- 172.21.15.150:0/211202349 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3c24043070 con 0x55fe3faf5440 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c36674740 10 client.15183 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c36674740 10 client.15183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c36674740 20 client.15183 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c36674740 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3fb05220 0x55fe3fb07640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c36674740 4 client.15183 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.931+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe3fa59830 con 0x55fe3fb05220 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.932+0000 7f3c2be00640 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3fb05220 0x55fe3fb07640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.932+0000 7f3c2be00640 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3fb05220 0x55fe3fb07640 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e7e9d1e3b017e41 server_cookie=5071aa2f6af2d958 in_seq=0 out_seq=0 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.932+0000 7f3c12a00640 10 client.15183 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c12a00640 1 -- 172.21.15.150:0/211202349 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe3fa59830 con 0x55fe3fb05220 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c12a00640 10 client.15183 handle_command_reply: tid=0 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 client.15183 shutdown 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 msgr2=0x55fe3fb01020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3fb01020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55fe3faf9070 tx=0x7f3c2402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 shutdown_connections 2024-09-15T22:12:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3fb05220 0x55fe3fb07640 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faf5440 0x55fe3fb01020 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faf9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 --2- 172.21.15.150:0/211202349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3faf9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c12a00640 0 client.15183 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.933+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 >> 172.21.15.150:0/211202349 conn(0x55fe3faeb0e0 msgr2=0x55fe3faec8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.934+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 shutdown_connections 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.934+0000 7f3c36674740 1 -- 172.21.15.150:0/211202349 wait complete. 2024-09-15T22:12:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.934+0000 7f3c36674740 20 client.15183 trim_cache size 0 max 16384 2024-09-15T22:12:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.963+0000 7f3c36674740 1 Processor -- start 2024-09-15T22:12:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.963+0000 7f3c36674740 1 -- start start 2024-09-15T22:12:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.963+0000 7f3c36674740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 0x55fe3fadd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.963+0000 7f3c36674740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faefa70 0x55fe3fb00f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.963+0000 7f3c36674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c36674740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c1a6bf0 con 0x55fe3faefa70 2024-09-15T22:12:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c36674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c1a8730 con 0x55fe3faf03b0 2024-09-15T22:12:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c36674740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c1a72c0 con 0x55fe3faeb0e0 2024-09-15T22:12:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c2be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faefa70 0x55fe3fb00f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 0x55fe3fadd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 0x55fe3fadd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:50832/0 (socket says 172.21.15.150:50832) 2024-09-15T22:12:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 -- 172.21.15.150:0/2894495791 learned_addr learned my addr 172.21.15.150:0/2894495791 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 -- 172.21.15.150:0/2894495791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 msgr2=0x55fe3faebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 -- 172.21.15.150:0/2894495791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faefa70 msgr2=0x55fe3fb00f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faefa70 0x55fe3fb00f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.964+0000 7f3c31800640 1 -- 172.21.15.150:0/2894495791 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3fb07ca0 con 0x55fe3faeb0e0 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.965+0000 7f3c31800640 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 0x55fe3fadd8d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c24031580 tx=0x7f3c24009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7a70ca3f1c44c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.965+0000 7f3c1d600640 1 -- 172.21.15.150:0/2894495791 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24040020 con 0x55fe3faeb0e0 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.965+0000 7f3c1d600640 1 -- 172.21.15.150:0/2894495791 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c24036040 con 0x55fe3faeb0e0 2024-09-15T22:12:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.965+0000 7f3c1d600640 1 -- 172.21.15.150:0/2894495791 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24059070 con 0x55fe3faeb0e0 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 -- 172.21.15.150:0/2894495791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 msgr2=0x55fe3fadd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 0x55fe3fadd8d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c24031580 tx=0x7f3c24009940 comp rx=0 tx=0).stop 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 -- 172.21.15.150:0/2894495791 shutdown_connections 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faefa70 0x55fe3fb00f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 --2- 172.21.15.150:0/2894495791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faeb0e0 0x55fe3fadd8d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 -- 172.21.15.150:0/2894495791 >> 172.21.15.150:0/2894495791 conn(0x55fe3faf4f90 msgr2=0x55fe3faf9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 -- 172.21.15.150:0/2894495791 shutdown_connections 2024-09-15T22:12:41.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.966+0000 7f3c36674740 1 -- 172.21.15.150:0/2894495791 wait complete. 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 -- start start 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 Processor -- start 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faeb0e0 0x55fe3fafe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3fafea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c1a8060 con 0x55fe3faeb0e0 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c1a7990 con 0x55fe3faf03b0 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.967+0000 7f3c36674740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c1a4bd0 con 0x55fe3faefa70 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c36674740 10 client.0 _ll_register_callbacks cb 0x7f3c24009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c31800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faeb0e0 0x55fe3fafe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c31800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faeb0e0 0x55fe3fafe4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49816/0 (socket says 172.21.15.150:49816) 2024-09-15T22:12:41.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c2be00640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3fafea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c31800640 1 -- 172.21.15.150:0/3138515793 learned_addr learned my addr 172.21.15.150:0/3138515793 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:41.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c31800640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c2be00640 1 -- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 msgr2=0x55fe3faffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c2be00640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c2be00640 1 -- 172.21.15.150:0/3138515793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faeb0e0 msgr2=0x55fe3fafe4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c2be00640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faeb0e0 0x55fe3fafe4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.968+0000 7f3c2be00640 1 -- 172.21.15.150:0/3138515793 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3fb00040 con 0x55fe3faefa70 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c2be00640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3fafea20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55fe3fb07e70 tx=0x7f3c1801f920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e495bc2cb3caa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c12a00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c12a00640 1 -- 172.21.15.150:0/3138515793 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18005220 con 0x55fe3faefa70 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c12a00640 1 -- 172.21.15.150:0/3138515793 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3c180053c0 con 0x55fe3faefa70 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c24036040 con 0x55fe3faefa70 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c12a00640 1 -- 172.21.15.150:0/3138515793 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c180055c0 con 0x55fe3faefa70 2024-09-15T22:12:41.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c36674740 10 client.25186 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.969+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe3fb01420 con 0x55fe3faefa70 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c12a00640 1 -- 172.21.15.150:0/3138515793 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c24036040 con 0x55fe3faefa70 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c12a00640 1 -- 172.21.15.150:0/3138515793 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3c180109c0 con 0x55fe3faefa70 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c36674740 10 client.25186 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c36674740 10 client.25186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c36674740 20 client.25186 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c36674740 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3faf5440 0x55fe3fb72720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c36674740 4 client.25186 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.970+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe3fa53b80 con 0x55fe3faf5440 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.971+0000 7f3c31800640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3faf5440 0x55fe3fb72720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.971+0000 7f3c31800640 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3faf5440 0x55fe3fb72720 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f165e97b6df379f3 server_cookie=84ddb4b95b933c4e in_seq=0 out_seq=0 2024-09-15T22:12:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.971+0000 7f3c12a00640 10 client.25186 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c12a00640 1 -- 172.21.15.150:0/3138515793 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe3fa53b80 con 0x55fe3faf5440 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c12a00640 10 client.25186 handle_command_reply: tid=0 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 client.25186 shutdown 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 msgr2=0x55fe3fafea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3fafea20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55fe3fb07e70 tx=0x7f3c1801f920 comp rx=0 tx=0).stop 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 shutdown_connections 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55fe3faf5440 0x55fe3fb72720 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe3faf03b0 0x55fe3faffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fe3faefa70 0x55fe3fafea20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 --2- 172.21.15.150:0/3138515793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe3faeb0e0 0x55fe3fafe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 >> 172.21.15.150:0/3138515793 conn(0x55fe3faf4f90 msgr2=0x55fe3fae11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.979+0000 7f3c12a00640 0 client.25186 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.980+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 shutdown_connections 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.980+0000 7f3c36674740 1 -- 172.21.15.150:0/3138515793 wait complete. 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.980+0000 7f3c36674740 20 client.25186 trim_cache size 0 max 16384 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:12:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:12:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3c140a32c0 msgr2=0x7f3c140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3c140a32c0 0x7f3c140a5780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c2009beb0 tx=0x7f3c2000ef90 comp rx=0 tx=0).stop 2024-09-15T22:12:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 msgr2=0x7f3c2c199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 0x7f3c2c199f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000ea60 tx=0x7f3c2000ef20 comp rx=0 tx=0).stop 2024-09-15T22:12:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 shutdown_connections 2024-09-15T22:12:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c2c109cf0 0x7f3c2c1a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f3c140a32c0 0x7f3c140a5780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c2c074f60 0x7f3c2c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 --2- 172.21.15.150:0/510031505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c2c074620 0x7f3c2c199f70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 >> 172.21.15.150:0/510031505 conn(0x7f3c2c0fd0d0 msgr2=0x7f3c2c105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 shutdown_connections 2024-09-15T22:12:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:41.981+0000 7f3c32200640 1 -- 172.21.15.150:0/510031505 wait complete. 2024-09-15T22:12:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:42 smithi150 ceph-mon[30886]: pgmap v373: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-15T22:12:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:42 smithi169 ceph-mon[35850]: pgmap v373: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-15T22:12:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:42 smithi154 ceph-mon[34853]: pgmap v373: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-15T22:12:44.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:44 smithi150 ceph-mon[30886]: pgmap v374: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:12:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:44 smithi169 ceph-mon[35850]: pgmap v374: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:12:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:44 smithi154 ceph-mon[34853]: pgmap v374: 97 pgs: 97 active+clean; 666 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:12:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:46 smithi150 ceph-mon[30886]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-15T22:12:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:46 smithi169 ceph-mon[35850]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-15T22:12:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:46 smithi154 ceph-mon[34853]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-15T22:12:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:48 smithi150 ceph-mon[30886]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-15T22:12:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:48 smithi169 ceph-mon[35850]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-15T22:12:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:48 smithi154 ceph-mon[34853]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-15T22:12:49.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:49 smithi150 ceph-mon[30886]: pgmap v377: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-15T22:12:49.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:49 smithi169 ceph-mon[35850]: pgmap v377: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-15T22:12:49.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:49 smithi154 ceph-mon[34853]: pgmap v377: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-15T22:12:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:52 smithi154 ceph-mon[34853]: pgmap v378: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:12:52.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:52 smithi150 ceph-mon[30886]: pgmap v378: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:12:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:52 smithi169 ceph-mon[35850]: pgmap v378: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:12:54.511 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:54 smithi169 ceph-mon[35850]: pgmap v379: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-15T22:12:54.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:54 smithi154 ceph-mon[34853]: pgmap v379: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-15T22:12:54.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:54 smithi150 ceph-mon[30886]: pgmap v379: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.166+0000 7f5291400640 1 -- 172.21.15.150:0/1601854911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c104d60 msgr2=0x7f528c1051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.166+0000 7f5291400640 1 --2- 172.21.15.150:0/1601854911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c104d60 0x7f528c1051e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5278009900 tx=0x7f527802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 -- 172.21.15.150:0/1601854911 shutdown_connections 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 --2- 172.21.15.150:0/1601854911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c105720 0x7f528c10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 --2- 172.21.15.150:0/1601854911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c104d60 0x7f528c1051e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 --2- 172.21.15.150:0/1601854911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f528c103b70 0x7f528c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 -- 172.21.15.150:0/1601854911 >> 172.21.15.150:0/1601854911 conn(0x7f528c0ff2f0 msgr2=0x7f528c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 -- 172.21.15.150:0/1601854911 shutdown_connections 2024-09-15T22:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.167+0000 7f5291400640 1 -- 172.21.15.150:0/1601854911 wait complete. 2024-09-15T22:12:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.168+0000 7f5291400640 1 Processor -- start 2024-09-15T22:12:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.168+0000 7f5291400640 1 -- start start 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5291400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 0x7f528c199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5291400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f528c104d60 0x7f528c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5291400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c105720 0x7f528c1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5291400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f528c10f840 con 0x7f528c104d60 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5291400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f528c10f6c0 con 0x7f528c103b70 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5291400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f528c10f9c0 con 0x7f528c105720 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f528b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f528c104d60 0x7f528c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f528be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 0x7f528c199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f528be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 0x7f528c199e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:40862/0 (socket says 172.21.15.150:40862) 2024-09-15T22:12:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f528be00640 1 -- 172.21.15.150:0/2819607570 learned_addr learned my addr 172.21.15.150:0/2819607570 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.169+0000 7f5290a00640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c105720 0x7f528c1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f528be00640 1 -- 172.21.15.150:0/2819607570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c105720 msgr2=0x7f528c1a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f528be00640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c105720 0x7f528c1a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f528be00640 1 -- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f528c104d60 msgr2=0x7f528c19a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f528be00640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f528c104d60 0x7f528c19a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f528be00640 1 -- 172.21.15.150:0/2819607570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c1a1a80 con 0x7f528c103b70 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f528be00640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 0x7f528c199e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f527c00e9c0 tx=0x7f527c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.170+0000 7f5288c00640 1 -- 172.21.15.150:0/2819607570 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c00cd80 con 0x7f528c103b70 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.171+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c1a1d70 con 0x7f528c103b70 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.171+0000 7f5288c00640 1 -- 172.21.15.150:0/2819607570 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527c0035f0 con 0x7f528c103b70 2024-09-15T22:12:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.171+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c1a21d0 con 0x7f528c103b70 2024-09-15T22:12:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.171+0000 7f5288c00640 1 -- 172.21.15.150:0/2819607570 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c004220 con 0x7f528c103b70 2024-09-15T22:12:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.175+0000 7f5295a2e740 1 Processor -- start 2024-09-15T22:12:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.175+0000 7f5295a2e740 1 -- start start 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 0x55bcb2958e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb295de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb295e440 0x55bcb2960900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5295a2e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bcb28b5100 con 0x55bcb295e440 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5295a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bcb285d1b0 con 0x55bcb29593b0 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5295a2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bcb28b10c0 con 0x55bcb2958a70 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5290a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 0x55bcb2958e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f528b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb295e440 0x55bcb2960900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5290a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 0x55bcb2958e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:46932/0 (socket says 172.21.15.150:46932) 2024-09-15T22:12:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.176+0000 7f5290a00640 1 -- 172.21.15.150:0/2572233696 learned_addr learned my addr 172.21.15.150:0/2572233696 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5290a00640 1 -- 172.21.15.150:0/2572233696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 msgr2=0x55bcb295de70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5290a00640 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb295de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5290a00640 1 -- 172.21.15.150:0/2572233696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb295e440 msgr2=0x55bcb2960900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5290a00640 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb295e440 0x55bcb2960900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5290a00640 1 -- 172.21.15.150:0/2572233696 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcb25c8210 con 0x55bcb2958a70 2024-09-15T22:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5288c00640 1 -- 172.21.15.150:0/2819607570 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f527c0037a0 con 0x7f528c103b70 2024-09-15T22:12:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5290a00640 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 0x55bcb2958e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5284009fd0 tx=0x7f52840118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d56dbd5ad9bd6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.177+0000 7f5281200640 1 -- 172.21.15.150:0/2572233696 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284004d20 con 0x55bcb2958a70 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.178+0000 7f5281200640 1 -- 172.21.15.150:0/2572233696 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5284004050 con 0x55bcb2958a70 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.178+0000 7f5281200640 1 -- 172.21.15.150:0/2572233696 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284005260 con 0x55bcb2958a70 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.178+0000 7f5295a2e740 1 -- 172.21.15.150:0/2572233696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 msgr2=0x55bcb2958e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.178+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 0x55bcb2958e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5284009fd0 tx=0x7f52840118d0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 -- 172.21.15.150:0/2572233696 shutdown_connections 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb295e440 0x55bcb2960900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb295de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2572233696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb2958a70 0x55bcb2958e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 -- 172.21.15.150:0/2572233696 >> 172.21.15.150:0/2572233696 conn(0x55bcb294b8d0 msgr2=0x55bcb294bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 -- 172.21.15.150:0/2572233696 shutdown_connections 2024-09-15T22:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5295a2e740 1 -- 172.21.15.150:0/2572233696 wait complete. 2024-09-15T22:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5288c00640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52700a33d0 0x7f52700a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.179+0000 7f5288c00640 1 -- 172.21.15.150:0/2819607570 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f527c004020 con 0x7f528c103b70 2024-09-15T22:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.180+0000 7f5295a2e740 1 -- start start 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.180+0000 7f528b400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52700a33d0 0x7f52700a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.180+0000 7f5295a2e740 1 Processor -- start 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.180+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 0x55bcb2962c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb29593b0 0x55bcb29631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb296a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f5295a2e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bcb2961410 con 0x55bcb29593b0 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f5295a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bcb283e090 con 0x55bcb2958a70 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f5295a2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bcb2961590 con 0x55bcb295e440 2024-09-15T22:12:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f5295a2e740 10 client.0 _ll_register_callbacks cb 0x55bcb2892f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528b400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52700a33d0 0x7f52700a5890 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5278031440 tx=0x7f52780315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 0x55bcb2962c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 0x55bcb2962c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:40874/0 (socket says 172.21.15.150:40874) 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528be00640 1 -- 172.21.15.150:0/104210167 learned_addr learned my addr 172.21.15.150:0/104210167 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528be00640 1 -- 172.21.15.150:0/104210167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 msgr2=0x55bcb296a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528be00640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb296a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.181+0000 7f528be00640 1 -- 172.21.15.150:0/104210167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb29593b0 msgr2=0x55bcb29631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f528b400640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb29593b0 0x55bcb29631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f528be00640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb29593b0 0x55bcb29631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f528be00640 1 -- 172.21.15.150:0/104210167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcb2694620 con 0x55bcb2958a70 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f528b400640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb29593b0 0x55bcb29631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:12:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f528be00640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 0x55bcb2962c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f527c098320 tx=0x7f527c09b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a9fff741230fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f5275600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:12:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.182+0000 7f5275600640 1 -- 172.21.15.150:0/104210167 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c09fd00 con 0x55bcb2958a70 2024-09-15T22:12:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.183+0000 7f5275600640 1 -- 172.21.15.150:0/104210167 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f527c097fc0 con 0x55bcb2958a70 2024-09-15T22:12:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.183+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5284004050 con 0x55bcb2958a70 2024-09-15T22:12:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.183+0000 7f5275600640 1 -- 172.21.15.150:0/104210167 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f527c0a4530 con 0x55bcb2958a70 2024-09-15T22:12:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.183+0000 7f5295a2e740 10 client.25226 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.183+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bcb296d070 con 0x55bcb2958a70 2024-09-15T22:12:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5275600640 1 -- 172.21.15.150:0/104210167 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5284004050 con 0x55bcb2958a70 2024-09-15T22:12:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5275600640 1 -- 172.21.15.150:0/104210167 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f527c004340 con 0x55bcb2958a70 2024-09-15T22:12:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5295a2e740 10 client.25226 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5295a2e740 10 client.25226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5295a2e740 20 client.25226 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5295a2e740 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb296e740 0x55bcb2970b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.184+0000 7f5295a2e740 4 client.25226 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.185+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcb28c2830 con 0x55bcb296e740 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.185+0000 7f528b400640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb296e740 0x55bcb2970b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.185+0000 7f528b400640 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb296e740 0x55bcb2970b50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e20a4a9e9cc9c9 server_cookie=e5a66a918aa70042 in_seq=0 out_seq=0 2024-09-15T22:12:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.185+0000 7f5275600640 10 client.25226 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.186+0000 7f5275600640 1 -- 172.21.15.150:0/104210167 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcb28c2830 con 0x55bcb296e740 2024-09-15T22:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.186+0000 7f5275600640 10 client.25226 handle_command_reply: tid=0 2024-09-15T22:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.186+0000 7f5295a2e740 1 client.25226 shutdown 2024-09-15T22:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 msgr2=0x55bcb2962c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 0x55bcb2962c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f527c098320 tx=0x7f527c09b550 comp rx=0 tx=0).stop 2024-09-15T22:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 shutdown_connections 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb296e740 0x55bcb2970b50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb296a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb29593b0 0x55bcb29631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5275600640 0 client.25226 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 --2- 172.21.15.150:0/104210167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb2958a70 0x55bcb2962c90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 >> 172.21.15.150:0/104210167 conn(0x55bcb294b8d0 msgr2=0x55bcb294d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 shutdown_connections 2024-09-15T22:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.187+0000 7f5295a2e740 1 -- 172.21.15.150:0/104210167 wait complete. 2024-09-15T22:12:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.188+0000 7f5295a2e740 20 client.25226 trim_cache size 0 max 16384 2024-09-15T22:12:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 Processor -- start 2024-09-15T22:12:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 -- start start 2024-09-15T22:12:55.220 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2963260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.220 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb296a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.220 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb294a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.220 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1a6ca0 con 0x55bcb2958a70 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1a87e0 con 0x55bcb29593b0 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.217+0000 7f5295a2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1a7370 con 0x55bcb295e440 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f528be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2963260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f528be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2963260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50448/0 (socket says 172.21.15.150:50448) 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f528be00640 1 -- 172.21.15.150:0/2268661644 learned_addr learned my addr 172.21.15.150:0/2268661644 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f5290a00640 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb294a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f528b400640 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb296a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f5290a00640 1 -- 172.21.15.150:0/2268661644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 msgr2=0x55bcb296a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f5290a00640 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb296a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f5290a00640 1 -- 172.21.15.150:0/2268661644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 msgr2=0x55bcb2963260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.218+0000 7f5290a00640 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2963260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.219+0000 7f5290a00640 1 -- 172.21.15.150:0/2268661644 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcb294b6f0 con 0x55bcb295e440 2024-09-15T22:12:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.219+0000 7f528be00640 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2963260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.219+0000 7f5290a00640 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb294a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5284009fd0 tx=0x7f5284009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5396d486d85be05d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.219+0000 7f5277e00640 1 -- 172.21.15.150:0/2268661644 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284003a30 con 0x55bcb295e440 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.219+0000 7f5277e00640 1 -- 172.21.15.150:0/2268661644 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5284003bd0 con 0x55bcb295e440 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.219+0000 7f5277e00640 1 -- 172.21.15.150:0/2268661644 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528400f980 con 0x55bcb295e440 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.220+0000 7f5295a2e740 1 -- 172.21.15.150:0/2268661644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 msgr2=0x55bcb294a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.220+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb294a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5284009fd0 tx=0x7f5284009d80 comp rx=0 tx=0).stop 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 -- 172.21.15.150:0/2268661644 shutdown_connections 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb295e440 0x55bcb294a900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb29593b0 0x55bcb296a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 --2- 172.21.15.150:0/2268661644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2963260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 -- 172.21.15.150:0/2268661644 >> 172.21.15.150:0/2268661644 conn(0x55bcb294b8d0 msgr2=0x55bcb294a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 -- 172.21.15.150:0/2268661644 shutdown_connections 2024-09-15T22:12:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 -- 172.21.15.150:0/2268661644 wait complete. 2024-09-15T22:12:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.221+0000 7f5295a2e740 1 -- start start 2024-09-15T22:12:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 Processor -- start 2024-09-15T22:12:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2967a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb29593b0 0x55bcb2967fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb295e440 0x55bcb2968fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1a8110 con 0x55bcb2958a70 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1a7a40 con 0x55bcb295e440 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1a4ca0 con 0x55bcb29593b0 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f5295a2e740 10 client.0 _ll_register_callbacks cb 0x7f527c003f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f528be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2967a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f528be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2967a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:50458/0 (socket says 172.21.15.150:50458) 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f528b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb29593b0 0x55bcb2967fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.222+0000 7f528be00640 1 -- 172.21.15.150:0/3943618610 learned_addr learned my addr 172.21.15.150:0/3943618610 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f5290a00640 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb295e440 0x55bcb2968fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f528b400640 1 -- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb295e440 msgr2=0x55bcb2968fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f528b400640 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb295e440 0x55bcb2968fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f528b400640 1 -- 172.21.15.150:0/3943618610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 msgr2=0x55bcb2967a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f528b400640 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2967a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f528b400640 1 -- 172.21.15.150:0/3943618610 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcb29695c0 con 0x55bcb29593b0 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f528b400640 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb29593b0 0x55bcb2967fa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f527802a910 tx=0x7f527803f070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb0459f1494c67ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f5275600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.223+0000 7f5275600640 1 -- 172.21.15.150:0/3943618610 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278035040 con 0x55bcb29593b0 2024-09-15T22:12:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.224+0000 7f5275600640 1 -- 172.21.15.150:0/3943618610 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f5278004c40 con 0x55bcb29593b0 2024-09-15T22:12:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.224+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5284003bd0 con 0x55bcb29593b0 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.224+0000 7f5275600640 1 -- 172.21.15.150:0/3943618610 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5278004e40 con 0x55bcb29593b0 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.224+0000 7f5295a2e740 10 client.25201 fetch_fsmap learned FSMap version 28 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.224+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bcb29d96d0 con 0x55bcb29593b0 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.224+0000 7f5275600640 1 -- 172.21.15.150:0/3943618610 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5284003bd0 con 0x55bcb29593b0 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5275600640 1 -- 172.21.15.150:0/3943618610 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5278003a40 con 0x55bcb29593b0 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5295a2e740 10 client.25201 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5295a2e740 10 client.25201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5295a2e740 20 client.25201 populate_metadata read hostname 'smithi150' 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5295a2e740 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb29d9fb0 0x55bcb29dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5295a2e740 4 client.25201 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:12:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bcb28bcb80 con 0x55bcb29d9fb0 2024-09-15T22:12:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.225+0000 7f528be00640 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb29d9fb0 0x55bcb29dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.226+0000 7f528be00640 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb29d9fb0 0x55bcb29dc3d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424f023218f78311 server_cookie=792527f78832f88d in_seq=0 out_seq=0 2024-09-15T22:12:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.226+0000 7f5275600640 10 client.25201 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5275600640 1 -- 172.21.15.150:0/3943618610 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bcb28bcb80 con 0x55bcb29d9fb0 2024-09-15T22:12:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5275600640 10 client.25201 handle_command_reply: tid=0 2024-09-15T22:12:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 client.25201 shutdown 2024-09-15T22:12:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb29593b0 msgr2=0x55bcb2967fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb29593b0 0x55bcb2967fa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f527802a910 tx=0x7f527803f070 comp rx=0 tx=0).stop 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 shutdown_connections 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55bcb29d9fb0 0x55bcb29dc3d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bcb295e440 0x55bcb2968fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcb29593b0 0x55bcb2967fa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 --2- 172.21.15.150:0/3943618610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2958a70 0x55bcb2967a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 >> 172.21.15.150:0/3943618610 conn(0x55bcb294b8d0 msgr2=0x55bcb2963120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5275600640 0 client.25201 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 shutdown_connections 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.230+0000 7f5295a2e740 1 -- 172.21.15.150:0/3943618610 wait complete. 2024-09-15T22:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.231+0000 7f5295a2e740 20 client.25201 trim_cache size 0 max 16384 2024-09-15T22:12:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:12:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:12:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:12:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:12:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.231+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52700a33d0 msgr2=0x7f52700a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.231+0000 7f5291400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52700a33d0 0x7f52700a5890 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5278031440 tx=0x7f52780315b0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.231+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 msgr2=0x7f528c199e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.231+0000 7f5291400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 0x7f528c199e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f527c00e9c0 tx=0x7f527c00ee80 comp rx=0 tx=0).stop 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 shutdown_connections 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f528c105720 0x7f528c1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f52700a33d0 0x7f52700a5890 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f528c104d60 0x7f528c19a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 --2- 172.21.15.150:0/2819607570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c103b70 0x7f528c199e60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 >> 172.21.15.150:0/2819607570 conn(0x7f528c0ff2f0 msgr2=0x7f528c108060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 shutdown_connections 2024-09-15T22:12:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:12:55.232+0000 7f5291400640 1 -- 172.21.15.150:0/2819607570 wait complete. 2024-09-15T22:12:56.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:56 smithi154 ceph-mon[34853]: pgmap v380: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-15T22:12:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:56 smithi150 ceph-mon[30886]: pgmap v380: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-15T22:12:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:56 smithi169 ceph-mon[35850]: pgmap v380: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-15T22:12:58.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:12:58 smithi154 ceph-mon[34853]: pgmap v381: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:12:58.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:12:58 smithi150 ceph-mon[30886]: pgmap v381: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:12:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:12:58 smithi169 ceph-mon[35850]: pgmap v381: 97 pgs: 97 active+clean; 667 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:13:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:00 smithi154 ceph-mon[34853]: pgmap v382: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-15T22:13:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:00 smithi150 ceph-mon[30886]: pgmap v382: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-15T22:13:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:00 smithi169 ceph-mon[35850]: pgmap v382: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-15T22:13:02.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:02 smithi154 ceph-mon[34853]: pgmap v383: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-15T22:13:02.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:02 smithi150 ceph-mon[30886]: pgmap v383: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-15T22:13:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:02 smithi169 ceph-mon[35850]: pgmap v383: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-15T22:13:04.522 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:04 smithi154 ceph-mon[34853]: pgmap v384: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-15T22:13:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:04 smithi150 ceph-mon[30886]: pgmap v384: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-15T22:13:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:04 smithi169 ceph-mon[35850]: pgmap v384: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-15T22:13:06.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:06 smithi154 ceph-mon[34853]: pgmap v385: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-15T22:13:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:06 smithi150 ceph-mon[30886]: pgmap v385: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-15T22:13:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:06 smithi169 ceph-mon[35850]: pgmap v385: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-15T22:13:07.341 INFO:tasks.workunit.client.0.smithi150.stderr:Updating files: 64% (8285/12889) Updating files: 65% (8378/12889) Updating files: 66% (8507/12889) Updating files: 67% (8636/12889) Updating files: 68% (8765/12889) Updating files: 69% (8894/12889) Updating files: 70% (9023/12889) Updating files: 71% (9152/12889) Updating files: 72% (9281/12889) Updating files: 73% (9409/12889) Updating files: 74% (9538/12889) Updating files: 75% (9667/12889) Updating files: 76% (9796/12889) Updating files: 77% (9925/12889) Updating files: 78% (10054/12889) Updating files: 79% (10183/12889) Updating files: 80% (10312/12889) Updating files: 81% (10441/12889) Updating files: 82% (10569/12889) Updating files: 83% (10698/12889) Updating files: 84% (10827/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-15T22:13:08.089 INFO:tasks.workunit.client.0.smithi150.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T22:13:08.089 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.089 INFO:tasks.workunit.client.0.smithi150.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T22:13:08.089 INFO:tasks.workunit.client.0.smithi150.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T22:13:08.089 INFO:tasks.workunit.client.0.smithi150.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T22:13:08.089 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: git switch -c 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr:Or undo this operation with: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: git switch - 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:08.090 INFO:tasks.workunit.client.0.smithi150.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T22:13:08.103 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T22:13:08.189 INFO:tasks.workunit.client.0.smithi150.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T22:13:08.194 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:13:08.194 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T22:13:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 -- 172.21.15.150:0/1181555514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020077df0 msgr2=0x7f7020078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 --2- 172.21.15.150:0/1181555514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020077df0 0x7f7020078250 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7008009900 tx=0x7f700802a410 comp rx=0 tx=0).stop 2024-09-15T22:13:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 -- 172.21.15.150:0/1181555514 shutdown_connections 2024-09-15T22:13:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 --2- 172.21.15.150:0/1181555514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7020078790 0x7f7020079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 --2- 172.21.15.150:0/1181555514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020077df0 0x7f7020078250 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 --2- 172.21.15.150:0/1181555514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f7020076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 -- 172.21.15.150:0/1181555514 >> 172.21.15.150:0/1181555514 conn(0x7f70200ff4e0 msgr2=0x7f7020101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 -- 172.21.15.150:0/1181555514 shutdown_connections 2024-09-15T22:13:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.351+0000 7f7025200640 1 -- 172.21.15.150:0/1181555514 wait complete. 2024-09-15T22:13:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 Processor -- start 2024-09-15T22:13:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 -- start start 2024-09-15T22:13:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f702019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7020077df0 0x7f702019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020078790 0x7f70201a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7020113e10 con 0x7f7020078790 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7020113c90 con 0x7f7020077df0 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.352+0000 7f7025200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7020113f90 con 0x7f7020076bb0 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f702019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020078790 0x7f70201a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f702019e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37376/0 (socket says 172.21.15.150:37376) 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 -- 172.21.15.150:0/3297739355 learned_addr learned my addr 172.21.15.150:0/3297739355 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f7017e00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7020077df0 0x7f702019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 -- 172.21.15.150:0/3297739355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7020077df0 msgr2=0x7f702019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7020077df0 0x7f702019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 -- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020078790 msgr2=0x7f70201a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020078790 0x7f70201a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 -- 172.21.15.150:0/3297739355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70201a6020 con 0x7f7020076bb0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.353+0000 7f701de00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f702019e400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f701000e9f0 tx=0x7f701000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.354+0000 7f7016a00640 1 -- 172.21.15.150:0/3297739355 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701000cd80 con 0x7f7020076bb0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.354+0000 7f7016a00640 1 -- 172.21.15.150:0/3297739355 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7010010910 con 0x7f7020076bb0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.354+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70201a6310 con 0x7f7020076bb0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.354+0000 7f7016a00640 1 -- 172.21.15.150:0/3297739355 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010018990 con 0x7f7020076bb0 2024-09-15T22:13:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.354+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70201a6880 con 0x7f7020076bb0 2024-09-15T22:13:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 Processor -- start 2024-09-15T22:13:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 -- start start 2024-09-15T22:13:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7016a00640 1 -- 172.21.15.150:0/3297739355 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f7010010ac0 con 0x7f7020076bb0 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed72490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed729d0 0x5558fed77490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fed79f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5558fecd7100 con 0x5558fed729d0 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5558fec7f1b0 con 0x5558fed77a60 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.358+0000 7f7028058740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5558fecd30c0 con 0x5558fed72090 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed72490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f7017e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fed79f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed729d0 0x5558fed77490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed72490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37378/0 (socket says 172.21.15.150:37378) 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 -- 172.21.15.150:0/4284172924 learned_addr learned my addr 172.21.15.150:0/4284172924 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 -- 172.21.15.150:0/4284172924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 msgr2=0x5558fed79f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fed79f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 -- 172.21.15.150:0/4284172924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed729d0 msgr2=0x5558fed77490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed729d0 0x5558fed77490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 -- 172.21.15.150:0/4284172924 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fe9ea210 con 0x5558fed72090 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f7017e00640 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fed79f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:13:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.359+0000 7f701e800640 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed72490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7018009fd0 tx=0x7f70180118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81208e82fc588add server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f700f400640 1 -- 172.21.15.150:0/4284172924 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018004d20 con 0x5558fed72090 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f700f400640 1 -- 172.21.15.150:0/4284172924 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7018004050 con 0x5558fed72090 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f700f400640 1 -- 172.21.15.150:0/4284172924 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018005260 con 0x5558fed72090 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7016a00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f70040a3370 0x7f70040a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7016a00640 1 -- 172.21.15.150:0/3297739355 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f70100cfbb0 con 0x7f7020076bb0 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 -- 172.21.15.150:0/4284172924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 msgr2=0x5558fed72490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed72490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7018009fd0 tx=0x7f70180118d0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 -- 172.21.15.150:0/4284172924 shutdown_connections 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f701de00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f70040a3370 0x7f70040a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fed79f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed729d0 0x5558fed77490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 --2- 172.21.15.150:0/4284172924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed72490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 -- 172.21.15.150:0/4284172924 >> 172.21.15.150:0/4284172924 conn(0x5558fed6d700 msgr2=0x5558fed6db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 -- 172.21.15.150:0/4284172924 shutdown_connections 2024-09-15T22:13:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.360+0000 7f7028058740 1 -- 172.21.15.150:0/4284172924 wait complete. 2024-09-15T22:13:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.361+0000 7f701de00640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f70040a3370 0x7f70040a5830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f70100cd9f0 tx=0x7f70100d3690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.361+0000 7f7028058740 1 -- start start 2024-09-15T22:13:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.361+0000 7f7028058740 1 Processor -- start 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed7c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed7c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed77a60 0x5558fed837c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5558fed7aa30 con 0x5558fed72090 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5558fec60090 con 0x5558fed729d0 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5558fed7abb0 con 0x5558fed77a60 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7028058740 10 client.0 _ll_register_callbacks cb 0x5558fecb4f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed7c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed7c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35664/0 (socket says 172.21.15.150:35664) 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 -- 172.21.15.150:0/1258692870 learned_addr learned my addr 172.21.15.150:0/1258692870 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f7017e00640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed7c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed77a60 0x5558fed837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 -- 172.21.15.150:0/1258692870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed77a60 msgr2=0x5558fed837c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed77a60 0x5558fed837c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 -- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 msgr2=0x5558fed7c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.362+0000 7f701e800640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed7c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f701e800640 1 -- 172.21.15.150:0/1258692870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558feab6620 con 0x5558fed72090 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f701e800640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed7c240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7018011dd0 tx=0x7f7018009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843aeb795f894f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7003e00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7003e00640 1 -- 172.21.15.150:0/1258692870 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018005040 con 0x5558fed72090 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7003e00640 1 -- 172.21.15.150:0/1258692870 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f70180051e0 con 0x5558fed72090 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7018004050 con 0x5558fed72090 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7003e00640 1 -- 172.21.15.150:0/1258692870 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70180053e0 con 0x5558fed72090 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7028058740 10 client.15216 fetch_fsmap learned FSMap version 28 2024-09-15T22:13:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.363+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558fed865b0 con 0x5558fed72090 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7003e00640 1 -- 172.21.15.150:0/1258692870 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7018004050 con 0x5558fed72090 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7003e00640 1 -- 172.21.15.150:0/1258692870 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f701800faa0 con 0x5558fed72090 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7028058740 10 client.15216 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7028058740 10 client.15216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7028058740 20 client.15216 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7028058740 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fed87b00 0x5558fed89ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7028058740 4 client.15216 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558fece4830 con 0x5558fed87b00 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.364+0000 7f7017e00640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fed87b00 0x5558fed89ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.365+0000 7f7017e00640 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fed87b00 0x5558fed89ef0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=559a428baea63ee0 server_cookie=569a8f9a202aaff2 in_seq=0 out_seq=0 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.365+0000 7f7003e00640 10 client.15216 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.365+0000 7f7003e00640 1 -- 172.21.15.150:0/1258692870 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558fece4830 con 0x5558fed87b00 2024-09-15T22:13:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.365+0000 7f7003e00640 10 client.15216 handle_command_reply: tid=0 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 client.15216 shutdown 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 msgr2=0x5558fed7c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed7c240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7018011dd0 tx=0x7f7018009c80 comp rx=0 tx=0).stop 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 shutdown_connections 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fed87b00 0x5558fed89ef0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed77a60 0x5558fed837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed7c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7003e00640 0 client.15216 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 --2- 172.21.15.150:0/1258692870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed7c240 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 >> 172.21.15.150:0/1258692870 conn(0x5558fed6d700 msgr2=0x5558fed6ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 shutdown_connections 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 1 -- 172.21.15.150:0/1258692870 wait complete. 2024-09-15T22:13:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.366+0000 7f7028058740 20 client.15216 trim_cache size 0 max 16384 2024-09-15T22:13:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 Processor -- start 2024-09-15T22:13:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 -- start start 2024-09-15T22:13:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed6c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed83780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 0x5558fed8e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70201af720 con 0x5558fed77a60 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70201b1260 con 0x5558fed729d0 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f7028058740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70201afdf0 con 0x5558fed72090 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 0x5558fed8e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 0x5558fed8e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35676/0 (socket says 172.21.15.150:35676) 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f701e800640 1 -- 172.21.15.150:0/1078021633 learned_addr learned my addr 172.21.15.150:0/1078021633 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.381+0000 7f701e800640 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed6c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f7017e00640 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed83780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f701e800640 1 -- 172.21.15.150:0/1078021633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 msgr2=0x5558fed6c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f701e800640 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed6c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f701e800640 1 -- 172.21.15.150:0/1078021633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 msgr2=0x5558fed83780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f701e800640 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed83780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f701e800640 1 -- 172.21.15.150:0/1078021633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fed72eb0 con 0x5558fed77a60 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f701e800640 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 0x5558fed8e7b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7018002230 tx=0x7f70180118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6ef685ac3da7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f700ea00640 1 -- 172.21.15.150:0/1078021633 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018005040 con 0x5558fed77a60 2024-09-15T22:13:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f700ea00640 1 -- 172.21.15.150:0/1078021633 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f701802c070 con 0x5558fed77a60 2024-09-15T22:13:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.382+0000 7f700ea00640 1 -- 172.21.15.150:0/1078021633 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018019cc0 con 0x5558fed77a60 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 -- 172.21.15.150:0/1078021633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 msgr2=0x5558fed8e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 0x5558fed8e7b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7018002230 tx=0x7f70180118d0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 -- 172.21.15.150:0/1078021633 shutdown_connections 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed77a60 0x5558fed8e7b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed729d0 0x5558fed83780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 --2- 172.21.15.150:0/1078021633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed72090 0x5558fed6c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 -- 172.21.15.150:0/1078021633 >> 172.21.15.150:0/1078021633 conn(0x5558fed6d700 msgr2=0x5558fed6c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 -- 172.21.15.150:0/1078021633 shutdown_connections 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 -- 172.21.15.150:0/1078021633 wait complete. 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.383+0000 7f7028058740 1 -- start start 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 Processor -- start 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed80610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed729d0 0x5558fed80b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fedf0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70201b0b90 con 0x5558fed72090 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70201b04c0 con 0x5558fed77a60 2024-09-15T22:13:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70201ad700 con 0x5558fed729d0 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7028058740 10 client.0 _ll_register_callbacks cb 0x7f70100d3560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed80610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f701e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed80610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35678/0 (socket says 172.21.15.150:35678) 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f701e800640 1 -- 172.21.15.150:0/1675311368 learned_addr learned my addr 172.21.15.150:0/1675311368 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f7017e00640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed729d0 0x5558fed80b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.384+0000 7f701e800640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fedf0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7017e00640 1 -- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 msgr2=0x5558fedf0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7017e00640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fedf0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7017e00640 1 -- 172.21.15.150:0/1675311368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 msgr2=0x5558fed80610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7017e00640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed80610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7017e00640 1 -- 172.21.15.150:0/1675311368 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fedf0cc0 con 0x5558fed729d0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f701e800640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed80610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7017e00640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed729d0 0x5558fed80b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f700802a930 tx=0x7f70080043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5487c454e8b79ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7003e00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7003e00640 1 -- 172.21.15.150:0/1675311368 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008035040 con 0x5558fed729d0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7003e00640 1 -- 172.21.15.150:0/1675311368 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7008005450 con 0x5558fed729d0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701802c070 con 0x5558fed729d0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7003e00640 1 -- 172.21.15.150:0/1675311368 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7008054030 con 0x5558fed729d0 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7028058740 10 client.25219 fetch_fsmap learned FSMap version 28 2024-09-15T22:13:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.385+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558fedf1fd0 con 0x5558fed729d0 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7003e00640 1 -- 172.21.15.150:0/1675311368 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f701802c070 con 0x5558fed729d0 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7003e00640 1 -- 172.21.15.150:0/1675311368 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70080317d0 con 0x5558fed729d0 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7028058740 10 client.25219 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7028058740 10 client.25219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7028058740 20 client.25219 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7028058740 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fedf2920 0x5558fedf4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7028058740 4 client.25219 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558fecdeb80 con 0x5558fedf2920 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.386+0000 7f701e800640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fedf2920 0x5558fedf4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.387+0000 7f701e800640 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fedf2920 0x5558fedf4d40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24be1729e4cd977b server_cookie=ab74bcd84c63db7f in_seq=0 out_seq=0 2024-09-15T22:13:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.387+0000 7f7003e00640 10 client.25219 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7003e00640 1 -- 172.21.15.150:0/1675311368 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558fecdeb80 con 0x5558fedf2920 2024-09-15T22:13:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7003e00640 10 client.25219 handle_command_reply: tid=0 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 client.25219 shutdown 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed729d0 msgr2=0x5558fed80b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed729d0 0x5558fed80b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f700802a930 tx=0x7f70080043c0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 shutdown_connections 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5558fedf2920 0x5558fedf4d40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558fed77a60 0x5558fedf0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558fed729d0 0x5558fed80b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7003e00640 0 client.25219 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.390+0000 7f7028058740 1 --2- 172.21.15.150:0/1675311368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5558fed72090 0x5558fed80610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 >> 172.21.15.150:0/1675311368 conn(0x5558fed6d700 msgr2=0x5558fed6e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 shutdown_connections 2024-09-15T22:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7028058740 1 -- 172.21.15.150:0/1675311368 wait complete. 2024-09-15T22:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7028058740 20 client.25219 trim_cache size 0 max 16384 2024-09-15T22:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f70040a3370 msgr2=0x7f70040a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f70040a3370 0x7f70040a5830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f70100cd9f0 tx=0x7f70100d3690 comp rx=0 tx=0).stop 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 msgr2=0x7f702019e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f702019e400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f701000e9f0 tx=0x7f701000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 shutdown_connections 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f70040a3370 0x7f70040a5830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7020078790 0x7f70201a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.391+0000 7f7025200640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7020077df0 0x7f702019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.392+0000 7f7025200640 1 --2- 172.21.15.150:0/3297739355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7020076bb0 0x7f702019e400 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.392+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 >> 172.21.15.150:0/3297739355 conn(0x7f70200ff4e0 msgr2=0x7f7020100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.392+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 shutdown_connections 2024-09-15T22:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:08.392+0000 7f7025200640 1 -- 172.21.15.150:0/3297739355 wait complete. 2024-09-15T22:13:08.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:08 smithi154 ceph-mon[34853]: pgmap v386: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-15T22:13:08.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:08 smithi150 ceph-mon[30886]: pgmap v386: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-15T22:13:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:08 smithi169 ceph-mon[35850]: pgmap v386: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-15T22:13:08.901 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T22:13:09.017 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T22:13:09.088 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:13:09.093 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:13:09.093 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T22:13:09.161 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:13:09.168 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:13:09.169 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T22:13:09.245 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-15T22:13:09.246 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-15T22:13:09.246 DEBUG:teuthology.orchestra.run.smithi150:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-15T22:13:09.335 INFO:tasks.workunit.client.0.smithi150.stdout:getting blogbench 2024-09-15T22:13:09.335 INFO:tasks.workunit.client.0.smithi150.stderr:+ echo 'getting blogbench' 2024-09-15T22:13:09.335 INFO:tasks.workunit.client.0.smithi150.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-15T22:13:09.365 INFO:tasks.workunit.client.0.smithi150.stderr:--2024-09-15 22:13:09-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-15T22:13:09.375 INFO:tasks.workunit.client.0.smithi150.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-15T22:13:09.396 INFO:tasks.workunit.client.0.smithi150.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-15T22:13:09.417 INFO:tasks.workunit.client.0.smithi150.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-15T22:13:09.417 INFO:tasks.workunit.client.0.smithi150.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-15T22:13:09.419 INFO:tasks.workunit.client.0.smithi150.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-15T22:13:09.423 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:09.458 INFO:tasks.workunit.client.0.smithi150.stderr: 0K .......... .......... .......... .......... .......... 49% 1.27M 0s 2024-09-15T22:13:09.479 INFO:tasks.workunit.client.0.smithi150.stderr: 50K .......... .......... .......... .......... .......... 99% 2.41M 0s 2024-09-15T22:13:09.479 INFO:tasks.workunit.client.0.smithi150.stderr: 100K 100% 1.74T=0.06s 2024-09-15T22:13:09.479 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:09.479 INFO:tasks.workunit.client.0.smithi150.stderr:2024-09-15 22:13:09 (1.68 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-15T22:13:09.479 INFO:tasks.workunit.client.0.smithi150.stderr: 2024-09-15T22:13:09.479 INFO:tasks.workunit.client.0.smithi150.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-15T22:13:09.512 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/ 2024-09-15T22:13:09.513 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/m4/ 2024-09-15T22:13:09.514 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-15T22:13:09.516 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/man/ 2024-09-15T22:13:09.517 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/man/blogbench.8 2024-09-15T22:13:09.519 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/man/Makefile.am 2024-09-15T22:13:09.520 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/man/Makefile.in 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:09 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.522 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/ 2024-09-15T22:13:09.523 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-15T22:13:09.524 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-15T22:13:09.525 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/blogbench.c 2024-09-15T22:13:09.527 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/blogbench.h 2024-09-15T22:13:09.528 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-15T22:13:09.529 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-15T22:13:09.531 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-15T22:13:09.532 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-15T22:13:09.534 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-15T22:13:09.535 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/Makefile.am 2024-09-15T22:13:09.537 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/Makefile.in 2024-09-15T22:13:09.538 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/process.c 2024-09-15T22:13:09.539 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/globals.h 2024-09-15T22:13:09.541 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/commenter.c 2024-09-15T22:13:09.542 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/rewriter.c 2024-09-15T22:13:09.544 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/reader.c 2024-09-15T22:13:09.545 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/writer.c 2024-09-15T22:13:09.546 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/src/helpers.c 2024-09-15T22:13:09.548 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/NEWS 2024-09-15T22:13:09.550 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/compile 2024-09-15T22:13:09.551 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/depcomp 2024-09-15T22:13:09.552 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/aclocal.m4 2024-09-15T22:13:09.556 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/README 2024-09-15T22:13:09.557 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/configure 2024-09-15T22:13:09.562 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/configure.ac 2024-09-15T22:13:09.563 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/config.guess 2024-09-15T22:13:09.565 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/install-sh 2024-09-15T22:13:09.566 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/config.sub 2024-09-15T22:13:09.568 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/missing 2024-09-15T22:13:09.569 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/mkinstalldirs 2024-09-15T22:13:09.570 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/Makefile.am 2024-09-15T22:13:09.572 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/Makefile.in 2024-09-15T22:13:09.573 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/config.h.in 2024-09-15T22:13:09.574 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/AUTHORS 2024-09-15T22:13:09.576 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/INSTALL 2024-09-15T22:13:09.577 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/ChangeLog 2024-09-15T22:13:09.578 INFO:tasks.workunit.client.0.smithi150.stdout:blogbench-1.0/COPYING 2024-09-15T22:13:09.580 INFO:tasks.workunit.client.0.smithi150.stderr:+ cd blogbench-1.0/ 2024-09-15T22:13:09.580 INFO:tasks.workunit.client.0.smithi150.stdout:making blogbench 2024-09-15T22:13:09.581 INFO:tasks.workunit.client.0.smithi150.stderr:+ echo 'making blogbench' 2024-09-15T22:13:09.581 INFO:tasks.workunit.client.0.smithi150.stderr:+ ./configure 2024-09-15T22:13:09.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:09.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:09 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:09 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:09.818 INFO:tasks.workunit.client.0.smithi150.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-15T22:13:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:10 smithi154 ceph-mon[34853]: pgmap v387: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-15T22:13:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:10.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:10 smithi150 ceph-mon[30886]: pgmap v387: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-15T22:13:10.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:10.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:10.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:10 smithi169 ceph-mon[35850]: pgmap v387: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-15T22:13:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:10.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:10.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:13:10.831 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether build environment is sane... yes 2024-09-15T22:13:10.848 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gawk... gawk 2024-09-15T22:13:10.872 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether make sets $(MAKE)... yes 2024-09-15T22:13:10.895 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc... gcc 2024-09-15T22:13:10.981 INFO:tasks.workunit.client.0.smithi150.stdout:checking for C compiler default output file name... a.out 2024-09-15T22:13:10.985 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether the C compiler works... yes 2024-09-15T22:13:10.988 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are cross compiling... no 2024-09-15T22:13:11.046 INFO:tasks.workunit.client.0.smithi150.stdout:checking for suffix of executables... 2024-09-15T22:13:11.105 INFO:tasks.workunit.client.0.smithi150.stdout:checking for suffix of object files... o 2024-09-15T22:13:11.163 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether we are using the GNU C compiler... yes 2024-09-15T22:13:11.223 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether gcc accepts -g... yes 2024-09-15T22:13:11.319 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-15T22:13:11.391 INFO:tasks.workunit.client.0.smithi150.stdout:checking for style of include used by make... GNU 2024-09-15T22:13:11.537 INFO:tasks.workunit.client.0.smithi150.stdout:checking dependency style of gcc... gcc3 2024-09-15T22:13:11.537 INFO:tasks.workunit.client.0.smithi150.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-15T22:13:11.628 INFO:tasks.workunit.client.0.smithi150.stdout:checking how to run the C preprocessor... gcc -E 2024-09-15T22:13:11.703 INFO:tasks.workunit.client.0.smithi150.stdout:checking for egrep... grep -E 2024-09-15T22:13:11.724 INFO:tasks.workunit.client.0.smithi150.stdout:checking for AIX... no 2024-09-15T22:13:11.833 INFO:tasks.workunit.client.0.smithi150.stdout:checking for library containing strerror... none required 2024-09-15T22:13:12.076 INFO:tasks.workunit.client.0.smithi150.stdout:checking for ANSI C header files... yes 2024-09-15T22:13:12.144 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-15T22:13:12.225 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/types.h... yes 2024-09-15T22:13:12.312 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/stat.h... yes 2024-09-15T22:13:12.396 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdlib.h... yes 2024-09-15T22:13:12.483 INFO:tasks.workunit.client.0.smithi150.stdout:checking for string.h... yes 2024-09-15T22:13:12.569 INFO:tasks.workunit.client.0.smithi150.stdout:checking for memory.h... yes 2024-09-15T22:13:12.656 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strings.h... yes 2024-09-15T22:13:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:12 smithi150 ceph-mon[30886]: pgmap v388: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-15T22:13:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:12 smithi169 ceph-mon[35850]: pgmap v388: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-15T22:13:12.744 INFO:tasks.workunit.client.0.smithi150.stdout:checking for inttypes.h... yes 2024-09-15T22:13:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:12 smithi154 ceph-mon[34853]: pgmap v388: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-15T22:13:12.836 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdint.h... yes 2024-09-15T22:13:12.931 INFO:tasks.workunit.client.0.smithi150.stdout:checking for unistd.h... yes 2024-09-15T22:13:12.951 INFO:tasks.workunit.client.0.smithi150.stdout:checking for memory.h... (cached) yes 2024-09-15T22:13:12.965 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strings.h... (cached) yes 2024-09-15T22:13:12.979 INFO:tasks.workunit.client.0.smithi150.stdout:checking for unistd.h... (cached) yes 2024-09-15T22:13:13.063 INFO:tasks.workunit.client.0.smithi150.stdout:checking locale.h usability... yes 2024-09-15T22:13:13.099 INFO:tasks.workunit.client.0.smithi150.stdout:checking locale.h presence... yes 2024-09-15T22:13:13.101 INFO:tasks.workunit.client.0.smithi150.stdout:checking for locale.h... yes 2024-09-15T22:13:13.124 INFO:tasks.workunit.client.0.smithi150.stdout:checking for stdlib.h... (cached) yes 2024-09-15T22:13:13.138 INFO:tasks.workunit.client.0.smithi150.stdout:checking for string.h... (cached) yes 2024-09-15T22:13:13.235 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/socket.h usability... yes 2024-09-15T22:13:13.274 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/socket.h presence... yes 2024-09-15T22:13:13.276 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/socket.h... yes 2024-09-15T22:13:13.366 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/time.h usability... yes 2024-09-15T22:13:13.404 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/time.h presence... yes 2024-09-15T22:13:13.405 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/time.h... yes 2024-09-15T22:13:13.497 INFO:tasks.workunit.client.0.smithi150.stdout:checking fcntl.h usability... yes 2024-09-15T22:13:13.535 INFO:tasks.workunit.client.0.smithi150.stdout:checking fcntl.h presence... yes 2024-09-15T22:13:13.536 INFO:tasks.workunit.client.0.smithi150.stdout:checking for fcntl.h... yes 2024-09-15T22:13:13.641 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/fcntl.h usability... yes 2024-09-15T22:13:13.679 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/fcntl.h presence... yes 2024-09-15T22:13:13.681 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/fcntl.h... yes 2024-09-15T22:13:13.836 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/param.h usability... yes 2024-09-15T22:13:13.879 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/param.h presence... yes 2024-09-15T22:13:13.880 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/param.h... yes 2024-09-15T22:13:13.961 INFO:tasks.workunit.client.0.smithi150.stdout:checking ioctl.h usability... no 2024-09-15T22:13:13.998 INFO:tasks.workunit.client.0.smithi150.stdout:checking ioctl.h presence... no 2024-09-15T22:13:14.000 INFO:tasks.workunit.client.0.smithi150.stdout:checking for ioctl.h... no 2024-09-15T22:13:14.089 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/ioctl.h usability... yes 2024-09-15T22:13:14.126 INFO:tasks.workunit.client.0.smithi150.stdout:checking sys/ioctl.h presence... yes 2024-09-15T22:13:14.128 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sys/ioctl.h... yes 2024-09-15T22:13:14.216 INFO:tasks.workunit.client.0.smithi150.stdout:checking return type of signal handlers... void 2024-09-15T22:13:14.294 INFO:tasks.workunit.client.0.smithi150.stdout:checking for size_t... yes 2024-09-15T22:13:14.362 INFO:tasks.workunit.client.0.smithi150.stdout:checking for dev_t... yes 2024-09-15T22:13:14.465 INFO:tasks.workunit.client.0.smithi150.stdout:checking for short... yes 2024-09-15T22:13:14.609 INFO:tasks.workunit.client.0.smithi150.stdout:checking size of short... 2 2024-09-15T22:13:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:14 smithi150 ceph-mon[30886]: pgmap v389: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-15T22:13:14.683 INFO:tasks.workunit.client.0.smithi150.stdout:checking for int... yes 2024-09-15T22:13:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:14 smithi169 ceph-mon[35850]: pgmap v389: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-15T22:13:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:14 smithi154 ceph-mon[34853]: pgmap v389: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-15T22:13:14.787 INFO:tasks.workunit.client.0.smithi150.stdout:checking size of int... 4 2024-09-15T22:13:14.869 INFO:tasks.workunit.client.0.smithi150.stdout:checking for long... yes 2024-09-15T22:13:14.975 INFO:tasks.workunit.client.0.smithi150.stdout:checking size of long... 8 2024-09-15T22:13:15.054 INFO:tasks.workunit.client.0.smithi150.stdout:checking for long long... yes 2024-09-15T22:13:15.159 INFO:tasks.workunit.client.0.smithi150.stdout:checking size of long long... 8 2024-09-15T22:13:15.234 INFO:tasks.workunit.client.0.smithi150.stdout:checking for ssize_t... yes 2024-09-15T22:13:15.305 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sig_atomic_t... yes 2024-09-15T22:13:15.388 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether gcc needs -traditional... no 2024-09-15T22:13:15.452 INFO:tasks.workunit.client.0.smithi150.stdout:checking for an ANSI C-conforming const... yes 2024-09-15T22:13:15.501 INFO:tasks.workunit.client.0.smithi150.stdout:checking for inline... inline 2024-09-15T22:13:15.601 INFO:tasks.workunit.client.0.smithi150.stdout:checking for working alloca.h... yes 2024-09-15T22:13:15.685 INFO:tasks.workunit.client.0.smithi150.stdout:checking for alloca... yes 2024-09-15T22:13:15.798 INFO:tasks.workunit.client.0.smithi150.stdout:checking for working memcmp... yes 2024-09-15T22:13:15.920 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strftime... yes 2024-09-15T22:13:16.049 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-15T22:13:16.147 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether stat accepts an empty string... no 2024-09-15T22:13:16.245 INFO:tasks.workunit.client.0.smithi150.stdout:checking for vprintf... yes 2024-09-15T22:13:16.347 INFO:tasks.workunit.client.0.smithi150.stdout:checking for _doprnt... no 2024-09-15T22:13:16.396 INFO:tasks.workunit.client.0.smithi150.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-15T22:13:16.425 INFO:tasks.workunit.client.0.smithi150.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-15T22:13:16.530 INFO:tasks.workunit.client.0.smithi150.stdout:checking for the pthreads library -lpthreads... no 2024-09-15T22:13:16.626 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether pthreads work without any flags... yes 2024-09-15T22:13:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:16 smithi150 ceph-mon[30886]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 99 KiB/s wr, 16 op/s 2024-09-15T22:13:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:16 smithi169 ceph-mon[35850]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 99 KiB/s wr, 16 op/s 2024-09-15T22:13:16.712 INFO:tasks.workunit.client.0.smithi150.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-15T22:13:16.712 INFO:tasks.workunit.client.0.smithi150.stdout:checking if more special flags are required for pthreads... no 2024-09-15T22:13:16.712 INFO:tasks.workunit.client.0.smithi150.stdout:checking for cc_r... gcc 2024-09-15T22:13:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:16 smithi154 ceph-mon[34853]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 99 KiB/s wr, 16 op/s 2024-09-15T22:13:16.824 INFO:tasks.workunit.client.0.smithi150.stdout:checking for setrlimit... yes 2024-09-15T22:13:16.927 INFO:tasks.workunit.client.0.smithi150.stdout:checking for setproctitle... no 2024-09-15T22:13:17.027 INFO:tasks.workunit.client.0.smithi150.stdout:checking for getopt_long... yes 2024-09-15T22:13:17.133 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strtoull... yes 2024-09-15T22:13:17.240 INFO:tasks.workunit.client.0.smithi150.stdout:checking for strtoq... yes 2024-09-15T22:13:17.347 INFO:tasks.workunit.client.0.smithi150.stdout:checking for snprintf... yes 2024-09-15T22:13:17.454 INFO:tasks.workunit.client.0.smithi150.stdout:checking for vsnprintf... yes 2024-09-15T22:13:17.561 INFO:tasks.workunit.client.0.smithi150.stdout:checking for vfprintf... yes 2024-09-15T22:13:17.666 INFO:tasks.workunit.client.0.smithi150.stdout:checking for gethostname... yes 2024-09-15T22:13:17.771 INFO:tasks.workunit.client.0.smithi150.stdout:checking for setlocale... yes 2024-09-15T22:13:17.878 INFO:tasks.workunit.client.0.smithi150.stdout:checking for sync... yes 2024-09-15T22:13:17.983 INFO:tasks.workunit.client.0.smithi150.stdout:checking whether snprintf is C99 conformant... done 2024-09-15T22:13:18.004 INFO:tasks.workunit.client.0.smithi150.stdout:configure: creating ./config.status 2024-09-15T22:13:18.288 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating Makefile 2024-09-15T22:13:18.326 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating src/Makefile 2024-09-15T22:13:18.367 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating man/Makefile 2024-09-15T22:13:18.387 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: creating config.h 2024-09-15T22:13:18.473 INFO:tasks.workunit.client.0.smithi150.stdout:config.status: executing depfiles commands 2024-09-15T22:13:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:18 smithi150 ceph-mon[30886]: pgmap v391: 97 pgs: 97 active+clean; 2.0 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 124 KiB/s wr, 20 op/s 2024-09-15T22:13:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:18 smithi169 ceph-mon[35850]: pgmap v391: 97 pgs: 97 active+clean; 2.0 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 124 KiB/s wr, 20 op/s 2024-09-15T22:13:18.747 INFO:tasks.workunit.client.0.smithi150.stderr:+ make 2024-09-15T22:13:18.758 INFO:tasks.workunit.client.0.smithi150.stdout:make all-recursive 2024-09-15T22:13:18.761 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:13:18.767 INFO:tasks.workunit.client.0.smithi150.stdout:Making all in src 2024-09-15T22:13:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:18 smithi154 ceph-mon[34853]: pgmap v391: 97 pgs: 97 active+clean; 2.0 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 124 KiB/s wr, 20 op/s 2024-09-15T22:13:18.774 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-15T22:13:18.774 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-15T22:13:18.774 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-15T22:13:18.893 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-15T22:13:18.893 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-15T22:13:18.984 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-15T22:13:18.984 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-15T22:13:19.070 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-15T22:13:19.070 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-15T22:13:19.176 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-15T22:13:19.176 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-15T22:13:19.283 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-15T22:13:19.283 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-15T22:13:19.383 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-15T22:13:19.383 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-15T22:13:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-15T22:13:19.508 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-15T22:13:19.587 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-15T22:13:19.588 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-15T22:13:19.668 INFO:tasks.workunit.client.0.smithi150.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-15T22:13:19.668 INFO:tasks.workunit.client.0.smithi150.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-15T22:13:19.742 INFO:tasks.workunit.client.0.smithi150.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-15T22:13:19.775 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-15T22:13:19.775 INFO:tasks.workunit.client.0.smithi150.stdout:Making all in man 2024-09-15T22:13:19.784 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-15T22:13:19.784 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Nothing to be done for 'all'. 2024-09-15T22:13:19.784 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-15T22:13:19.787 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:13:19.790 INFO:tasks.workunit.client.0.smithi150.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:13:19.790 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:13:19.791 INFO:tasks.workunit.client.0.smithi150.stderr:+ cd src 2024-09-15T22:13:19.792 INFO:tasks.workunit.client.0.smithi150.stderr:+ mkdir blogtest_in 2024-09-15T22:13:19.795 INFO:tasks.workunit.client.0.smithi150.stdout:running blogbench 2024-09-15T22:13:19.796 INFO:tasks.workunit.client.0.smithi150.stderr:+ echo 'running blogbench' 2024-09-15T22:13:19.796 INFO:tasks.workunit.client.0.smithi150.stderr:+ ./blogbench -d blogtest_in 2024-09-15T22:13:19.797 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-15T22:13:19.797 INFO:tasks.workunit.client.0.smithi150.stdout:Frequency = 10 secs 2024-09-15T22:13:19.797 INFO:tasks.workunit.client.0.smithi150.stdout:Scratch dir = [blogtest_in] 2024-09-15T22:13:20.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:20 smithi150 ceph-mon[30886]: pgmap v392: 97 pgs: 97 active+clean; 3.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 272 KiB/s wr, 34 op/s 2024-09-15T22:13:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:20 smithi169 ceph-mon[35850]: pgmap v392: 97 pgs: 97 active+clean; 3.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 272 KiB/s wr, 34 op/s 2024-09-15T22:13:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:20 smithi154 ceph-mon[34853]: pgmap v392: 97 pgs: 97 active+clean; 3.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 272 KiB/s wr, 34 op/s 2024-09-15T22:13:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 -- 172.21.15.150:0/1653986887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 msgr2=0x7f1684103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 --2- 172.21.15.150:0/1653986887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684103f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1674009860 tx=0x7f167402a340 comp rx=0 tx=0).stop 2024-09-15T22:13:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 -- 172.21.15.150:0/1653986887 shutdown_connections 2024-09-15T22:13:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 --2- 172.21.15.150:0/1653986887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1684105720 0x7f168410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 --2- 172.21.15.150:0/1653986887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 0x7f16841051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 --2- 172.21.15.150:0/1653986887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684103f70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 -- 172.21.15.150:0/1653986887 >> 172.21.15.150:0/1653986887 conn(0x7f16840ff310 msgr2=0x7f1684101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 -- 172.21.15.150:0/1653986887 shutdown_connections 2024-09-15T22:13:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.504+0000 7f1689000640 1 -- 172.21.15.150:0/1653986887 wait complete. 2024-09-15T22:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 Processor -- start 2024-09-15T22:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 -- start start 2024-09-15T22:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 0x7f168419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1684105720 0x7f16841a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f168410f7f0 con 0x7f1684104d60 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f168410f670 con 0x7f1684103b70 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.505+0000 7f1689000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f168410f970 con 0x7f1684105720 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1682a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 0x7f168419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54246/0 (socket says 172.21.15.150:54246) 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 -- 172.21.15.150:0/1841568415 learned_addr learned my addr 172.21.15.150:0/1841568415 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683e00640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1684105720 0x7f16841a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 -- 172.21.15.150:0/1841568415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1684105720 msgr2=0x7f16841a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1684105720 0x7f16841a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 -- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 msgr2=0x7f168419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 0x7f168419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 -- 172.21.15.150:0/1841568415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16841a1ac0 con 0x7f1684103b70 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1682a00640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 0x7f168419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f1683400640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684199ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1674035040 tx=0x7f1674033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.506+0000 7f167be00640 1 -- 172.21.15.150:0/1841568415 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674037040 con 0x7f1684103b70 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.507+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16841a1d50 con 0x7f1684103b70 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.507+0000 7f167be00640 1 -- 172.21.15.150:0/1841568415 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1674030850 con 0x7f1684103b70 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.507+0000 7f167be00640 1 -- 172.21.15.150:0/1841568415 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674004920 con 0x7f1684103b70 2024-09-15T22:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.507+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16841a21d0 con 0x7f1684103b70 2024-09-15T22:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f167be00640 1 -- 172.21.15.150:0/1841568415 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f1674004050 con 0x7f1684103b70 2024-09-15T22:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 Processor -- start 2024-09-15T22:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 -- start start 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a39660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a3c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f9d5999100 con 0x55f9d5a34ba0 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f9d59411b0 con 0x55f9d5a34260 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f168d63f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f9d59950c0 con 0x55f9d5a39c30 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f1683400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f1683e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f1683e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54250/0 (socket says 172.21.15.150:54250) 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f1683400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a39660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60914/0 (socket says 172.21.15.150:60914) 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f1683e00640 1 -- 172.21.15.150:0/3847921582 learned_addr learned my addr 172.21.15.150:0/3847921582 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.510+0000 7f1682a00640 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a3c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1683e00640 1 -- 172.21.15.150:0/3847921582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 msgr2=0x55f9d5a3c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1683e00640 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a3c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1683e00640 1 -- 172.21.15.150:0/3847921582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 msgr2=0x55f9d5a39660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1683e00640 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a39660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1683e00640 1 -- 172.21.15.150:0/3847921582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d56ac210 con 0x55f9d5a34260 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1683e00640 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f167c009fd0 tx=0x7f167c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92ae6329a329487f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1678c00640 1 -- 172.21.15.150:0/3847921582 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c004d20 con 0x55f9d5a34260 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1678c00640 1 -- 172.21.15.150:0/3847921582 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c004050 con 0x55f9d5a34260 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f1678c00640 1 -- 172.21.15.150:0/3847921582 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c005280 con 0x55f9d5a34260 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.511+0000 7f167be00640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f16680a3240 0x7f16680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f167be00640 1 -- 172.21.15.150:0/1841568415 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f16740ef7d0 con 0x7f1684103b70 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f1683400640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f16680a3240 0x7f16680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 -- 172.21.15.150:0/3847921582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 msgr2=0x55f9d5a34660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f167c009fd0 tx=0x7f167c0118d0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 -- 172.21.15.150:0/3847921582 shutdown_connections 2024-09-15T22:13:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a3c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a39660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 --2- 172.21.15.150:0/3847921582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 -- 172.21.15.150:0/3847921582 >> 172.21.15.150:0/3847921582 conn(0x55f9d5a2f8d0 msgr2=0x55f9d5a2fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 -- 172.21.15.150:0/3847921582 shutdown_connections 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f168d63f740 1 -- 172.21.15.150:0/3847921582 wait complete. 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.512+0000 7f1683400640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f16680a3240 0x7f16680a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16740ed610 tx=0x7f16740f5550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 -- start start 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 Processor -- start 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a3e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a3e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a45910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f9d5a3cc00 con 0x55f9d5a34ba0 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f9d5922090 con 0x55f9d5a34260 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f9d5a3cd80 con 0x55f9d5a39c30 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f168d63f740 10 client.0 _ll_register_callbacks cb 0x55f9d5976f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f1682a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a3e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f1683e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a3e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.513+0000 7f1683e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a3e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54260/0 (socket says 172.21.15.150:54260) 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1683e00640 1 -- 172.21.15.150:0/2782955090 learned_addr learned my addr 172.21.15.150:0/2782955090 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1683e00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a45910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1682a00640 1 -- 172.21.15.150:0/2782955090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 msgr2=0x55f9d5a45910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1682a00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a45910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1682a00640 1 -- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 msgr2=0x55f9d5a3e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1682a00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a3e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1682a00640 1 -- 172.21.15.150:0/2782955090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d5778620 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1683e00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a3e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f1682a00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a3e8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f168419b3b0 tx=0x7f167000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1019e72de8c9af77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f166d600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f166d600640 1 -- 172.21.15.150:0/2782955090 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167001e020 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f167c004050 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.514+0000 7f166d600640 1 -- 172.21.15.150:0/2782955090 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f16700047a0 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f166d600640 1 -- 172.21.15.150:0/2782955090 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16700049a0 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 10 client.15234 fetch_fsmap learned FSMap version 28 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9d5a48820 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f166d600640 1 -- 172.21.15.150:0/2782955090 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c004050 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f166d600640 1 -- 172.21.15.150:0/2782955090 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1670019070 con 0x55f9d5a34ba0 2024-09-15T22:13:21.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 10 client.15234 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 10 client.15234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 20 client.15234 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5a49ef0 0x55f9d5a4c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 4 client.15234 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.515+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9d59a6830 con 0x55f9d5a49ef0 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.516+0000 7f1683e00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5a49ef0 0x55f9d5a4c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.516+0000 7f1683e00640 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5a49ef0 0x55f9d5a4c320 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d340f9e750cfbb3 server_cookie=47a97c8cf1bb77dd in_seq=0 out_seq=0 2024-09-15T22:13:21.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.516+0000 7f166d600640 10 client.15234 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:21.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f166d600640 1 -- 172.21.15.150:0/2782955090 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9d59a6830 con 0x55f9d5a49ef0 2024-09-15T22:13:21.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f166d600640 10 client.15234 handle_command_reply: tid=0 2024-09-15T22:13:21.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 client.15234 shutdown 2024-09-15T22:13:21.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 msgr2=0x55f9d5a3e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a3e8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f168419b3b0 tx=0x7f167000f790 comp rx=0 tx=0).stop 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 shutdown_connections 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5a49ef0 0x55f9d5a4c320 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a39c30 0x55f9d5a45910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f166d600640 0 client.15234 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a3e8d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 --2- 172.21.15.150:0/2782955090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a3e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 >> 172.21.15.150:0/2782955090 conn(0x55f9d5a2f8d0 msgr2=0x55f9d5a310e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 shutdown_connections 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 1 -- 172.21.15.150:0/2782955090 wait complete. 2024-09-15T22:13:21.524 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.517+0000 7f168d63f740 20 client.15234 trim_cache size 0 max 16384 2024-09-15T22:13:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.532+0000 7f168d63f740 1 Processor -- start 2024-09-15T22:13:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 -- start start 2024-09-15T22:13:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a458d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a39c30 0x55f9d5a2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16841ab0b0 con 0x55f9d5a39c30 2024-09-15T22:13:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16841acbf0 con 0x55f9d5a34260 2024-09-15T22:13:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f168d63f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16841ab780 con 0x55f9d5a34ba0 2024-09-15T22:13:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1683e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1682a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1683e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54276/0 (socket says 172.21.15.150:54276) 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1683e00640 1 -- 172.21.15.150:0/4032339659 learned_addr learned my addr 172.21.15.150:0/4032339659 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1683e00640 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a39c30 0x55f9d5a2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1682a00640 1 -- 172.21.15.150:0/4032339659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 msgr2=0x55f9d5a34640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1682a00640 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1682a00640 1 -- 172.21.15.150:0/4032339659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a39c30 msgr2=0x55f9d5a2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1682a00640 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a39c30 0x55f9d5a2e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.533+0000 7f1682a00640 1 -- 172.21.15.150:0/4032339659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d5a35080 con 0x55f9d5a34ba0 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.534+0000 7f1682a00640 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a458d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16700247a0 tx=0x7f1670004930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b7bc9f00a39598 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.534+0000 7f166fe00640 1 -- 172.21.15.150:0/4032339659 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167001e040 con 0x55f9d5a34ba0 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.534+0000 7f166fe00640 1 -- 172.21.15.150:0/4032339659 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1670024820 con 0x55f9d5a34ba0 2024-09-15T22:13:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.534+0000 7f166fe00640 1 -- 172.21.15.150:0/4032339659 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670003b70 con 0x55f9d5a34ba0 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 -- 172.21.15.150:0/4032339659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34ba0 msgr2=0x55f9d5a458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a458d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16700247a0 tx=0x7f1670004930 comp rx=0 tx=0).stop 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 -- 172.21.15.150:0/4032339659 shutdown_connections 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a39c30 0x55f9d5a2e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a458d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 --2- 172.21.15.150:0/4032339659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a34260 0x55f9d5a34640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 -- 172.21.15.150:0/4032339659 >> 172.21.15.150:0/4032339659 conn(0x55f9d5a2f8d0 msgr2=0x55f9d5a2e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 -- 172.21.15.150:0/4032339659 shutdown_connections 2024-09-15T22:13:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 -- 172.21.15.150:0/4032339659 wait complete. 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 -- start start 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.535+0000 7f168d63f740 1 Processor -- start 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34260 0x55f9d5a42790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a42cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a39c30 0x55f9d5ab2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16841ac520 con 0x55f9d5a34ba0 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16841abe50 con 0x55f9d5a39c30 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16841a9090 con 0x55f9d5a34260 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f168d63f740 10 client.0 _ll_register_callbacks cb 0x7f1670011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a42cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a42cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60926/0 (socket says 172.21.15.150:60926) 2024-09-15T22:13:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 -- 172.21.15.150:0/1942239153 learned_addr learned my addr 172.21.15.150:0/1942239153 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1683e00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34260 0x55f9d5a42790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1683e00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a39c30 0x55f9d5ab2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 -- 172.21.15.150:0/1942239153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34260 msgr2=0x55f9d5a42790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34260 0x55f9d5a42790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 -- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a39c30 msgr2=0x55f9d5ab2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a39c30 0x55f9d5ab2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.536+0000 7f1682a00640 1 -- 172.21.15.150:0/1942239153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d5ab3130 con 0x55f9d5a34ba0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f1682a00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a42cd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f167000f7d0 tx=0x7f1670024460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cf5f4363b48c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f166d600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f166d600640 1 -- 172.21.15.150:0/1942239153 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167003a060 con 0x55f9d5a34ba0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f166d600640 1 -- 172.21.15.150:0/1942239153 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f16700042f0 con 0x55f9d5a34ba0 2024-09-15T22:13:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1670024820 con 0x55f9d5a34ba0 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f166d600640 1 -- 172.21.15.150:0/1942239153 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f167001e040 con 0x55f9d5a34ba0 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f168d63f740 10 client.15240 fetch_fsmap learned FSMap version 28 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9d5ab43a0 con 0x55f9d5a34ba0 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f166d600640 1 -- 172.21.15.150:0/1942239153 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1670024820 con 0x55f9d5a34ba0 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.537+0000 7f166d600640 1 -- 172.21.15.150:0/1942239153 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1670019040 con 0x55f9d5a34ba0 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f168d63f740 10 client.15240 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f168d63f740 10 client.15240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f168d63f740 20 client.15240 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f168d63f740 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5ab4c10 0x55f9d5ab7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f168d63f740 4 client.15240 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9d59a0b80 con 0x55f9d5ab4c10 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f1683e00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5ab4c10 0x55f9d5ab7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f1683e00640 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5ab4c10 0x55f9d5ab7030 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=904453702a74cde6 server_cookie=5a85968c86a9929 in_seq=0 out_seq=0 2024-09-15T22:13:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.538+0000 7f166d600640 10 client.15240 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.583+0000 7f166d600640 1 -- 172.21.15.150:0/1942239153 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9d59a0b80 con 0x55f9d5ab4c10 2024-09-15T22:13:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f166d600640 10 client.15240 handle_command_reply: tid=0 2024-09-15T22:13:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 client.15240 shutdown 2024-09-15T22:13:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 msgr2=0x55f9d5a42cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a42cd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f167000f7d0 tx=0x7f1670024460 comp rx=0 tx=0).stop 2024-09-15T22:13:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 shutdown_connections 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f9d5ab4c10 0x55f9d5ab7030 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9d5a39c30 0x55f9d5ab2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f9d5a34ba0 0x55f9d5a42cd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f166d600640 0 client.15240 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 --2- 172.21.15.150:0/1942239153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9d5a34260 0x55f9d5a42790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 >> 172.21.15.150:0/1942239153 conn(0x55f9d5a2f8d0 msgr2=0x55f9d5a2ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 shutdown_connections 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 1 -- 172.21.15.150:0/1942239153 wait complete. 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.584+0000 7f168d63f740 20 client.15240 trim_cache size 0 max 16384 2024-09-15T22:13:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:13:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:13:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:13:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:13:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f16680a3240 msgr2=0x7f16680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f16680a3240 0x7f16680a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16740ed610 tx=0x7f16740f5550 comp rx=0 tx=0).stop 2024-09-15T22:13:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 msgr2=0x7f1684199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684199ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1674035040 tx=0x7f1674033d90 comp rx=0 tx=0).stop 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 shutdown_connections 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1684105720 0x7f16841a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f16680a3240 0x7f16680a5700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1684104d60 0x7f168419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 --2- 172.21.15.150:0/1841568415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1684103b70 0x7f1684199ea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 >> 172.21.15.150:0/1841568415 conn(0x7f16840ff310 msgr2=0x7f1684108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 shutdown_connections 2024-09-15T22:13:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:21.585+0000 7f1689000640 1 -- 172.21.15.150:0/1841568415 wait complete. 2024-09-15T22:13:21.636 INFO:tasks.workunit.client.0.smithi150.stdout:Spawning 3 writers... 2024-09-15T22:13:21.636 INFO:tasks.workunit.client.0.smithi150.stdout:Spawning 1 rewriters... 2024-09-15T22:13:21.636 INFO:tasks.workunit.client.0.smithi150.stdout:Spawning 5 commenters... 2024-09-15T22:13:21.637 INFO:tasks.workunit.client.0.smithi150.stdout:Spawning 100 readers... 2024-09-15T22:13:21.642 INFO:tasks.workunit.client.0.smithi150.stdout:Benchmarking for 30 iterations. 2024-09-15T22:13:21.642 INFO:tasks.workunit.client.0.smithi150.stdout:The test will run during 5 minutes. 2024-09-15T22:13:21.642 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-15T22:13:21.642 INFO:tasks.workunit.client.0.smithi150.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-15T22:13:22.680 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:22 smithi150 ceph-mon[30886]: pgmap v393: 97 pgs: 97 active+clean; 4.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 341 KiB/s wr, 45 op/s 2024-09-15T22:13:22.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:22 smithi169 ceph-mon[35850]: pgmap v393: 97 pgs: 97 active+clean; 4.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 341 KiB/s wr, 45 op/s 2024-09-15T22:13:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:22 smithi154 ceph-mon[34853]: pgmap v393: 97 pgs: 97 active+clean; 4.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 341 KiB/s wr, 45 op/s 2024-09-15T22:13:24.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:24 smithi150 ceph-mon[30886]: pgmap v394: 97 pgs: 97 active+clean; 4.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 351 KiB/s wr, 47 op/s 2024-09-15T22:13:24.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:24 smithi169 ceph-mon[35850]: pgmap v394: 97 pgs: 97 active+clean; 4.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 351 KiB/s wr, 47 op/s 2024-09-15T22:13:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:24 smithi154 ceph-mon[34853]: pgmap v394: 97 pgs: 97 active+clean; 4.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 351 KiB/s wr, 47 op/s 2024-09-15T22:13:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:25 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:25 smithi150 ceph-mon[30886]: pgmap v395: 97 pgs: 97 active+clean; 5.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 542 KiB/s wr, 80 op/s 2024-09-15T22:13:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:25 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:25 smithi169 ceph-mon[35850]: pgmap v395: 97 pgs: 97 active+clean; 5.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 542 KiB/s wr, 80 op/s 2024-09-15T22:13:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:25 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:25 smithi154 ceph-mon[34853]: pgmap v395: 97 pgs: 97 active+clean; 5.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 542 KiB/s wr, 80 op/s 2024-09-15T22:13:28.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:28 smithi154 ceph-mon[34853]: pgmap v396: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 980 KiB/s wr, 91 op/s 2024-09-15T22:13:28.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:28 smithi150 ceph-mon[30886]: pgmap v396: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 980 KiB/s wr, 91 op/s 2024-09-15T22:13:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:28 smithi169 ceph-mon[35850]: pgmap v396: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 980 KiB/s wr, 91 op/s 2024-09-15T22:13:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:30 smithi154 ceph-mon[34853]: pgmap v397: 97 pgs: 97 active+clean; 15 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-09-15T22:13:30.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:30 smithi150 ceph-mon[30886]: pgmap v397: 97 pgs: 97 active+clean; 15 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-09-15T22:13:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:30 smithi169 ceph-mon[35850]: pgmap v397: 97 pgs: 97 active+clean; 15 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-09-15T22:13:31.642 INFO:tasks.workunit.client.0.smithi150.stdout: 11 136721 607 90352 717 20274 671 2024-09-15T22:13:32.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:32 smithi154 ceph-mon[34853]: pgmap v398: 97 pgs: 97 active+clean; 25 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-09-15T22:13:32.532 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:32 smithi150 ceph-mon[30886]: pgmap v398: 97 pgs: 97 active+clean; 25 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-09-15T22:13:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:32 smithi169 ceph-mon[35850]: pgmap v398: 97 pgs: 97 active+clean; 25 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-09-15T22:13:34.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:34 smithi154 ceph-mon[34853]: pgmap v399: 97 pgs: 97 active+clean; 26 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 2.0 MiB/s wr, 124 op/s 2024-09-15T22:13:34.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:34 smithi150 ceph-mon[30886]: pgmap v399: 97 pgs: 97 active+clean; 26 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 2.0 MiB/s wr, 124 op/s 2024-09-15T22:13:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:34 smithi169 ceph-mon[35850]: pgmap v399: 97 pgs: 97 active+clean; 26 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 2.0 MiB/s wr, 124 op/s 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 -- 172.21.15.150:0/4100672329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614105910 msgr2=0x7f661410c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 --2- 172.21.15.150:0/4100672329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614105910 0x7f661410c1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f660c009ca0 tx=0x7f660c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 -- 172.21.15.150:0/4100672329 shutdown_connections 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 --2- 172.21.15.150:0/4100672329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614105910 0x7f661410c1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 --2- 172.21.15.150:0/4100672329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614104f50 0x7f66141053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 --2- 172.21.15.150:0/4100672329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614103d60 0x7f6614104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 -- 172.21.15.150:0/4100672329 >> 172.21.15.150:0/4100672329 conn(0x7f66140ff4e0 msgr2=0x7f6614101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 -- 172.21.15.150:0/4100672329 shutdown_connections 2024-09-15T22:13:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.769+0000 7f6619800640 1 -- 172.21.15.150:0/4100672329 wait complete. 2024-09-15T22:13:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.770+0000 7f6619800640 1 Processor -- start 2024-09-15T22:13:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.770+0000 7f6619800640 1 -- start start 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6619800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 0x7f6614199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6619800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614104f50 0x7f661419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6619800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614105910 0x7f66141a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6619800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f661410fa30 con 0x7f6614105910 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6619800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f661410f8b0 con 0x7f6614103d60 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6619800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f661410fbb0 con 0x7f6614104f50 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 0x7f6614199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6613400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614105910 0x7f66141a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 0x7f6614199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53502/0 (socket says 172.21.15.150:53502) 2024-09-15T22:13:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 -- 172.21.15.150:0/698919425 learned_addr learned my addr 172.21.15.150:0/698919425 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612000640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614104f50 0x7f661419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 -- 172.21.15.150:0/698919425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614104f50 msgr2=0x7f661419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614104f50 0x7f661419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 -- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614105910 msgr2=0x7f66141a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614105910 0x7f66141a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6612a00640 1 -- 172.21.15.150:0/698919425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66141a1bb0 con 0x7f6614103d60 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.771+0000 7f6613400640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614105910 0x7f66141a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.772+0000 7f6612a00640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 0x7f6614199f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f660400e9c0 tx=0x7f660400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.772+0000 7f660b400640 1 -- 172.21.15.150:0/698919425 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660400cde0 con 0x7f6614103d60 2024-09-15T22:13:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.772+0000 7f660b400640 1 -- 172.21.15.150:0/698919425 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6604010910 con 0x7f6614103d60 2024-09-15T22:13:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.772+0000 7f660b400640 1 -- 172.21.15.150:0/698919425 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604018a00 con 0x7f6614103d60 2024-09-15T22:13:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.772+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66141a1ea0 con 0x7f6614103d60 2024-09-15T22:13:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.772+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66141a2360 con 0x7f6614103d60 2024-09-15T22:13:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.775+0000 7f660b400640 1 -- 172.21.15.150:0/698919425 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f660401f020 con 0x7f6614103d60 2024-09-15T22:13:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.775+0000 7f661c7d3740 1 Processor -- start 2024-09-15T22:13:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 -- start start 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312e3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e231243100 con 0x55e2312de090 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e2311eb1b0 con 0x55e2312de9d0 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f661c7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e23123f0c0 con 0x55e2312e3a60 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f6612a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f6612a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53508/0 (socket says 172.21.15.150:53508) 2024-09-15T22:13:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f6612a00640 1 -- 172.21.15.150:0/2179919796 learned_addr learned my addr 172.21.15.150:0/2179919796 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f6613400640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.776+0000 7f660b400640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65f80a3370 0x7f65f80a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612000640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f660b400640 1 -- 172.21.15.150:0/698919425 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f66040cfb10 con 0x7f6614103d60 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612a00640 1 -- 172.21.15.150:0/2179919796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 msgr2=0x55e2312e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612a00640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312e5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612a00640 1 -- 172.21.15.150:0/2179919796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 msgr2=0x55e2312de490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612a00640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612a00640 1 -- 172.21.15.150:0/2179919796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e230f56210 con 0x55e2312de9d0 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6613400640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612000640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.777+0000 7f6612a00640 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312e3490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f660409bda0 tx=0x7f660409bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85f22e26a5a15f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f6613400640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65f80a3370 0x7f65f80a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f65ffe00640 1 -- 172.21.15.150:0/2179919796 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660409c0a0 con 0x55e2312de9d0 2024-09-15T22:13:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f65ffe00640 1 -- 172.21.15.150:0/2179919796 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66040a0450 con 0x55e2312de9d0 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f65ffe00640 1 -- 172.21.15.150:0/2179919796 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604010ac0 con 0x55e2312de9d0 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f6613400640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65f80a3370 0x7f65f80a5830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f660c005e30 tx=0x7f660c040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f661c7d3740 1 -- 172.21.15.150:0/2179919796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 msgr2=0x55e2312e3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.778+0000 7f661c7d3740 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312e3490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f660409bda0 tx=0x7f660409bf30 comp rx=0 tx=0).stop 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 -- 172.21.15.150:0/2179919796 shutdown_connections 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312e3490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 --2- 172.21.15.150:0/2179919796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 -- 172.21.15.150:0/2179919796 >> 172.21.15.150:0/2179919796 conn(0x55e2312d9700 msgr2=0x55e2312d9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 -- 172.21.15.150:0/2179919796 shutdown_connections 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 -- 172.21.15.150:0/2179919796 wait complete. 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 -- start start 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.779+0000 7f661c7d3740 1 Processor -- start 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312de090 0x55e2312f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312e3a60 0x55e2312f8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e2312e69d0 con 0x55e2312e3a60 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e2311cc090 con 0x55e2312de9d0 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e2312e6b50 con 0x55e2312de090 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f661c7d3740 10 client.0 _ll_register_callbacks cb 0x55e231220f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:34.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312de090 0x55e2312f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53524/0 (socket says 172.21.15.150:53524) 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612000640 1 -- 172.21.15.150:0/359375216 learned_addr learned my addr 172.21.15.150:0/359375216 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6613400640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312e3a60 0x55e2312f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612a00640 1 -- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 msgr2=0x55e2312f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612a00640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612a00640 1 -- 172.21.15.150:0/359375216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312e3a60 msgr2=0x55e2312f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612a00640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312e3a60 0x55e2312f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6612a00640 1 -- 172.21.15.150:0/359375216 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e231022620 con 0x55e2312de090 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.780+0000 7f6613400640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312e3a60 0x55e2312f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f6612a00640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312de090 0x55e2312f0ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66040cf040 tx=0x7f66040106c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ead3fb2ddad2e84f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f65fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f65fcc00640 1 -- 172.21.15.150:0/359375216 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66040a4d10 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66040a0450 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f65fcc00640 1 -- 172.21.15.150:0/359375216 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f6604010ac0 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f65fcc00640 1 -- 172.21.15.150:0/359375216 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66040a0070 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f661c7d3740 10 client.25249 fetch_fsmap learned FSMap version 29 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2312e69d0 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.781+0000 7f65fcc00640 1 -- 172.21.15.150:0/359375216 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66040a0450 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f65fcc00640 1 -- 172.21.15.150:0/359375216 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f66040b7060 con 0x55e2312de090 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f661c7d3740 10 client.25249 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f661c7d3740 10 client.25249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f661c7d3740 20 client.25249 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f661c7d3740 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e2312fbff0 0x55e2312fe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f661c7d3740 4 client.25249 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e231250830 con 0x55e2312fbff0 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f6612000640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e2312fbff0 0x55e2312fe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f65fcc00640 10 client.25249 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.782+0000 7f6612000640 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e2312fbff0 0x55e2312fe3e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73a621917179a2 server_cookie=361bb761d2dae321 in_seq=0 out_seq=0 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f65fcc00640 1 -- 172.21.15.150:0/359375216 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e231250830 con 0x55e2312fbff0 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f65fcc00640 10 client.25249 handle_command_reply: tid=0 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 client.25249 shutdown 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312de090 msgr2=0x55e2312f0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312de090 0x55e2312f0ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66040cf040 tx=0x7f66040106c0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 shutdown_connections 2024-09-15T22:13:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e2312fbff0 0x55e2312fe3e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312e3a60 0x55e2312f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 --2- 172.21.15.150:0/359375216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312de090 0x55e2312f0ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 >> 172.21.15.150:0/359375216 conn(0x55e2312d9700 msgr2=0x55e2312daf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.783+0000 7f65fcc00640 0 client.25249 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.784+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 shutdown_connections 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.784+0000 7f661c7d3740 1 -- 172.21.15.150:0/359375216 wait complete. 2024-09-15T22:13:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.784+0000 7f661c7d3740 20 client.25249 trim_cache size 0 max 16384 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 Processor -- start 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 -- start start 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66141a6e60 con 0x55e2312de090 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66141a89d0 con 0x55e2312de9d0 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.799+0000 7f661c7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66141a7530 con 0x55e2312e3a60 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53540/0 (socket says 172.21.15.150:53540) 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47674/0 (socket says 172.21.15.150:47674) 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 -- 172.21.15.150:0/684051802 learned_addr learned my addr 172.21.15.150:0/684051802 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6613400640 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 -- 172.21.15.150:0/684051802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 msgr2=0x55e2312f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 -- 172.21.15.150:0/684051802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 msgr2=0x55e2312de470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 -- 172.21.15.150:0/684051802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2312fea10 con 0x55e2312de9d0 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6613400640 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:34.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f6612000640 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e2312fec40 tx=0x7f6600005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d90c34c1fcb06c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.800+0000 7f65ff400640 1 -- 172.21.15.150:0/684051802 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600010430 con 0x55e2312de9d0 2024-09-15T22:13:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f65ff400640 1 -- 172.21.15.150:0/684051802 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6600010ab0 con 0x55e2312de9d0 2024-09-15T22:13:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f65ff400640 1 -- 172.21.15.150:0/684051802 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660001ead0 con 0x55e2312de9d0 2024-09-15T22:13:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 -- 172.21.15.150:0/684051802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 msgr2=0x55e2312f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e2312fec40 tx=0x7f6600005f90 comp rx=0 tx=0).stop 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 -- 172.21.15.150:0/684051802 shutdown_connections 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de9d0 0x55e2312f0ed0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 --2- 172.21.15.150:0/684051802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de090 0x55e2312de470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 -- 172.21.15.150:0/684051802 >> 172.21.15.150:0/684051802 conn(0x55e2312d9700 msgr2=0x55e2312d8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 -- 172.21.15.150:0/684051802 shutdown_connections 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.801+0000 7f661c7d3740 1 -- 172.21.15.150:0/684051802 wait complete. 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 -- start start 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 Processor -- start 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 0x55e2312f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de9d0 0x55e2312f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66141a82d0 con 0x55e2312de9d0 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66141a7c00 con 0x55e2312de090 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66141a4e40 con 0x55e2312e3a60 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f661c7d3740 10 client.0 _ll_register_callbacks cb 0x7f6604010e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f6612a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 0x55e2312f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f6612a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 0x55e2312f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53548/0 (socket says 172.21.15.150:53548) 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.802+0000 7f6612a00640 1 -- 172.21.15.150:0/3158269413 learned_addr learned my addr 172.21.15.150:0/3158269413 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612000640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de9d0 0x55e2312f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6613400640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612a00640 1 -- 172.21.15.150:0/3158269413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 msgr2=0x55e2312f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612a00640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612a00640 1 -- 172.21.15.150:0/3158269413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de9d0 msgr2=0x55e2312f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612a00640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de9d0 0x55e2312f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612a00640 1 -- 172.21.15.150:0/3158269413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2312d4d60 con 0x55e2312de090 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f6612a00640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 0x55e2312f56d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6604098500 tx=0x7f66040a4d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0044e259559b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f65fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f65fcc00640 1 -- 172.21.15.150:0/3158269413 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66040a4a90 con 0x55e2312de090 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f65fcc00640 1 -- 172.21.15.150:0/3158269413 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f660409b4f0 con 0x55e2312de090 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.803+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6600010ab0 con 0x55e2312de090 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f65fcc00640 1 -- 172.21.15.150:0/3158269413 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66040a0210 con 0x55e2312de090 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 10 client.25286 fetch_fsmap learned FSMap version 29 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2312d4d60 con 0x55e2312de090 2024-09-15T22:13:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f65fcc00640 1 -- 172.21.15.150:0/3158269413 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6600010ab0 con 0x55e2312de090 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f65fcc00640 1 -- 172.21.15.150:0/3158269413 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f66040b7070 con 0x55e2312de090 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 10 client.25286 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 10 client.25286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 20 client.25286 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e231366fb0 0x55e2313693a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 4 client.25286 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e23124ab80 con 0x55e231366fb0 2024-09-15T22:13:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.804+0000 7f6612000640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e231366fb0 0x55e2313693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.805+0000 7f6612000640 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e231366fb0 0x55e2313693a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56379ad5607bbe7 server_cookie=8cf1a2dce4328700 in_seq=0 out_seq=0 2024-09-15T22:13:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.805+0000 7f65fcc00640 10 client.25286 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f65fcc00640 1 -- 172.21.15.150:0/3158269413 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e23124ab80 con 0x55e231366fb0 2024-09-15T22:13:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f65fcc00640 10 client.25286 handle_command_reply: tid=0 2024-09-15T22:13:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 client.25286 shutdown 2024-09-15T22:13:34.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 msgr2=0x55e2312f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 0x55e2312f56d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6604098500 tx=0x7f66040a4d80 comp rx=0 tx=0).stop 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 shutdown_connections 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e231366fb0 0x55e2313693a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2312e3a60 0x55e2312f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e2312de9d0 0x55e2312f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 --2- 172.21.15.150:0/3158269413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e2312de090 0x55e2312f56d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f65fcc00640 0 client.25286 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 >> 172.21.15.150:0/3158269413 conn(0x55e2312d9700 msgr2=0x55e2312d9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 shutdown_connections 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.824+0000 7f661c7d3740 1 -- 172.21.15.150:0/3158269413 wait complete. 2024-09-15T22:13:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.825+0000 7f661c7d3740 20 client.25286 trim_cache size 0 max 16384 2024-09-15T22:13:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:13:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:13:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:13:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65f80a3370 msgr2=0x7f65f80a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65f80a3370 0x7f65f80a5830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f660c005e30 tx=0x7f660c040040 comp rx=0 tx=0).stop 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 msgr2=0x7f6614199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 0x7f6614199f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f660400e9c0 tx=0x7f660400ee80 comp rx=0 tx=0).stop 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 shutdown_connections 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65f80a3370 0x7f65f80a5830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6614105910 0x7f66141a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614104f50 0x7f661419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 --2- 172.21.15.150:0/698919425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6614103d60 0x7f6614199f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 >> 172.21.15.150:0/698919425 conn(0x7f66140ff4e0 msgr2=0x7f66141081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 shutdown_connections 2024-09-15T22:13:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:34.826+0000 7f6619800640 1 -- 172.21.15.150:0/698919425 wait complete. 2024-09-15T22:13:36.558 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:36 smithi150 ceph-mon[30886]: pgmap v400: 97 pgs: 97 active+clean; 34 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 2.7 MiB/s wr, 177 op/s 2024-09-15T22:13:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:36 smithi169 ceph-mon[35850]: pgmap v400: 97 pgs: 97 active+clean; 34 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 2.7 MiB/s wr, 177 op/s 2024-09-15T22:13:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:36 smithi154 ceph-mon[34853]: pgmap v400: 97 pgs: 97 active+clean; 34 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 2.7 MiB/s wr, 177 op/s 2024-09-15T22:13:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:38 smithi150 ceph-mon[30886]: pgmap v401: 97 pgs: 97 active+clean; 40 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 167 op/s 2024-09-15T22:13:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:38 smithi169 ceph-mon[35850]: pgmap v401: 97 pgs: 97 active+clean; 40 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 167 op/s 2024-09-15T22:13:38.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:38 smithi154 ceph-mon[34853]: pgmap v401: 97 pgs: 97 active+clean; 40 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 167 op/s 2024-09-15T22:13:40.295 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:40 smithi150 ceph-mon[30886]: pgmap v402: 97 pgs: 97 active+clean; 36 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-15T22:13:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:40 smithi169 ceph-mon[35850]: pgmap v402: 97 pgs: 97 active+clean; 36 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-15T22:13:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:40 smithi154 ceph-mon[34853]: pgmap v402: 97 pgs: 97 active+clean; 36 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-15T22:13:41.645 INFO:tasks.workunit.client.0.smithi150.stdout: 22 494393 662 357769 602 156566 1406 2024-09-15T22:13:42.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:42 smithi150 ceph-mon[30886]: pgmap v403: 97 pgs: 97 active+clean; 43 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 160 op/s 2024-09-15T22:13:42.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:42 smithi169 ceph-mon[35850]: pgmap v403: 97 pgs: 97 active+clean; 43 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 160 op/s 2024-09-15T22:13:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:42 smithi154 ceph-mon[34853]: pgmap v403: 97 pgs: 97 active+clean; 43 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 160 op/s 2024-09-15T22:13:44.681 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:44 smithi150 ceph-mon[30886]: pgmap v404: 97 pgs: 97 active+clean; 47 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 121 op/s 2024-09-15T22:13:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:44 smithi169 ceph-mon[35850]: pgmap v404: 97 pgs: 97 active+clean; 47 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 121 op/s 2024-09-15T22:13:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:44 smithi154 ceph-mon[34853]: pgmap v404: 97 pgs: 97 active+clean; 47 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 121 op/s 2024-09-15T22:13:45.617 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:45 smithi150 ceph-mon[30886]: pgmap v405: 97 pgs: 97 active+clean; 53 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 132 op/s 2024-09-15T22:13:45.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:45 smithi169 ceph-mon[35850]: pgmap v405: 97 pgs: 97 active+clean; 53 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 132 op/s 2024-09-15T22:13:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:45 smithi154 ceph-mon[34853]: pgmap v405: 97 pgs: 97 active+clean; 53 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 132 op/s 2024-09-15T22:13:47.501 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:47 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:47.501 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:47 smithi150 ceph-mon[30886]: pgmap v406: 97 pgs: 97 active+clean; 53 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 79 op/s 2024-09-15T22:13:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:47 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:47 smithi154 ceph-mon[34853]: pgmap v406: 97 pgs: 97 active+clean; 53 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 79 op/s 2024-09-15T22:13:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 -- 172.21.15.150:0/3720400058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 msgr2=0x7f42a810c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 --2- 172.21.15.150:0/3720400058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 0x7f42a810c1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009be0 tx=0x7f42a002a6d0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 -- 172.21.15.150:0/3720400058 shutdown_connections 2024-09-15T22:13:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 --2- 172.21.15.150:0/3720400058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 0x7f42a810c1a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 --2- 172.21.15.150:0/3720400058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a8104f50 0x7f42a81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 --2- 172.21.15.150:0/3720400058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 -- 172.21.15.150:0/3720400058 >> 172.21.15.150:0/3720400058 conn(0x7f42a80ff4e0 msgr2=0x7f42a8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 -- 172.21.15.150:0/3720400058 shutdown_connections 2024-09-15T22:13:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.955+0000 7f42afe00640 1 -- 172.21.15.150:0/3720400058 wait complete. 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 Processor -- start 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 -- start start 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a8104f50 0x7f42a819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 0x7f42a81a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f42a810f9e0 con 0x7f42a8105910 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42a810f860 con 0x7f42a8104f50 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.956+0000 7f42afe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42a810fb60 con 0x7f42a8103d60 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40624/0 (socket says 172.21.15.150:40624) 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 -- 172.21.15.150:0/3118675490 learned_addr learned my addr 172.21.15.150:0/3118675490 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ade00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 0x7f42a81a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42aca00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a8104f50 0x7f42a819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 -- 172.21.15.150:0/3118675490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a8104f50 msgr2=0x7f42a819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a8104f50 0x7f42a819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 -- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 msgr2=0x7f42a81a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 0x7f42a81a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 -- 172.21.15.150:0/3118675490 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a81a1bf0 con 0x7f42a8103d60 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.957+0000 7f42ad400640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8199fd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f429c00e9c0 tx=0x7f429c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.958+0000 7f42a6000640 1 -- 172.21.15.150:0/3118675490 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c00cd80 con 0x7f42a8103d60 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.958+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a81a1ee0 con 0x7f42a8103d60 2024-09-15T22:13:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.958+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81a2340 con 0x7f42a8103d60 2024-09-15T22:13:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.958+0000 7f42a6000640 1 -- 172.21.15.150:0/3118675490 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f429c0035f0 con 0x7f42a8103d60 2024-09-15T22:13:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.958+0000 7f42a6000640 1 -- 172.21.15.150:0/3118675490 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c010690 con 0x7f42a8103d60 2024-09-15T22:13:47.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:47 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:47.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:47 smithi169 ceph-mon[35850]: pgmap v406: 97 pgs: 97 active+clean; 53 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 79 op/s 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.961+0000 7f42b2df5740 1 Processor -- start 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.961+0000 7f42b2df5740 1 -- start start 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.961+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.961+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.961+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42b2df5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5602d5742100 con 0x5602d57e2a60 2024-09-15T22:13:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42b2df5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5602d56ea1b0 con 0x5602d57dd090 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42b2df5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5602d573e0c0 con 0x5602d57dd9d0 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57dd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:47650/0 (socket says 172.21.15.150:47650) 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 -- 172.21.15.150:0/420395321 learned_addr learned my addr 172.21.15.150:0/420395321 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42aca00640 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 -- 172.21.15.150:0/420395321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 msgr2=0x5602d57e2490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e2490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42a6000640 1 -- 172.21.15.150:0/3118675490 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f429c004000 con 0x7f42a8103d60 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 -- 172.21.15.150:0/420395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 msgr2=0x5602d57e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.962+0000 7f42ade00640 1 -- 172.21.15.150:0/420395321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d5455210 con 0x5602d57dd090 2024-09-15T22:13:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.963+0000 7f42ade00640 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57dd490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009be0 tx=0x7f42a00092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33ce2c0ffa25a510 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.963+0000 7f429a600640 1 -- 172.21.15.150:0/420395321 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0041030 con 0x5602d57dd090 2024-09-15T22:13:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.963+0000 7f429a600640 1 -- 172.21.15.150:0/420395321 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42a0030bb0 con 0x5602d57dd090 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.963+0000 7f429a600640 1 -- 172.21.15.150:0/420395321 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0036040 con 0x5602d57dd090 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 -- 172.21.15.150:0/420395321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 msgr2=0x5602d57dd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57dd490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009be0 tx=0x7f42a00092f0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 -- 172.21.15.150:0/420395321 shutdown_connections 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 --2- 172.21.15.150:0/420395321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57dd490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 -- 172.21.15.150:0/420395321 >> 172.21.15.150:0/420395321 conn(0x5602d57d8700 msgr2=0x5602d57d8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 -- 172.21.15.150:0/420395321 shutdown_connections 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 -- 172.21.15.150:0/420395321 wait complete. 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42a6000640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f42900a3280 0x7f42900a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42a6000640 1 -- 172.21.15.150:0/3118675490 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f429c0cfc40 con 0x7f42a8103d60 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42b2df5740 1 -- start start 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.964+0000 7f42ade00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f42900a3280 0x7f42900a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 Processor -- start 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5602d57e59d0 con 0x5602d57e2a60 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5602d56cb090 con 0x5602d57dd090 2024-09-15T22:13:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5602d57e5b50 con 0x5602d57dd9d0 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42b2df5740 10 client.0 _ll_register_callbacks cb 0x5602d571ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42ade00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f42900a3280 0x7f42900a5740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42a0003db0 tx=0x7f42a002a6d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42ad400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42ad400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:47664/0 (socket says 172.21.15.150:47664) 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.965+0000 7f42ad400640 1 -- 172.21.15.150:0/3520605282 learned_addr learned my addr 172.21.15.150:0/3520605282 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42aca00640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ade00640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ad400640 1 -- 172.21.15.150:0/3520605282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 msgr2=0x5602d57e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ad400640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ad400640 1 -- 172.21.15.150:0/3520605282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 msgr2=0x5602d57ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ad400640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ad400640 1 -- 172.21.15.150:0/3520605282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d5521620 con 0x5602d57dd090 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ade00640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42ad400640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57e71c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f429c098ba0 tx=0x7f429c09bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34694be98849270e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f428ea00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f428ea00640 1 -- 172.21.15.150:0/3520605282 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0a4e40 con 0x5602d57dd090 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a0030bb0 con 0x5602d57dd090 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f428ea00640 1 -- 172.21.15.150:0/3520605282 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f429c0a0170 con 0x5602d57dd090 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f428ea00640 1 -- 172.21.15.150:0/3520605282 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f429c0bc070 con 0x5602d57dd090 2024-09-15T22:13:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42b2df5740 10 client.25298 fetch_fsmap learned FSMap version 30 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.966+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5602d57f1600 con 0x5602d57dd090 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f428ea00640 1 -- 172.21.15.150:0/3520605282 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42a0030bb0 con 0x5602d57dd090 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f428ea00640 1 -- 172.21.15.150:0/3520605282 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f429c0cdb70 con 0x5602d57dd090 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42b2df5740 10 client.25298 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42b2df5740 10 client.25298 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42b2df5740 20 client.25298 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42b2df5740 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d57f2d40 0x5602d57f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42b2df5740 4 client.25298 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602d574f830 con 0x5602d57f2d40 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.967+0000 7f42aca00640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d57f2d40 0x5602d57f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.968+0000 7f42aca00640 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d57f2d40 0x5602d57f5160 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47168a76155fb7a0 server_cookie=db3ce0398659ae7e in_seq=0 out_seq=0 2024-09-15T22:13:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.968+0000 7f428ea00640 10 client.25298 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.969+0000 7f428ea00640 1 -- 172.21.15.150:0/3520605282 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602d574f830 con 0x5602d57f2d40 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.969+0000 7f428ea00640 10 client.25298 handle_command_reply: tid=0 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.969+0000 7f42b2df5740 1 client.25298 shutdown 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.969+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 msgr2=0x5602d57e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.969+0000 7f42b2df5740 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57e71c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f429c098ba0 tx=0x7f429c09bbf0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 shutdown_connections 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d57f2d40 0x5602d57f5160 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57e2a60 0x5602d57ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd9d0 0x5602d57e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 --2- 172.21.15.150:0/3520605282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57dd090 0x5602d57e71c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f428ea00640 0 client.25298 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 >> 172.21.15.150:0/3520605282 conn(0x5602d57d8700 msgr2=0x5602d57d9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 shutdown_connections 2024-09-15T22:13:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 1 -- 172.21.15.150:0/3520605282 wait complete. 2024-09-15T22:13:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.970+0000 7f42b2df5740 20 client.25298 trim_cache size 0 max 16384 2024-09-15T22:13:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.992+0000 7f42b2df5740 1 Processor -- start 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.992+0000 7f42b2df5740 1 -- start start 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ee680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57d7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42b2df5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f428800e530 con 0x5602d57dd9d0 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42b2df5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42880100d0 con 0x5602d57e2a60 2024-09-15T22:13:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42b2df5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f428800ec00 con 0x5602d57dd090 2024-09-15T22:13:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57e75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40646/0 (socket says 172.21.15.150:40646) 2024-09-15T22:13:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 -- 172.21.15.150:0/2443640024 learned_addr learned my addr 172.21.15.150:0/2443640024 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ade00640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42aca00640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 -- 172.21.15.150:0/2443640024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 msgr2=0x5602d57d7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57d7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 -- 172.21.15.150:0/2443640024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 msgr2=0x5602d57ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ad400640 1 -- 172.21.15.150:0/2443640024 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d57f57c0 con 0x5602d57dd090 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.993+0000 7f42ade00640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57d7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.994+0000 7f42aca00640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.994+0000 7f42ad400640 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57e75e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f429c0a4b20 tx=0x7f429c09bc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e1d751647850c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.994+0000 7f4299c00640 1 -- 172.21.15.150:0/2443640024 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0a4e40 con 0x5602d57dd090 2024-09-15T22:13:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.994+0000 7f4299c00640 1 -- 172.21.15.150:0/2443640024 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f429c0bc210 con 0x5602d57dd090 2024-09-15T22:13:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.995+0000 7f4299c00640 1 -- 172.21.15.150:0/2443640024 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0cdb70 con 0x5602d57dd090 2024-09-15T22:13:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.995+0000 7f42b2df5740 1 -- 172.21.15.150:0/2443640024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 msgr2=0x5602d57e75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.995+0000 7f42b2df5740 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57e75e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f429c0a4b20 tx=0x7f429c09bc60 comp rx=0 tx=0).stop 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.995+0000 7f42b2df5740 1 -- 172.21.15.150:0/2443640024 shutdown_connections 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.995+0000 7f42b2df5740 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57d7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 --2- 172.21.15.150:0/2443640024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57e75e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 -- 172.21.15.150:0/2443640024 >> 172.21.15.150:0/2443640024 conn(0x5602d57d8700 msgr2=0x5602d57d7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 -- 172.21.15.150:0/2443640024 shutdown_connections 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 -- 172.21.15.150:0/2443640024 wait complete. 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 -- start start 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.996+0000 7f42b2df5740 1 Processor -- start 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ec280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f428800f9d0 con 0x5602d57dd9d0 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f428800f2d0 con 0x5602d57e2a60 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f428800c510 con 0x5602d57dd090 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42b2df5740 10 client.0 _ll_register_callbacks cb 0x7f429c0096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42ade00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42aca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ec280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42ade00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:47692/0 (socket says 172.21.15.150:47692) 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42ade00640 1 -- 172.21.15.150:0/851225507 learned_addr learned my addr 172.21.15.150:0/851225507 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.997+0000 7f42ad400640 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f42ade00640 1 -- 172.21.15.150:0/851225507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 msgr2=0x5602d57ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f42ade00640 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57ebd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f42ade00640 1 -- 172.21.15.150:0/851225507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 msgr2=0x5602d57ec280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:13:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f42ade00640 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ec280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f42ade00640 1 -- 172.21.15.150:0/851225507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d57d3d60 con 0x5602d57e2a60 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f42ade00640 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57ed220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009be0 tx=0x7f42a00092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7c8a5c82cf09b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.998+0000 7f428ea00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f428ea00640 1 -- 172.21.15.150:0/851225507 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0041040 con 0x5602d57e2a60 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429c0bc210 con 0x5602d57e2a60 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f428ea00640 1 -- 172.21.15.150:0/851225507 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f42a005c480 con 0x5602d57e2a60 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f428ea00640 1 -- 172.21.15.150:0/851225507 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f42a0036040 con 0x5602d57e2a60 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f42b2df5740 10 client.25301 fetch_fsmap learned FSMap version 30 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5602d57ee950 con 0x5602d57e2a60 2024-09-15T22:13:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f428ea00640 1 -- 172.21.15.150:0/851225507 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f429c0bc210 con 0x5602d57e2a60 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f428ea00640 1 -- 172.21.15.150:0/851225507 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f42a0046820 con 0x5602d57e2a60 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:47.999+0000 7f42b2df5740 10 client.25301 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42b2df5740 10 client.25301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42b2df5740 20 client.25301 populate_metadata read hostname 'smithi150' 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42b2df5740 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d5866540 0x5602d5868960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42b2df5740 4 client.25301 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602d5749b80 con 0x5602d5866540 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42ad400640 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d5866540 0x5602d5868960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f42ad400640 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d5866540 0x5602d5868960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa9054b229124d99 server_cookie=df99d439da147c9d in_seq=0 out_seq=0 2024-09-15T22:13:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.000+0000 7f428ea00640 10 client.25301 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.268+0000 7f428ea00640 1 -- 172.21.15.150:0/851225507 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602d5749b80 con 0x5602d5866540 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.268+0000 7f428ea00640 10 client.25301 handle_command_reply: tid=0 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.268+0000 7f42b2df5740 1 client.25301 shutdown 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 msgr2=0x5602d57ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57ed220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009be0 tx=0x7f42a00092f0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 shutdown_connections 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5602d5866540 0x5602d5868960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5602d57e2a60 0x5602d57ed220 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5602d57dd9d0 0x5602d57ec280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 --2- 172.21.15.150:0/851225507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5602d57dd090 0x5602d57ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f428ea00640 0 client.25301 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 >> 172.21.15.150:0/851225507 conn(0x5602d57d8700 msgr2=0x5602d57d95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 shutdown_connections 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 1 -- 172.21.15.150:0/851225507 wait complete. 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.269+0000 7f42b2df5740 20 client.25301 trim_cache size 0 max 16384 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:13:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:13:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:13:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f42900a3280 msgr2=0x7f42900a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f42900a3280 0x7f42900a5740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42a0003db0 tx=0x7f42a002a6d0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 msgr2=0x7f42a8199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8199fd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f429c00e9c0 tx=0x7f429c00ee80 comp rx=0 tx=0).stop 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 shutdown_connections 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f42900a3280 0x7f42900a5740 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42a8105910 0x7f42a81a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a8104f50 0x7f42a819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 --2- 172.21.15.150:0/3118675490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42a8103d60 0x7f42a8199fd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 >> 172.21.15.150:0/3118675490 conn(0x7f42a80ff4e0 msgr2=0x7f42a81081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 shutdown_connections 2024-09-15T22:13:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:13:48.270+0000 7f42afe00640 1 -- 172.21.15.150:0/3118675490 wait complete. 2024-09-15T22:13:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:50 smithi154 ceph-mon[34853]: pgmap v407: 97 pgs: 97 active+clean; 55 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 89 op/s 2024-09-15T22:13:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:50 smithi150 ceph-mon[30886]: pgmap v407: 97 pgs: 97 active+clean; 55 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 89 op/s 2024-09-15T22:13:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:50 smithi169 ceph-mon[35850]: pgmap v407: 97 pgs: 97 active+clean; 55 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 89 op/s 2024-09-15T22:13:51.650 INFO:tasks.workunit.client.0.smithi150.stdout: 36 509932 532 386685 674 188805 1183 2024-09-15T22:13:52.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:52 smithi154 ceph-mon[34853]: pgmap v408: 97 pgs: 97 active+clean; 62 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 119 op/s 2024-09-15T22:13:52.693 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:52 smithi150 ceph-mon[30886]: pgmap v408: 97 pgs: 97 active+clean; 62 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 119 op/s 2024-09-15T22:13:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:52 smithi169 ceph-mon[35850]: pgmap v408: 97 pgs: 97 active+clean; 62 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 119 op/s 2024-09-15T22:13:53.442 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:53 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:53.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:53 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:53.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:53 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:13:54.572 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:54 smithi150 ceph-mon[30886]: pgmap v409: 97 pgs: 97 active+clean; 62 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 112 op/s 2024-09-15T22:13:54.611 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:54 smithi169 ceph-mon[35850]: pgmap v409: 97 pgs: 97 active+clean; 62 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 112 op/s 2024-09-15T22:13:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:54 smithi154 ceph-mon[34853]: pgmap v409: 97 pgs: 97 active+clean; 62 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 112 op/s 2024-09-15T22:13:56.533 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:56 smithi150 ceph-mon[30886]: pgmap v410: 97 pgs: 97 active+clean; 79 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-09-15T22:13:56.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:56 smithi169 ceph-mon[35850]: pgmap v410: 97 pgs: 97 active+clean; 79 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-09-15T22:13:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:56 smithi154 ceph-mon[34853]: pgmap v410: 97 pgs: 97 active+clean; 79 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-09-15T22:13:57.362 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:13:57 smithi150 ceph-mon[30886]: pgmap v411: 97 pgs: 97 active+clean; 91 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 262 op/s 2024-09-15T22:13:57.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:13:57 smithi169 ceph-mon[35850]: pgmap v411: 97 pgs: 97 active+clean; 91 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 262 op/s 2024-09-15T22:13:57.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:13:57 smithi154 ceph-mon[34853]: pgmap v411: 97 pgs: 97 active+clean; 91 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 262 op/s 2024-09-15T22:14:00.436 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:00 smithi150 ceph-mon[30886]: pgmap v412: 97 pgs: 97 active+clean; 97 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2024-09-15T22:14:00.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:00 smithi154 ceph-mon[34853]: pgmap v412: 97 pgs: 97 active+clean; 97 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2024-09-15T22:14:00.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:00 smithi169 ceph-mon[35850]: pgmap v412: 97 pgs: 97 active+clean; 97 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 306 op/s 2024-09-15T22:14:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/1320091067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101580 msgr2=0x7fd6bc101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/1320091067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101580 0x7fd6bc101a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009900 tx=0x7fd6a802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/1320091067 shutdown_connections 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/1320091067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6bc101f40 0x7fd6bc109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/1320091067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101580 0x7fd6bc101a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/1320091067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc103050 0x7fd6bc103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/1320091067 >> 172.21.15.150:0/1320091067 conn(0x7fd6bc0fd0d0 msgr2=0x7fd6bc0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/1320091067 shutdown_connections 2024-09-15T22:14:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/1320091067 wait complete. 2024-09-15T22:14:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 Processor -- start 2024-09-15T22:14:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- start start 2024-09-15T22:14:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 0x7fd6bc19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101f40 0x7fd6bc19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6bc103050 0x7fd6bc1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc10d740 con 0x7fd6bc101f40 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc10d5c0 con 0x7fd6bc103050 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc10d8c0 con 0x7fd6bc101580 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 0x7fd6bc19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101f40 0x7fd6bc19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6bc103050 0x7fd6bc1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 0x7fd6bc19a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49120/0 (socket says 172.21.15.150:49120) 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 -- 172.21.15.150:0/2509768702 learned_addr learned my addr 172.21.15.150:0/2509768702 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:01.392 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 -- 172.21.15.150:0/2509768702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6bc103050 msgr2=0x7fd6bc1a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6bc103050 0x7fd6bc1a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 -- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101f40 msgr2=0x7fd6bc19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101f40 0x7fd6bc19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 -- 172.21.15.150:0/2509768702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc1a1c30 con 0x7fd6bc101580 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c1a00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 0x7fd6bc19a010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000e9c0 tx=0x7fd6b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6ba000640 1 -- 172.21.15.150:0/2509768702 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000cd80 con 0x7fd6bc101580 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6ba000640 1 -- 172.21.15.150:0/2509768702 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b00035f0 con 0x7fd6bc101580 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc1a1f20 con 0x7fd6bc101580 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6ba000640 1 -- 172.21.15.150:0/2509768702 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0010690 con 0x7fd6bc101580 2024-09-15T22:14:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.385+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc1a2330 con 0x7fd6bc101580 2024-09-15T22:14:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 Processor -- start 2024-09-15T22:14:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6ba000640 1 -- 172.21.15.150:0/2509768702 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fd6b00037a0 con 0x7fd6bc101580 2024-09-15T22:14:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- start start 2024-09-15T22:14:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 0x5559eea38660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38ba0 0x5559eea3d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5559ee99d100 con 0x5559eea3dc30 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559ee9451b0 con 0x5559eea38ba0 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5559ee9990c0 con 0x5559eea38260 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38ba0 0x5559eea3d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 0x5559eea38660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 0x5559eea38660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49124/0 (socket says 172.21.15.150:49124) 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 -- 172.21.15.150:0/2062186515 learned_addr learned my addr 172.21.15.150:0/2062186515 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 -- 172.21.15.150:0/2062186515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38ba0 msgr2=0x5559eea3d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38ba0 0x5559eea3d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 -- 172.21.15.150:0/2062186515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 msgr2=0x5559eea400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 -- 172.21.15.150:0/2062186515 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ee6b0210 con 0x5559eea38260 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 0x5559eea38660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009fd0 tx=0x7fd6b40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0506548bb26680 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6ba000640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6a40a3240 0x7fd6a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6aea00640 1 -- 172.21.15.150:0/2062186515 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4004d20 con 0x5559eea38260 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6aea00640 1 -- 172.21.15.150:0/2062186515 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b4004050 con 0x5559eea38260 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6aea00640 1 -- 172.21.15.150:0/2062186515 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4005260 con 0x5559eea38260 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6ba000640 1 -- 172.21.15.150:0/2509768702 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fd6b00cfcf0 con 0x7fd6bc101580 2024-09-15T22:14:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1a00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6a40a3240 0x7fd6a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/2062186515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 msgr2=0x5559eea38660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 0x5559eea38660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009fd0 tx=0x7fd6b40118d0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/2062186515 shutdown_connections 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1a00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6a40a3240 0x7fd6a40a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00cff90 tx=0x7fd6b00d3730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38ba0 0x5559eea3d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- 172.21.15.150:0/2062186515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38260 0x5559eea38660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/2062186515 >> 172.21.15.150:0/2062186515 conn(0x5559eea338d0 msgr2=0x5559eea33cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/2062186515 shutdown_connections 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/2062186515 wait complete. 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- start start 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 Processor -- start 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea38260 0x5559eea42380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea3dc30 0x5559eea49900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5559eea40c00 con 0x5559eea38260 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559ee926090 con 0x5559eea3dc30 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5559eea40d80 con 0x5559eea38ba0 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 10 client.0 _ll_register_callbacks cb 0x5559ee97af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea38260 0x5559eea42380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea38260 0x5559eea42380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59754/0 (socket says 172.21.15.150:59754) 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 -- 172.21.15.150:0/3873181046 learned_addr learned my addr 172.21.15.150:0/3873181046 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea3dc30 0x5559eea49900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 -- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea3dc30 msgr2=0x5559eea49900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea3dc30 0x5559eea49900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 -- 172.21.15.150:0/3873181046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea38260 msgr2=0x5559eea42380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea38260 0x5559eea42380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 -- 172.21.15.150:0/3873181046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ee77c620 con 0x5559eea38ba0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c2400640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea3dc30 0x5559eea49900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c1000640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea428c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6a802a910 tx=0x7fd6a80042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90af53b38a85efb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6a3400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6a3400640 1 -- 172.21.15.150:0/3873181046 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8035040 con 0x5559eea38ba0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6b4004050 con 0x5559eea38ba0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6a3400640 1 -- 172.21.15.150:0/3873181046 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fd6a8005450 con 0x5559eea38ba0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6a3400640 1 -- 172.21.15.150:0/3873181046 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd6a804b030 con 0x5559eea38ba0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 10 client.25282 fetch_fsmap learned FSMap version 31 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.392+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5559eea4c760 con 0x5559eea38ba0 2024-09-15T22:14:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6a3400640 1 -- 172.21.15.150:0/3873181046 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b4004050 con 0x5559eea38ba0 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6a3400640 1 -- 172.21.15.150:0/3873181046 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fd6a8031870 con 0x5559eea38ba0 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c727f740 10 client.25282 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c727f740 10 client.25282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c727f740 20 client.25282 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c727f740 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eea4dde0 0x5559eea50230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c727f740 4 client.25282 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559ee9aa830 con 0x5559eea4dde0 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c2400640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eea4dde0 0x5559eea50230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6c2400640 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eea4dde0 0x5559eea50230 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17fec821d00f9a18 server_cookie=65fc7873ac9f9cbe in_seq=0 out_seq=0 2024-09-15T22:14:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.397+0000 7fd6a3400640 10 client.25282 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6a3400640 1 -- 172.21.15.150:0/3873181046 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559ee9aa830 con 0x5559eea4dde0 2024-09-15T22:14:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6a3400640 10 client.25282 handle_command_reply: tid=0 2024-09-15T22:14:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 client.25282 shutdown 2024-09-15T22:14:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 msgr2=0x5559eea428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea428c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6a802a910 tx=0x7fd6a80042e0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 shutdown_connections 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eea4dde0 0x5559eea50230 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea3dc30 0x5559eea49900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea428c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6a3400640 0 client.25282 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 --2- 172.21.15.150:0/3873181046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea38260 0x5559eea42380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 >> 172.21.15.150:0/3873181046 conn(0x5559eea338d0 msgr2=0x5559eea350e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 shutdown_connections 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 1 -- 172.21.15.150:0/3873181046 wait complete. 2024-09-15T22:14:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.403+0000 7fd6c727f740 20 client.25282 trim_cache size 0 max 16384 2024-09-15T22:14:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 Processor -- start 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 -- start start 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea2e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea34cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1ab1a0 con 0x5559eea3dc30 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1acd70 con 0x5559eea38260 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c727f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1ab870 con 0x5559eea38ba0 2024-09-15T22:14:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c2400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea2e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49138/0 (socket says 172.21.15.150:49138) 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 -- 172.21.15.150:0/1822023877 learned_addr learned my addr 172.21.15.150:0/1822023877 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c2400640 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea34cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 -- 172.21.15.150:0/1822023877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 msgr2=0x5559eea2e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea2e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 -- 172.21.15.150:0/1822023877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 msgr2=0x5559eea34cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea34cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 -- 172.21.15.150:0/1822023877 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559eea336f0 con 0x5559eea38ba0 2024-09-15T22:14:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.415+0000 7fd6c1000640 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea498c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8031cc0 tx=0x7fd6a8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcdb7396e3987d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:01.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6ae000640 1 -- 172.21.15.150:0/1822023877 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8035070 con 0x5559eea38ba0 2024-09-15T22:14:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6ae000640 1 -- 172.21.15.150:0/1822023877 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a8040070 con 0x5559eea38ba0 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6ae000640 1 -- 172.21.15.150:0/1822023877 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8003910 con 0x5559eea38ba0 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/1822023877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 msgr2=0x5559eea498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea498c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8031cc0 tx=0x7fd6a8000bc0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/1822023877 shutdown_connections 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea34cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea498c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- 172.21.15.150:0/1822023877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea2e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/1822023877 >> 172.21.15.150:0/1822023877 conn(0x5559eea338d0 msgr2=0x5559eea32a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/1822023877 shutdown_connections 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/1822023877 wait complete. 2024-09-15T22:14:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- start start 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 Processor -- start 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea46b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea48060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1ac670 con 0x5559eea3dc30 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1abf40 con 0x5559eea38260 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1a9180 con 0x5559eea38ba0 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 10 client.0 _ll_register_callbacks cb 0x7fd6b0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49154/0 (socket says 172.21.15.150:49154) 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 -- 172.21.15.150:0/4272544760 learned_addr learned my addr 172.21.15.150:0/4272544760 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c2400640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea46b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c2400640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea48060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 -- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 msgr2=0x5559eea46b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea46b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 -- 172.21.15.150:0/4272544760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 msgr2=0x5559eea48060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea48060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 -- 172.21.15.150:0/4272544760 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559eea48670 con 0x5559eea38ba0 2024-09-15T22:14:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c2400640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea48060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c1000640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea470c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6a802a910 tx=0x7fd6a8005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14a987d13981cde8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 1 -- 172.21.15.150:0/4272544760 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8035070 con 0x5559eea38ba0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6a8040070 con 0x5559eea38ba0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 1 -- 172.21.15.150:0/4272544760 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fd6a8005740 con 0x5559eea38ba0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 1 -- 172.21.15.150:0/4272544760 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd6a8067050 con 0x5559eea38ba0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 10 client.25288 fetch_fsmap learned FSMap version 31 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5559eea49980 con 0x5559eea38ba0 2024-09-15T22:14:01.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 1 -- 172.21.15.150:0/4272544760 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a8040070 con 0x5559eea38ba0 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 1 -- 172.21.15.150:0/4272544760 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fd6a8060060 con 0x5559eea38ba0 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 10 client.25288 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 10 client.25288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 20 client.25288 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eeab90c0 0x5559eeabb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 4 client.25288 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559ee9a4b80 con 0x5559eeab90c0 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c2400640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eeab90c0 0x5559eeabb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6c2400640 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eeab90c0 0x5559eeabb4e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90ad32c2f30cd550 server_cookie=7d5b1707d91f8924 in_seq=0 out_seq=0 2024-09-15T22:14:01.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:01.420+0000 7fd6a3400640 10 client.25288 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:01.650 INFO:tasks.workunit.client.0.smithi150.stdout: 37 173810 104 129930 64 74720 212 2024-09-15T22:14:02.356 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:02 smithi150 ceph-mon[30886]: pgmap v413: 97 pgs: 97 active+clean; 135 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.5 MiB/s wr, 515 op/s 2024-09-15T22:14:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:02 smithi169 ceph-mon[35850]: pgmap v413: 97 pgs: 97 active+clean; 135 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.5 MiB/s wr, 515 op/s 2024-09-15T22:14:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:02 smithi154 ceph-mon[34853]: pgmap v413: 97 pgs: 97 active+clean; 135 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.5 MiB/s wr, 515 op/s 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6a3400640 1 -- 172.21.15.150:0/4272544760 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559ee9a4b80 con 0x5559eeab90c0 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6a3400640 10 client.25288 handle_command_reply: tid=0 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 client.25288 shutdown 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 msgr2=0x5559eea470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea470c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6a802a910 tx=0x7fd6a8005fd0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 shutdown_connections 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5559eeab90c0 0x5559eeabb4e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5559eea3dc30 0x5559eea48060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559eea38ba0 0x5559eea470c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 --2- 172.21.15.150:0/4272544760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559eea38260 0x5559eea46b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6a3400640 0 client.25288 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 >> 172.21.15.150:0/4272544760 conn(0x5559eea338d0 msgr2=0x5559eea32a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 shutdown_connections 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 1 -- 172.21.15.150:0/4272544760 wait complete. 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c727f740 20 client.25288 trim_cache size 0 max 16384 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:14:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:14:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:14:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:14:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6a40a3240 msgr2=0x7fd6a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6a40a3240 0x7fd6a40a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00cff90 tx=0x7fd6b00d3730 comp rx=0 tx=0).stop 2024-09-15T22:14:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 msgr2=0x7fd6bc19a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 0x7fd6bc19a010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000e9c0 tx=0x7fd6b000ee80 comp rx=0 tx=0).stop 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 shutdown_connections 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6bc103050 0x7fd6bc1a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd6a40a3240 0x7fd6a40a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6bc101f40 0x7fd6bc19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 --2- 172.21.15.150:0/2509768702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6bc101580 0x7fd6bc19a010 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 >> 172.21.15.150:0/2509768702 conn(0x7fd6bc0fd0d0 msgr2=0x7fd6bc108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 shutdown_connections 2024-09-15T22:14:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:02.773+0000 7fd6c2e00640 1 -- 172.21.15.150:0/2509768702 wait complete. 2024-09-15T22:14:04.537 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:04 smithi150 ceph-mon[30886]: pgmap v414: 97 pgs: 97 active+clean; 143 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.5 MiB/s wr, 528 op/s 2024-09-15T22:14:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:04 smithi169 ceph-mon[35850]: pgmap v414: 97 pgs: 97 active+clean; 143 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.5 MiB/s wr, 528 op/s 2024-09-15T22:14:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:04 smithi154 ceph-mon[34853]: pgmap v414: 97 pgs: 97 active+clean; 143 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.5 MiB/s wr, 528 op/s 2024-09-15T22:14:06.513 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:06 smithi150 ceph-mon[30886]: pgmap v415: 97 pgs: 97 active+clean; 169 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 718 op/s 2024-09-15T22:14:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:06 smithi169 ceph-mon[35850]: pgmap v415: 97 pgs: 97 active+clean; 169 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 718 op/s 2024-09-15T22:14:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:06 smithi154 ceph-mon[34853]: pgmap v415: 97 pgs: 97 active+clean; 169 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 718 op/s 2024-09-15T22:14:08.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:08 smithi150 ceph-mon[30886]: pgmap v416: 97 pgs: 97 active+clean; 167 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 644 op/s 2024-09-15T22:14:08.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:08 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:14:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:08 smithi169 ceph-mon[35850]: pgmap v416: 97 pgs: 97 active+clean; 167 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 644 op/s 2024-09-15T22:14:08.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:08 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:14:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:08 smithi154 ceph-mon[34853]: pgmap v416: 97 pgs: 97 active+clean; 167 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 644 op/s 2024-09-15T22:14:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:08 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:14:10.449 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:10 smithi150 ceph-mon[30886]: pgmap v417: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.5 MiB/s wr, 588 op/s 2024-09-15T22:14:10.450 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:14:10.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:10 smithi169 ceph-mon[35850]: pgmap v417: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.5 MiB/s wr, 588 op/s 2024-09-15T22:14:10.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:14:10.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:10 smithi154 ceph-mon[34853]: pgmap v417: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.5 MiB/s wr, 588 op/s 2024-09-15T22:14:10.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:14:11.650 INFO:tasks.workunit.client.0.smithi150.stdout: 37 685 2 522 3 379 7 2024-09-15T22:14:11.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:11.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:11.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:14:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:11.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:11.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:14:11.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:11.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:11.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:14:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:12 smithi150 ceph-mon[30886]: pgmap v418: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 7.0 MiB/s wr, 542 op/s 2024-09-15T22:14:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:12 smithi169 ceph-mon[35850]: pgmap v418: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 7.0 MiB/s wr, 542 op/s 2024-09-15T22:14:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:12 smithi154 ceph-mon[34853]: pgmap v418: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 7.0 MiB/s wr, 542 op/s 2024-09-15T22:14:13.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:13 smithi150 ceph-mon[30886]: pgmap v419: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 3.4 MiB/s wr, 298 op/s 2024-09-15T22:14:13.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:13 smithi169 ceph-mon[35850]: pgmap v419: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 3.4 MiB/s wr, 298 op/s 2024-09-15T22:14:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:13 smithi154 ceph-mon[34853]: pgmap v419: 97 pgs: 97 active+clean; 167 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 3.4 MiB/s wr, 298 op/s 2024-09-15T22:14:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 -- 172.21.15.150:0/2753544689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 msgr2=0x7fba6c1005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 --2- 172.21.15.150:0/2753544689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c1005b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009900 tx=0x7fba5c02a400 comp rx=0 tx=0).stop 2024-09-15T22:14:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 -- 172.21.15.150:0/2753544689 shutdown_connections 2024-09-15T22:14:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 --2- 172.21.15.150:0/2753544689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c101490 0x7fba6c101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 --2- 172.21.15.150:0/2753544689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba6c100af0 0x7fba6c100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 --2- 172.21.15.150:0/2753544689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c1005b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 -- 172.21.15.150:0/2753544689 >> 172.21.15.150:0/2753544689 conn(0x7fba6c0fbfa0 msgr2=0x7fba6c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 -- 172.21.15.150:0/2753544689 shutdown_connections 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.901+0000 7fba72000640 1 -- 172.21.15.150:0/2753544689 wait complete. 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.902+0000 7fba72000640 1 Processor -- start 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.902+0000 7fba72000640 1 -- start start 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba72000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba72000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c100af0 0x7fba6c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba72000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba6c101490 0x7fba6c1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba72000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c10f7e0 con 0x7fba6c101490 2024-09-15T22:14:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba72000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c10f660 con 0x7fba6c1001b0 2024-09-15T22:14:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba72000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c10f960 con 0x7fba6c100af0 2024-09-15T22:14:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38606/0 (socket says 172.21.15.150:38606) 2024-09-15T22:14:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 -- 172.21.15.150:0/1810336667 learned_addr learned my addr 172.21.15.150:0/1810336667 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba6be00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c100af0 0x7fba6c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba71600640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba6c101490 0x7fba6c1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 -- 172.21.15.150:0/1810336667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c100af0 msgr2=0x7fba6c19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c100af0 0x7fba6c19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 -- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba6c101490 msgr2=0x7fba6c1a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba6c101490 0x7fba6c1a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba70c00640 1 -- 172.21.15.150:0/1810336667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c1a1a60 con 0x7fba6c1001b0 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.903+0000 7fba6be00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c100af0 0x7fba6c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.904+0000 7fba70c00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c199e40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba5c031440 tx=0x7fba5c032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.904+0000 7fba69600640 1 -- 172.21.15.150:0/1810336667 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c03f030 con 0x7fba6c1001b0 2024-09-15T22:14:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.904+0000 7fba69600640 1 -- 172.21.15.150:0/1810336667 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba5c003ce0 con 0x7fba6c1001b0 2024-09-15T22:14:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.904+0000 7fba69600640 1 -- 172.21.15.150:0/1810336667 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c035070 con 0x7fba6c1001b0 2024-09-15T22:14:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.904+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c1a1cf0 con 0x7fba6c1001b0 2024-09-15T22:14:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.904+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c1a2190 con 0x7fba6c1001b0 2024-09-15T22:14:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.907+0000 7fba76658740 1 Processor -- start 2024-09-15T22:14:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 -- start start 2024-09-15T22:14:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba69600640 1 -- 172.21.15.150:0/1810336667 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fba5c042030 con 0x7fba6c1001b0 2024-09-15T22:14:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 0x557046619660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619ba0 0x55704661e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x5570466210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55704657e100 con 0x557046619ba0 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5570465261b0 con 0x557046619260 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba76658740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55704657a0c0 con 0x55704661ec30 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba71600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 0x557046619660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba6be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x5570466210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba71600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 0x557046619660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38622/0 (socket says 172.21.15.150:38622) 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba71600640 1 -- 172.21.15.150:0/259473618 learned_addr learned my addr 172.21.15.150:0/259473618 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.908+0000 7fba70c00640 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619ba0 0x55704661e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba71600640 1 -- 172.21.15.150:0/259473618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 msgr2=0x5570466210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba71600640 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x5570466210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba71600640 1 -- 172.21.15.150:0/259473618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619ba0 msgr2=0x55704661e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba71600640 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619ba0 0x55704661e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba71600640 1 -- 172.21.15.150:0/259473618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557046291210 con 0x557046619260 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba6be00640 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x5570466210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba71600640 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 0x557046619660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba64010370 tx=0x7fba64010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e1d9fb65d613e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba59c00640 1 -- 172.21.15.150:0/259473618 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64016070 con 0x557046619260 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba59c00640 1 -- 172.21.15.150:0/259473618 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba64004d20 con 0x557046619260 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba59c00640 1 -- 172.21.15.150:0/259473618 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64005480 con 0x557046619260 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba69600640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba540a32c0 0x7fba540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.909+0000 7fba69600640 1 -- 172.21.15.150:0/1810336667 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fba5c0eff30 con 0x7fba6c1001b0 2024-09-15T22:14:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba70c00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba540a32c0 0x7fba540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 -- 172.21.15.150:0/259473618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 msgr2=0x557046619660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 0x557046619660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba64010370 tx=0x7fba64010830 comp rx=0 tx=0).stop 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 -- 172.21.15.150:0/259473618 shutdown_connections 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x5570466210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619ba0 0x55704661e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 --2- 172.21.15.150:0/259473618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619260 0x557046619660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 -- 172.21.15.150:0/259473618 >> 172.21.15.150:0/259473618 conn(0x5570466148d0 msgr2=0x557046614cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba70c00640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba540a32c0 0x7fba540a5780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0bc1c0 tx=0x7fba5c0f3970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 -- 172.21.15.150:0/259473618 shutdown_connections 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.910+0000 7fba76658740 1 -- 172.21.15.150:0/259473618 wait complete. 2024-09-15T22:14:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 -- start start 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 Processor -- start 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x5570466234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 0x5570466239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x55704662aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557046621c00 con 0x557046619260 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557046507090 con 0x557046619ba0 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.911+0000 7fba76658740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557046621d80 con 0x55704661ec30 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba76658740 10 client.0 _ll_register_callbacks cb 0x55704655bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 0x5570466239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 0x5570466239e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38626/0 (socket says 172.21.15.150:38626) 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 -- 172.21.15.150:0/4095534323 learned_addr learned my addr 172.21.15.150:0/4095534323 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba71600640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x5570466234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba71600640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x55704662aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 -- 172.21.15.150:0/4095534323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 msgr2=0x55704662aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x55704662aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 -- 172.21.15.150:0/4095534323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 msgr2=0x5570466234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x5570466234a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 -- 172.21.15.150:0/4095534323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55704635d620 con 0x557046619ba0 2024-09-15T22:14:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba71600640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x55704662aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba6be00640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 0x5570466239e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba600126b0 tx=0x7fba60012b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f8779c17079a59d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba4e000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.912+0000 7fba4e000640 1 -- 172.21.15.150:0/4095534323 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60011c70 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba64004d20 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba4e000640 1 -- 172.21.15.150:0/4095534323 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fba60011e10 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba4e000640 1 -- 172.21.15.150:0/4095534323 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fba60004030 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 10 client.25331 fetch_fsmap learned FSMap version 32 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55704662d8e0 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba4e000640 1 -- 172.21.15.150:0/4095534323 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba64004d20 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba4e000640 1 -- 172.21.15.150:0/4095534323 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fba60025070 con 0x557046619ba0 2024-09-15T22:14:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 10 client.25331 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 10 client.25331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 20 client.25331 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55704662efb0 0x5570466313c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 4 client.25331 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.913+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55704658b830 con 0x55704662efb0 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.914+0000 7fba71600640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55704662efb0 0x5570466313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.914+0000 7fba71600640 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55704662efb0 0x5570466313c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0033a3987bd02db server_cookie=bceb48ab8235930c in_seq=0 out_seq=0 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.914+0000 7fba4e000640 10 client.25331 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba4e000640 1 -- 172.21.15.150:0/4095534323 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55704658b830 con 0x55704662efb0 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba4e000640 10 client.25331 handle_command_reply: tid=0 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 client.25331 shutdown 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 msgr2=0x5570466239e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 0x5570466239e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba600126b0 tx=0x7fba60012b70 comp rx=0 tx=0).stop 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 shutdown_connections 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55704662efb0 0x5570466313c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55704661ec30 0x55704662aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557046619ba0 0x5570466239e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba4e000640 0 client.25331 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 --2- 172.21.15.150:0/4095534323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x5570466234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 >> 172.21.15.150:0/4095534323 conn(0x5570466148d0 msgr2=0x5570466160e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 shutdown_connections 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 1 -- 172.21.15.150:0/4095534323 wait complete. 2024-09-15T22:14:15.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.915+0000 7fba76658740 20 client.25331 trim_cache size 0 max 16384 2024-09-15T22:14:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 Processor -- start 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 -- start start 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55704661e7c0 0x557046622180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 0x55704662a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557046619260 0x557046613900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1ab130 con 0x55704661e7c0 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1acd30 con 0x5570466148d0 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba76658740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1ab800 con 0x557046619260 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba6be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 0x55704662a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba6be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 0x55704662a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38628/0 (socket says 172.21.15.150:38628) 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba6be00640 1 -- 172.21.15.150:0/3058910760 learned_addr learned my addr 172.21.15.150:0/3058910760 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba71600640 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55704661e7c0 0x557046622180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.931+0000 7fba71600640 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557046619260 0x557046613900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba6be00640 1 -- 172.21.15.150:0/3058910760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557046619260 msgr2=0x557046613900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba6be00640 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557046619260 0x557046613900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba6be00640 1 -- 172.21.15.150:0/3058910760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55704661e7c0 msgr2=0x557046622180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba6be00640 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55704661e7c0 0x557046622180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba6be00640 1 -- 172.21.15.150:0/3058910760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55704661a080 con 0x5570466148d0 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba6be00640 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 0x55704662a9e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fba60009960 tx=0x7fba60011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4915118e68145041 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba59200640 1 -- 172.21.15.150:0/3058910760 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6001c7a0 con 0x5570466148d0 2024-09-15T22:14:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba59200640 1 -- 172.21.15.150:0/3058910760 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba60022070 con 0x5570466148d0 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.932+0000 7fba59200640 1 -- 172.21.15.150:0/3058910760 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba600035f0 con 0x5570466148d0 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 -- 172.21.15.150:0/3058910760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 msgr2=0x55704662a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 0x55704662a9e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fba60009960 tx=0x7fba60011810 comp rx=0 tx=0).stop 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 -- 172.21.15.150:0/3058910760 shutdown_connections 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557046619260 0x557046613900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570466148d0 0x55704662a9e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 --2- 172.21.15.150:0/3058910760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55704661e7c0 0x557046622180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 -- 172.21.15.150:0/3058910760 >> 172.21.15.150:0/3058910760 conn(0x55704660fa50 msgr2=0x5570466131f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 -- 172.21.15.150:0/3058910760 shutdown_connections 2024-09-15T22:14:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 -- 172.21.15.150:0/3058910760 wait complete. 2024-09-15T22:14:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.933+0000 7fba76658740 1 -- start start 2024-09-15T22:14:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 Processor -- start 2024-09-15T22:14:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570466148d0 0x557046628000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x557046628540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55704661e7c0 0x557046629550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1ac630 con 0x557046619260 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1abed0 con 0x55704661e7c0 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1a9110 con 0x5570466148d0 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba76658740 10 client.0 _ll_register_callbacks cb 0x7fba60009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba71600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570466148d0 0x557046628000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba6be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x557046628540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba71600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570466148d0 0x557046628000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:37490/0 (socket says 172.21.15.150:37490) 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba71600640 1 -- 172.21.15.150:0/1226821307 learned_addr learned my addr 172.21.15.150:0/1226821307 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.934+0000 7fba71600640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55704661e7c0 0x557046629550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba6be00640 1 -- 172.21.15.150:0/1226821307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570466148d0 msgr2=0x557046628000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba6be00640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570466148d0 0x557046628000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba6be00640 1 -- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55704661e7c0 msgr2=0x557046629550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba6be00640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55704661e7c0 0x557046629550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba6be00640 1 -- 172.21.15.150:0/1226821307 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557046629b60 con 0x557046619260 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba71600640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55704661e7c0 0x557046629550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba6be00640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x557046628540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5570466130e0 tx=0x7fba60009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ce4b9fec5615bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba4e000640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba4e000640 1 -- 172.21.15.150:0/1226821307 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6001c9b0 con 0x557046619260 2024-09-15T22:14:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba60022070 con 0x557046619260 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba4e000640 1 -- 172.21.15.150:0/1226821307 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fba60018040 con 0x557046619260 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.935+0000 7fba4e000640 1 -- 172.21.15.150:0/1226821307 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fba60042050 con 0x557046619260 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 10 client.15306 fetch_fsmap learned FSMap version 32 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557046699ca0 con 0x557046619260 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba4e000640 1 -- 172.21.15.150:0/1226821307 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba60022070 con 0x557046619260 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba4e000640 1 -- 172.21.15.150:0/1226821307 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fba60025070 con 0x557046619260 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 10 client.15306 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 10 client.15306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 20 client.15306 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557046619ba0 0x55704669c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 4 client.15306 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:14:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557046585b80 con 0x557046619ba0 2024-09-15T22:14:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.936+0000 7fba71600640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557046619ba0 0x55704669c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.937+0000 7fba71600640 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557046619ba0 0x55704669c480 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1900c8d2a11535 server_cookie=cae3d2653a8af4a in_seq=0 out_seq=0 2024-09-15T22:14:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:15.937+0000 7fba4e000640 10 client.15306 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba4e000640 1 -- 172.21.15.150:0/1226821307 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557046585b80 con 0x557046619ba0 2024-09-15T22:14:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba4e000640 10 client.15306 handle_command_reply: tid=0 2024-09-15T22:14:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 client.15306 shutdown 2024-09-15T22:14:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 msgr2=0x557046628540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x557046628540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5570466130e0 tx=0x7fba60009710 comp rx=0 tx=0).stop 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 shutdown_connections 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557046619ba0 0x55704669c480 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55704661e7c0 0x557046629550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557046619260 0x557046628540 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 --2- 172.21.15.150:0/1226821307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570466148d0 0x557046628000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba4e000640 0 client.15306 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 >> 172.21.15.150:0/1226821307 conn(0x55704660fa50 msgr2=0x5570466131f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 shutdown_connections 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 1 -- 172.21.15.150:0/1226821307 wait complete. 2024-09-15T22:14:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.078+0000 7fba76658740 20 client.15306 trim_cache size 0 max 16384 2024-09-15T22:14:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:14:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:14:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:14:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba540a32c0 msgr2=0x7fba540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba540a32c0 0x7fba540a5780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0bc1c0 tx=0x7fba5c0f3970 comp rx=0 tx=0).stop 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 msgr2=0x7fba6c199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c199e40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba5c031440 tx=0x7fba5c032ce0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 shutdown_connections 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba540a32c0 0x7fba540a5780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba6c101490 0x7fba6c1a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba6c100af0 0x7fba6c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 --2- 172.21.15.150:0/1810336667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba6c1001b0 0x7fba6c199e40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 >> 172.21.15.150:0/1810336667 conn(0x7fba6c0fbfa0 msgr2=0x7fba6c0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 shutdown_connections 2024-09-15T22:14:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:16.079+0000 7fba72000640 1 -- 172.21.15.150:0/1810336667 wait complete. 2024-09-15T22:14:16.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:16 smithi154 ceph-mon[34853]: pgmap v420: 97 pgs: 97 active+clean; 173 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-09-15T22:14:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:16 smithi150 ceph-mon[30886]: pgmap v420: 97 pgs: 97 active+clean; 173 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-09-15T22:14:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:16 smithi169 ceph-mon[35850]: pgmap v420: 97 pgs: 97 active+clean; 173 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-09-15T22:14:18.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:18 smithi150 ceph-mon[30886]: pgmap v421: 97 pgs: 97 active+clean; 173 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 618 KiB/s wr, 95 op/s 2024-09-15T22:14:18.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:18 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:14:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:18 smithi169 ceph-mon[35850]: pgmap v421: 97 pgs: 97 active+clean; 173 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 618 KiB/s wr, 95 op/s 2024-09-15T22:14:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:18 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:14:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:18 smithi154 ceph-mon[34853]: pgmap v421: 97 pgs: 97 active+clean; 173 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 618 KiB/s wr, 95 op/s 2024-09-15T22:14:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:18 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:14:20.680 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:20 smithi150 ceph-mon[30886]: pgmap v422: 97 pgs: 97 active+clean; 175 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 803 KiB/s wr, 108 op/s 2024-09-15T22:14:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:20 smithi169 ceph-mon[35850]: pgmap v422: 97 pgs: 97 active+clean; 175 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 803 KiB/s wr, 108 op/s 2024-09-15T22:14:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:20 smithi154 ceph-mon[34853]: pgmap v422: 97 pgs: 97 active+clean; 175 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 803 KiB/s wr, 108 op/s 2024-09-15T22:14:21.658 INFO:tasks.workunit.client.0.smithi150.stdout: 50 334143 641 260017 621 148798 576 2024-09-15T22:14:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:22 smithi150 ceph-mon[30886]: pgmap v423: 97 pgs: 97 active+clean; 179 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-09-15T22:14:22.712 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:22 smithi169 ceph-mon[35850]: pgmap v423: 97 pgs: 97 active+clean; 179 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-09-15T22:14:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:22 smithi154 ceph-mon[34853]: pgmap v423: 97 pgs: 97 active+clean; 179 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-09-15T22:14:24.650 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:24 smithi150 ceph-mon[30886]: pgmap v424: 97 pgs: 97 active+clean; 179 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-09-15T22:14:24.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:24 smithi169 ceph-mon[35850]: pgmap v424: 97 pgs: 97 active+clean; 179 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-09-15T22:14:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:24 smithi154 ceph-mon[34853]: pgmap v424: 97 pgs: 97 active+clean; 179 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-09-15T22:14:25.545 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:25 smithi150 ceph-mon[30886]: pgmap v425: 97 pgs: 97 active+clean; 185 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 287 op/s 2024-09-15T22:14:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:25 smithi169 ceph-mon[35850]: pgmap v425: 97 pgs: 97 active+clean; 185 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 287 op/s 2024-09-15T22:14:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:25 smithi154 ceph-mon[34853]: pgmap v425: 97 pgs: 97 active+clean; 185 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 287 op/s 2024-09-15T22:14:28.687 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:28 smithi150 ceph-mon[30886]: pgmap v426: 97 pgs: 97 active+clean; 192 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 312 op/s 2024-09-15T22:14:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:28 smithi169 ceph-mon[35850]: pgmap v426: 97 pgs: 97 active+clean; 192 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 312 op/s 2024-09-15T22:14:28.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:28 smithi154 ceph-mon[34853]: pgmap v426: 97 pgs: 97 active+clean; 192 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 312 op/s 2024-09-15T22:14:30.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:30 smithi150 ceph-mon[30886]: pgmap v427: 97 pgs: 97 active+clean; 201 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 355 op/s 2024-09-15T22:14:30.572 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:30 smithi154 ceph-mon[34853]: pgmap v427: 97 pgs: 97 active+clean; 201 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 355 op/s 2024-09-15T22:14:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:30 smithi169 ceph-mon[35850]: pgmap v427: 97 pgs: 97 active+clean; 201 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 355 op/s 2024-09-15T22:14:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.249+0000 7f3265600640 1 -- 172.21.15.150:0/3941856376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010de90 msgr2=0x7f3260110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.249+0000 7f3265600640 1 --2- 172.21.15.150:0/3941856376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010de90 0x7f3260110350 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3258009be0 tx=0x7f325802a710 comp rx=0 tx=0).stop 2024-09-15T22:14:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.250+0000 7f3265600640 1 -- 172.21.15.150:0/3941856376 shutdown_connections 2024-09-15T22:14:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.250+0000 7f3265600640 1 --2- 172.21.15.150:0/3941856376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010de90 0x7f3260110350 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.250+0000 7f3265600640 1 --2- 172.21.15.150:0/3941856376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f326010b4e0 0x7f326010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.250+0000 7f3265600640 1 --2- 172.21.15.150:0/3941856376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 0x7f3260073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.250+0000 7f3265600640 1 -- 172.21.15.150:0/3941856376 >> 172.21.15.150:0/3941856376 conn(0x7f326006eb50 msgr2=0x7f3260070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.259+0000 7f3265600640 1 -- 172.21.15.150:0/3941856376 shutdown_connections 2024-09-15T22:14:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.259+0000 7f3265600640 1 -- 172.21.15.150:0/3941856376 wait complete. 2024-09-15T22:14:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.260+0000 7f3265600640 1 Processor -- start 2024-09-15T22:14:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.260+0000 7f3265600640 1 -- start start 2024-09-15T22:14:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.261+0000 7f3265600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 0x7f32601a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.264+0000 7f3265600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 0x7f32601a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f325e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 0x7f32601a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f325e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 0x7f32601a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33398/0 (socket says 172.21.15.150:33398) 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f325ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 0x7f32601a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f325ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 0x7f32601a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49776/0 (socket says 172.21.15.150:49776) 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f325e000640 1 -- 172.21.15.150:0/2158625206 learned_addr learned my addr 172.21.15.150:0/2158625206 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f326010de90 0x7f32601ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f326011c480 con 0x7f326010b4e0 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f326011c300 con 0x7f3260072d80 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.265+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f326011c600 con 0x7f326010de90 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.266+0000 7f325e000640 1 -- 172.21.15.150:0/2158625206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f326010de90 msgr2=0x7f32601ae0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.266+0000 7f325e000640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f326010de90 0x7f32601ae0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.266+0000 7f325e000640 1 -- 172.21.15.150:0/2158625206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 msgr2=0x7f32601a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.266+0000 7f325e000640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 0x7f32601a6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.266+0000 7f325e000640 1 -- 172.21.15.150:0/2158625206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32601ae760 con 0x7f326010b4e0 2024-09-15T22:14:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.267+0000 7f325e000640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 0x7f32601a7080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f325000ea90 tx=0x7f325000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.268+0000 7f3257400640 1 -- 172.21.15.150:0/2158625206 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325000cc90 con 0x7f326010b4e0 2024-09-15T22:14:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.268+0000 7f3257400640 1 -- 172.21.15.150:0/2158625206 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f325000ce30 con 0x7f326010b4e0 2024-09-15T22:14:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.268+0000 7f3257400640 1 -- 172.21.15.150:0/2158625206 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32500324a0 con 0x7f326010b4e0 2024-09-15T22:14:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.274+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3260074480 con 0x7f326010b4e0 2024-09-15T22:14:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.274+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32600749d0 con 0x7f326010b4e0 2024-09-15T22:14:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.287+0000 7f3268644740 1 Processor -- start 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.295+0000 7f3268644740 1 -- start start 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.296+0000 7f3268644740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.296+0000 7f3268644740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77bb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.296+0000 7f325f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.296+0000 7f325f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49778/0 (socket says 172.21.15.150:49778) 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.296+0000 7f325f400640 1 -- 172.21.15.150:0/1407224626 learned_addr learned my addr 172.21.15.150:0/1407224626 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:31.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.296+0000 7f3268644740 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77bbc30 0x55ddd77be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ddd771b100 con 0x55ddd77b6ba0 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ddd76c31b0 con 0x55ddd77b6260 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ddd77170c0 con 0x55ddd77bbc30 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f325f400640 1 -- 172.21.15.150:0/1407224626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77bbc30 msgr2=0x55ddd77be0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f325f400640 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77bbc30 0x55ddd77be0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f325f400640 1 -- 172.21.15.150:0/1407224626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 msgr2=0x55ddd77bb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f325f400640 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f325f400640 1 -- 172.21.15.150:0/1407224626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd742e210 con 0x55ddd77b6260 2024-09-15T22:14:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.297+0000 7f325f400640 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77b6660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3258034040 tx=0x7f3258030b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708c4351cf002765 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.301+0000 7f324b400640 1 -- 172.21.15.150:0/1407224626 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258040020 con 0x55ddd77b6260 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.301+0000 7f324b400640 1 -- 172.21.15.150:0/1407224626 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3258030e80 con 0x55ddd77b6260 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.301+0000 7f324b400640 1 -- 172.21.15.150:0/1407224626 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258036040 con 0x55ddd77b6260 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.302+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 msgr2=0x55ddd77b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.302+0000 7f3268644740 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77b6660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3258034040 tx=0x7f3258030b60 comp rx=0 tx=0).stop 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.306+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 shutdown_connections 2024-09-15T22:14:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.306+0000 7f3268644740 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77bbc30 0x55ddd77be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.306+0000 7f3268644740 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77bb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.306+0000 7f3268644740 1 --2- 172.21.15.150:0/1407224626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77b6660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.306+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 >> 172.21.15.150:0/1407224626 conn(0x55ddd77b18d0 msgr2=0x55ddd77b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.308+0000 7f3257400640 1 -- 172.21.15.150:0/2158625206 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f32500046c0 con 0x7f326010b4e0 2024-09-15T22:14:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.310+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 shutdown_connections 2024-09-15T22:14:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.310+0000 7f3268644740 1 -- 172.21.15.150:0/1407224626 wait complete. 2024-09-15T22:14:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.310+0000 7f3268644740 1 -- start start 2024-09-15T22:14:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.311+0000 7f3268644740 1 Processor -- start 2024-09-15T22:14:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.315+0000 7f3268644740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.316+0000 7f325f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.316+0000 7f325f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77c05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49782/0 (socket says 172.21.15.150:49782) 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.316+0000 7f3268644740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77b6ba0 0x55ddd77c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.316+0000 7f325f400640 1 -- 172.21.15.150:0/744873102 learned_addr learned my addr 172.21.15.150:0/744873102 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.316+0000 7f325ea00640 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77b6ba0 0x55ddd77c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.316+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd77c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ddd77beba0 con 0x55ddd77c5b10 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ddd76a4090 con 0x55ddd77b6260 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ddd77bed20 con 0x55ddd77b6ba0 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f325ea00640 1 -- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 msgr2=0x55ddd77c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f325ea00640 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f325ea00640 1 -- 172.21.15.150:0/744873102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 msgr2=0x55ddd77c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f325ea00640 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd77c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.317+0000 7f325ea00640 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd74fa620 con 0x55ddd77b6ba0 2024-09-15T22:14:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.318+0000 7f325ea00640 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77b6ba0 0x55ddd77c0ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55ddd77b2750 tx=0x7f324c00e8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a91a75b9ebe6f06a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.318+0000 7f323fe00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:14:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.318+0000 7f323fe00640 1 -- 172.21.15.150:0/744873102 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c017070 con 0x55ddd77b6ba0 2024-09-15T22:14:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.318+0000 7f323fe00640 1 -- 172.21.15.150:0/744873102 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f324c013680 con 0x55ddd77b6ba0 2024-09-15T22:14:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.318+0000 7f3268644740 10 client.0 _ll_register_callbacks cb 0x55ddd76f8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.319+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3258030e80 con 0x55ddd77b6ba0 2024-09-15T22:14:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.319+0000 7f323fe00640 1 -- 172.21.15.150:0/744873102 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f324c021050 con 0x55ddd77b6ba0 2024-09-15T22:14:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.321+0000 7f3257400640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32440a3360 0x7f32440a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.321+0000 7f3257400640 1 -- 172.21.15.150:0/2158625206 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f32500f1d10 con 0x7f326010b4e0 2024-09-15T22:14:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.323+0000 7f3268644740 10 client.25312 fetch_fsmap learned FSMap version 33 2024-09-15T22:14:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.323+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55ddd77cac40 con 0x55ddd77b6ba0 2024-09-15T22:14:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.326+0000 7f325f400640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32440a3360 0x7f32440a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f323fe00640 1 -- 172.21.15.150:0/744873102 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f324c013880 con 0x55ddd77b6ba0 2024-09-15T22:14:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f325f400640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32440a3360 0x7f32440a5820 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f325802a750 tx=0x7f3258005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f3268644740 10 client.25312 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:14:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f3268644740 10 client.25312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f3268644740 20 client.25312 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd77cc270 0x55ddd77ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f3268644740 4 client.25312 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:14:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.327+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3258030e80 con 0x55ddd77cc270 2024-09-15T22:14:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.329+0000 7f325e000640 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd77cc270 0x55ddd77ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.337+0000 7f325e000640 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd77cc270 0x55ddd77ce700 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bff6a7bcb5465d server_cookie=556a6c29a61ddeb5 in_seq=0 out_seq=0 2024-09-15T22:14:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.339+0000 7f323fe00640 10 client.25312 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.339+0000 7f323fe00640 1 -- 172.21.15.150:0/744873102 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3258030e80 con 0x55ddd77cc270 2024-09-15T22:14:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.339+0000 7f323fe00640 10 client.25312 handle_command_reply: tid=0 2024-09-15T22:14:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.339+0000 7f3268644740 1 client.25312 shutdown 2024-09-15T22:14:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77b6ba0 msgr2=0x55ddd77c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77b6ba0 0x55ddd77c0ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55ddd77b2750 tx=0x7f324c00e8e0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 shutdown_connections 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd77cc270 0x55ddd77ce700 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd77c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77b6ba0 0x55ddd77c0ae0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 --2- 172.21.15.150:0/744873102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 >> 172.21.15.150:0/744873102 conn(0x55ddd77b18d0 msgr2=0x55ddd77b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.340+0000 7f323fe00640 0 client.25312 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.343+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 shutdown_connections 2024-09-15T22:14:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.343+0000 7f3268644740 1 -- 172.21.15.150:0/744873102 wait complete. 2024-09-15T22:14:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.345+0000 7f3268644740 20 client.25312 trim_cache size 0 max 16384 2024-09-15T22:14:31.505 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.495+0000 7f3268644740 1 Processor -- start 2024-09-15T22:14:31.511 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 -- start start 2024-09-15T22:14:31.511 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77bb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77c5b10 0x55ddd77b8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f326007d830 con 0x55ddd77b6ba0 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f326007f460 con 0x55ddd77b6260 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.508+0000 7f3268644740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f326007df00 con 0x55ddd77c5b10 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.509+0000 7f325e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.509+0000 7f325e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77b7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33418/0 (socket says 172.21.15.150:33418) 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.509+0000 7f325e000640 1 -- 172.21.15.150:0/4170169712 learned_addr learned my addr 172.21.15.150:0/4170169712 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.509+0000 7f325f400640 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77c5b10 0x55ddd77b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.509+0000 7f325ea00640 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.510+0000 7f325ea00640 1 -- 172.21.15.150:0/4170169712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77c5b10 msgr2=0x55ddd77b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.510+0000 7f325ea00640 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77c5b10 0x55ddd77b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.510+0000 7f325ea00640 1 -- 172.21.15.150:0/4170169712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 msgr2=0x55ddd77b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.510+0000 7f325ea00640 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77b7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.510+0000 7f325ea00640 1 -- 172.21.15.150:0/4170169712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd77c00e0 con 0x55ddd77b6260 2024-09-15T22:14:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.510+0000 7f325ea00640 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77bb540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f324c000ea0 tx=0x7f324c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=946aa073f6f02150 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.511+0000 7f324aa00640 1 -- 172.21.15.150:0/4170169712 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c017070 con 0x55ddd77b6260 2024-09-15T22:14:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.511+0000 7f324aa00640 1 -- 172.21.15.150:0/4170169712 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f324c004500 con 0x55ddd77b6260 2024-09-15T22:14:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.511+0000 7f324aa00640 1 -- 172.21.15.150:0/4170169712 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c003690 con 0x55ddd77b6260 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.512+0000 7f3268644740 1 -- 172.21.15.150:0/4170169712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 msgr2=0x55ddd77bb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.512+0000 7f3268644740 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77bb540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f324c000ea0 tx=0x7f324c013000 comp rx=0 tx=0).stop 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 -- 172.21.15.150:0/4170169712 shutdown_connections 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd77c5b10 0x55ddd77b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77b6ba0 0x55ddd77b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 --2- 172.21.15.150:0/4170169712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd77bb540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 -- 172.21.15.150:0/4170169712 >> 172.21.15.150:0/4170169712 conn(0x55ddd77b18d0 msgr2=0x55ddd77ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 -- 172.21.15.150:0/4170169712 shutdown_connections 2024-09-15T22:14:31.516 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.513+0000 7f3268644740 1 -- 172.21.15.150:0/4170169712 wait complete. 2024-09-15T22:14:31.516 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.514+0000 7f3268644740 1 -- start start 2024-09-15T22:14:31.516 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.514+0000 7f3268644740 1 Processor -- start 2024-09-15T22:14:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.517+0000 7f3268644740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd7833250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.517+0000 7f325ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd7833250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f325ea00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd7833250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49786/0 (socket says 172.21.15.150:49786) 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f325ea00640 1 -- 172.21.15.150:0/1715595372 learned_addr learned my addr 172.21.15.150:0/1715595372 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd7833790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd7833cd0 0x55ddd77ded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f326007ed60 con 0x55ddd77c5b10 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f326007e5d0 con 0x55ddd77b6260 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f326007b810 con 0x55ddd7833cd0 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f325e000640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd7833790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f325f400640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd7833cd0 0x55ddd77ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f325ea00640 1 -- 172.21.15.150:0/1715595372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd7833cd0 msgr2=0x55ddd77ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.518+0000 7f325ea00640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd7833cd0 0x55ddd77ded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f325ea00640 1 -- 172.21.15.150:0/1715595372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 msgr2=0x55ddd7833790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f325ea00640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd7833790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f325ea00640 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd77df2e0 con 0x55ddd77b6260 2024-09-15T22:14:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f3268644740 10 client.0 _ll_register_callbacks cb 0x7f324c009350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f324c004500 con 0x55ddd77b6260 2024-09-15T22:14:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f325e000640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd7833790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:14:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.519+0000 7f325ea00640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd7833250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f324c009a10 tx=0x7f324c004250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53f661dd597a5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.529+0000 7f323fe00640 10 client.25352 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:14:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.529+0000 7f323fe00640 1 -- 172.21.15.150:0/1715595372 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c017040 con 0x55ddd77b6260 2024-09-15T22:14:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.529+0000 7f323fe00640 1 -- 172.21.15.150:0/1715595372 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f324c003aa0 con 0x55ddd77b6260 2024-09-15T22:14:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.529+0000 7f323fe00640 1 -- 172.21.15.150:0/1715595372 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f324c003d20 con 0x55ddd77b6260 2024-09-15T22:14:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.532+0000 7f3268644740 10 client.25352 fetch_fsmap learned FSMap version 33 2024-09-15T22:14:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.532+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55ddd77e0410 con 0x55ddd77b6260 2024-09-15T22:14:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f323fe00640 1 -- 172.21.15.150:0/1715595372 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f324c02d070 con 0x55ddd77b6260 2024-09-15T22:14:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f3268644740 10 client.25352 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:14:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f3268644740 10 client.25352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f3268644740 20 client.25352 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd7847f30 0x55ddd784a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f3268644740 4 client.25352 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:14:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.534+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ddd7728830 con 0x55ddd7847f30 2024-09-15T22:14:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.541+0000 7f325e000640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd7847f30 0x55ddd784a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.541+0000 7f325e000640 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd7847f30 0x55ddd784a370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23da85da2fa9e717 server_cookie=6906942039b4e539 in_seq=0 out_seq=0 2024-09-15T22:14:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.545+0000 7f323fe00640 10 client.25352 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:31.662 INFO:tasks.workunit.client.0.smithi150.stdout: 73 366622 1363 267890 1267 110069 50 2024-09-15T22:14:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.872+0000 7f323fe00640 1 -- 172.21.15.150:0/1715595372 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ddd7728830 con 0x55ddd7847f30 2024-09-15T22:14:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.872+0000 7f323fe00640 10 client.25352 handle_command_reply: tid=0 2024-09-15T22:14:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.872+0000 7f3268644740 1 client.25352 shutdown 2024-09-15T22:14:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:14:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:14:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:14:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.888+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 msgr2=0x55ddd7833250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.888+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd7833250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f324c009a10 tx=0x7f324c004250 comp rx=0 tx=0).stop 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 shutdown_connections 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ddd7847f30 0x55ddd784a370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddd7833cd0 0x55ddd77ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ddd77c5b10 0x55ddd7833790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f3268644740 1 --2- 172.21.15.150:0/1715595372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ddd77b6260 0x55ddd7833250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 >> 172.21.15.150:0/1715595372 conn(0x55ddd77b18d0 msgr2=0x55ddd77b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.889+0000 7f323fe00640 0 client.25352 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.890+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 shutdown_connections 2024-09-15T22:14:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.890+0000 7f3268644740 1 -- 172.21.15.150:0/1715595372 wait complete. 2024-09-15T22:14:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.890+0000 7f3268644740 20 client.25352 trim_cache size 0 max 16384 2024-09-15T22:14:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.932+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32440a3360 msgr2=0x7f32440a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.932+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32440a3360 0x7f32440a5820 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f325802a750 tx=0x7f3258005bd0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.932+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 msgr2=0x7f32601a7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.932+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 0x7f32601a7080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f325000ea90 tx=0x7f325000ef50 comp rx=0 tx=0).stop 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.933+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 shutdown_connections 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.933+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f326010de90 0x7f32601ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.933+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f32440a3360 0x7f32440a5820 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.933+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f326010b4e0 0x7f32601a7080 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.933+0000 7f3265600640 1 --2- 172.21.15.150:0/2158625206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3260072d80 0x7f32601a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.933+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 >> 172.21.15.150:0/2158625206 conn(0x7f326006eb50 msgr2=0x7f326010c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.934+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 shutdown_connections 2024-09-15T22:14:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:31.934+0000 7f3265600640 1 -- 172.21.15.150:0/2158625206 wait complete. 2024-09-15T22:14:32.680 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:32 smithi150 ceph-mon[30886]: pgmap v428: 97 pgs: 97 active+clean; 218 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 402 op/s 2024-09-15T22:14:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:32 smithi169 ceph-mon[35850]: pgmap v428: 97 pgs: 97 active+clean; 218 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 402 op/s 2024-09-15T22:14:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:32 smithi154 ceph-mon[34853]: pgmap v428: 97 pgs: 97 active+clean; 218 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 402 op/s 2024-09-15T22:14:34.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:34 smithi150 ceph-mon[30886]: pgmap v429: 97 pgs: 97 active+clean; 226 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 343 op/s 2024-09-15T22:14:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:34 smithi169 ceph-mon[35850]: pgmap v429: 97 pgs: 97 active+clean; 226 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 343 op/s 2024-09-15T22:14:34.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:34 smithi154 ceph-mon[34853]: pgmap v429: 97 pgs: 97 active+clean; 226 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 343 op/s 2024-09-15T22:14:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:36 smithi150 ceph-mon[30886]: pgmap v430: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 545 op/s 2024-09-15T22:14:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:36 smithi169 ceph-mon[35850]: pgmap v430: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 545 op/s 2024-09-15T22:14:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:36 smithi154 ceph-mon[34853]: pgmap v430: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 545 op/s 2024-09-15T22:14:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:38 smithi150 ceph-mon[30886]: pgmap v431: 97 pgs: 97 active+clean; 266 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 503 op/s 2024-09-15T22:14:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:38 smithi169 ceph-mon[35850]: pgmap v431: 97 pgs: 97 active+clean; 266 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 503 op/s 2024-09-15T22:14:38.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:38 smithi154 ceph-mon[34853]: pgmap v431: 97 pgs: 97 active+clean; 266 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 503 op/s 2024-09-15T22:14:40.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:40 smithi150 ceph-mon[30886]: pgmap v432: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.7 MiB/s wr, 453 op/s 2024-09-15T22:14:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:40 smithi169 ceph-mon[35850]: pgmap v432: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.7 MiB/s wr, 453 op/s 2024-09-15T22:14:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:40 smithi154 ceph-mon[34853]: pgmap v432: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.7 MiB/s wr, 453 op/s 2024-09-15T22:14:41.662 INFO:tasks.workunit.client.0.smithi150.stdout: 99 563740 1367 420026 1357 125032 541 2024-09-15T22:14:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:42 smithi150 ceph-mon[30886]: pgmap v433: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-09-15T22:14:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:42 smithi169 ceph-mon[35850]: pgmap v433: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-09-15T22:14:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:42 smithi154 ceph-mon[34853]: pgmap v433: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-09-15T22:14:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:44 smithi169 ceph-mon[35850]: pgmap v434: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 320 op/s 2024-09-15T22:14:44.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:44 smithi150 ceph-mon[30886]: pgmap v434: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 320 op/s 2024-09-15T22:14:44.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:44 smithi154 ceph-mon[34853]: pgmap v434: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 320 op/s 2024-09-15T22:14:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.655+0000 7f7233e00640 1 -- 172.21.15.150:0/2348424013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109180 msgr2=0x7f7234109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.655+0000 7f7233e00640 1 --2- 172.21.15.150:0/2348424013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109180 0x7f7234109600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7224009930 tx=0x7f722402a460 comp rx=0 tx=0).stop 2024-09-15T22:14:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.661+0000 7f7233e00640 1 -- 172.21.15.150:0/2348424013 shutdown_connections 2024-09-15T22:14:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.661+0000 7f7233e00640 1 --2- 172.21.15.150:0/2348424013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109b40 0x7f72341103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.661+0000 7f7233e00640 1 --2- 172.21.15.150:0/2348424013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109180 0x7f7234109600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.661+0000 7f7233e00640 1 --2- 172.21.15.150:0/2348424013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 0x7f7234108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.661+0000 7f7233e00640 1 -- 172.21.15.150:0/2348424013 >> 172.21.15.150:0/2348424013 conn(0x7f7234077470 msgr2=0x7f72340798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.663+0000 7f7233e00640 1 -- 172.21.15.150:0/2348424013 shutdown_connections 2024-09-15T22:14:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.663+0000 7f7233e00640 1 -- 172.21.15.150:0/2348424013 wait complete. 2024-09-15T22:14:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.668+0000 7f7233e00640 1 Processor -- start 2024-09-15T22:14:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.670+0000 7f7233e00640 1 -- start start 2024-09-15T22:14:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.671+0000 7f7233e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 0x7f7234070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.671+0000 7f7233e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109180 0x7f7234071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.671+0000 7f7233e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109b40 0x7f723419d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.672+0000 7f7232a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 0x7f7234070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.673+0000 7f7232a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 0x7f7234070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:50596/0 (socket says 172.21.15.150:50596) 2024-09-15T22:14:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.673+0000 7f7232000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109180 0x7f7234071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.673+0000 7f7232000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109180 0x7f7234071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55420/0 (socket says 172.21.15.150:55420) 2024-09-15T22:14:45.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:45 smithi150 ceph-mon[30886]: pgmap v435: 97 pgs: 97 active+clean; 275 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 356 op/s 2024-09-15T22:14:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.677+0000 7f7233e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7234113c80 con 0x7f7234109180 2024-09-15T22:14:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.677+0000 7f7233e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7234113b00 con 0x7f7234108470 2024-09-15T22:14:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.677+0000 7f7233e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7234113e00 con 0x7f7234109b40 2024-09-15T22:14:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.677+0000 7f7232a00640 1 -- 172.21.15.150:0/2085199358 learned_addr learned my addr 172.21.15.150:0/2085199358 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.677+0000 7f7233400640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109b40 0x7f723419d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.678+0000 7f7233400640 1 -- 172.21.15.150:0/2085199358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 msgr2=0x7f7234070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.678+0000 7f7233400640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 0x7f7234070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.678+0000 7f7233400640 1 -- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109180 msgr2=0x7f7234071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.678+0000 7f7233400640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109180 0x7f7234071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.678+0000 7f7233400640 1 -- 172.21.15.150:0/2085199358 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723419d880 con 0x7f7234109b40 2024-09-15T22:14:45.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.680+0000 7f7233400640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109b40 0x7f723419d340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f722000d6b0 tx=0x7f722000db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.684+0000 7f722b400640 1 -- 172.21.15.150:0/2085199358 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220017070 con 0x7f7234109b40 2024-09-15T22:14:45.685 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.684+0000 7f722b400640 1 -- 172.21.15.150:0/2085199358 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7220009d00 con 0x7f7234109b40 2024-09-15T22:14:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.684+0000 7f722b400640 1 -- 172.21.15.150:0/2085199358 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220003d60 con 0x7f7234109b40 2024-09-15T22:14:45.697 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.694+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723419db70 con 0x7f7234109b40 2024-09-15T22:14:45.697 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.694+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723419e040 con 0x7f7234109b40 2024-09-15T22:14:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:45 smithi169 ceph-mon[35850]: pgmap v435: 97 pgs: 97 active+clean; 275 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 356 op/s 2024-09-15T22:14:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.728+0000 7f722b400640 1 -- 172.21.15.150:0/2085199358 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f7220009820 con 0x7f7234109b40 2024-09-15T22:14:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.732+0000 7f722b400640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f72180a3450 0x7f72180a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.732+0000 7f722b400640 1 -- 172.21.15.150:0/2085199358 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f72200cf1a0 con 0x7f7234109b40 2024-09-15T22:14:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.736+0000 7f723c878740 1 Processor -- start 2024-09-15T22:14:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.742+0000 7f7232a00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f72180a3450 0x7f72180a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.745+0000 7f723c878740 1 -- start start 2024-09-15T22:14:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.745+0000 7f723c878740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db48660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.745+0000 7f723c878740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db48ba0 0x56068db4d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.745+0000 7f723c878740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db4dc30 0x56068db500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.747+0000 7f7232000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db48ba0 0x56068db4d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.748+0000 7f7232000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db48ba0 0x56068db4d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60258/0 (socket says 172.21.15.150:60258) 2024-09-15T22:14:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.752+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56068daad100 con 0x56068db4dc30 2024-09-15T22:14:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.752+0000 7f7232000640 1 -- 172.21.15.150:0/2488222016 learned_addr learned my addr 172.21.15.150:0/2488222016 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.752+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56068da551b0 con 0x56068db48260 2024-09-15T22:14:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.752+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56068daa90c0 con 0x56068db48ba0 2024-09-15T22:14:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.752+0000 7f7233400640 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db4dc30 0x56068db500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.756+0000 7f7233400640 1 -- 172.21.15.150:0/2488222016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db48ba0 msgr2=0x56068db4d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.758+0000 7f7232a00640 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db48660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.758+0000 7f7233400640 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db48ba0 0x56068db4d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.759+0000 7f7233400640 1 -- 172.21.15.150:0/2488222016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 msgr2=0x56068db48660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.760+0000 7f7233400640 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db48660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.760+0000 7f7233400640 1 -- 172.21.15.150:0/2488222016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56068d7c0210 con 0x56068db4dc30 2024-09-15T22:14:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.760+0000 7f7232a00640 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db48660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.761+0000 7f7232a00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f72180a3450 0x7f72180a5910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7234072030 tx=0x7f722c00f8a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.763+0000 7f7233400640 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db4dc30 0x56068db500f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f72200ccc10 tx=0x7f722009b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a02dc26bb86dab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:45 smithi154 ceph-mon[34853]: pgmap v435: 97 pgs: 97 active+clean; 275 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 356 op/s 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.771+0000 7f721fe00640 1 -- 172.21.15.150:0/2488222016 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722009beb0 con 0x56068db4dc30 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.771+0000 7f721fe00640 1 -- 172.21.15.150:0/2488222016 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722009b7b0 con 0x56068db4dc30 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.771+0000 7f721fe00640 1 -- 172.21.15.150:0/2488222016 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220097e20 con 0x56068db4dc30 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.772+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db4dc30 msgr2=0x56068db500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.772+0000 7f723c878740 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db4dc30 0x56068db500f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f72200ccc10 tx=0x7f722009b6a0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.773+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 shutdown_connections 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.773+0000 7f723c878740 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db4dc30 0x56068db500f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.774+0000 7f723c878740 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db48ba0 0x56068db4d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.774+0000 7f723c878740 1 --2- 172.21.15.150:0/2488222016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db48660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.774+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 >> 172.21.15.150:0/2488222016 conn(0x56068db438d0 msgr2=0x56068db43cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.774+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 shutdown_connections 2024-09-15T22:14:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.774+0000 7f723c878740 1 -- 172.21.15.150:0/2488222016 wait complete. 2024-09-15T22:14:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.775+0000 7f723c878740 1 -- start start 2024-09-15T22:14:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.775+0000 7f723c878740 1 Processor -- start 2024-09-15T22:14:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.779+0000 7f723c878740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db52520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.779+0000 7f723c878740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db52a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.780+0000 7f7232a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db52520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.780+0000 7f7232a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db52520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55440/0 (socket says 172.21.15.150:55440) 2024-09-15T22:14:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.780+0000 7f7232000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db52a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.780+0000 7f7232000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db52a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:50610/0 (socket says 172.21.15.150:50610) 2024-09-15T22:14:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.780+0000 7f7232000640 1 -- 172.21.15.150:0/3824231541 learned_addr learned my addr 172.21.15.150:0/3824231541 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.781+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db59aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.782+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56068db50ba0 con 0x56068db48260 2024-09-15T22:14:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.782+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56068da36090 con 0x56068db48ba0 2024-09-15T22:14:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.782+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56068db50d20 con 0x56068db4dc30 2024-09-15T22:14:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.782+0000 7f723c878740 10 client.0 _ll_register_callbacks cb 0x56068da8af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.782+0000 7f7233400640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db59aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.783+0000 7f7233400640 1 -- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 msgr2=0x56068db52a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.783+0000 7f7233400640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db52a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.783+0000 7f7233400640 1 -- 172.21.15.150:0/3824231541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 msgr2=0x56068db52520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.783+0000 7f7233400640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db52520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.783+0000 7f7233400640 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56068d88c620 con 0x56068db4dc30 2024-09-15T22:14:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.783+0000 7f7233400640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db59aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7220009cd0 tx=0x7f722009fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995e64f6a2f5fd43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.784+0000 7f721cc00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:14:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.787+0000 7f721cc00640 1 -- 172.21.15.150:0/3824231541 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220009b10 con 0x56068db4dc30 2024-09-15T22:14:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.787+0000 7f721cc00640 1 -- 172.21.15.150:0/3824231541 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f722009ac00 con 0x56068db4dc30 2024-09-15T22:14:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.787+0000 7f7232000640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db52a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.787+0000 7f7232a00640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db52520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.787+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f722009b7b0 con 0x56068db4dc30 2024-09-15T22:14:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.788+0000 7f721cc00640 1 -- 172.21.15.150:0/3824231541 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f722009beb0 con 0x56068db4dc30 2024-09-15T22:14:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 10 client.25330 fetch_fsmap learned FSMap version 33 2024-09-15T22:14:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56068db50ba0 con 0x56068db4dc30 2024-09-15T22:14:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f721cc00640 1 -- 172.21.15.150:0/3824231541 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722009ae00 con 0x56068db4dc30 2024-09-15T22:14:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f721cc00640 1 -- 172.21.15.150:0/3824231541 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f722009a780 con 0x56068db4dc30 2024-09-15T22:14:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 10 client.25330 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:14:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 10 client.25330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 20 client.25330 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068db5e0a0 0x56068db604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 4 client.25330 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:14:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.790+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f722009b7b0 con 0x56068db5e0a0 2024-09-15T22:14:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.791+0000 7f7232a00640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068db5e0a0 0x56068db604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.795+0000 7f7232a00640 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068db5e0a0 0x56068db604c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8454c2dda049e7 server_cookie=d61fe38cb6ac59e3 in_seq=0 out_seq=0 2024-09-15T22:14:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.795+0000 7f721cc00640 10 client.25330 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.796+0000 7f721cc00640 1 -- 172.21.15.150:0/3824231541 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f722009b7b0 con 0x56068db5e0a0 2024-09-15T22:14:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.796+0000 7f721cc00640 10 client.25330 handle_command_reply: tid=0 2024-09-15T22:14:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.796+0000 7f723c878740 1 client.25330 shutdown 2024-09-15T22:14:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.796+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 msgr2=0x56068db59aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.796+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db59aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7220009cd0 tx=0x7f722009fbd0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 shutdown_connections 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068db5e0a0 0x56068db604c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db59aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db52a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 --2- 172.21.15.150:0/3824231541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db52520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 >> 172.21.15.150:0/3824231541 conn(0x56068db438d0 msgr2=0x56068db450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f721cc00640 0 client.25330 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 shutdown_connections 2024-09-15T22:14:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.797+0000 7f723c878740 1 -- 172.21.15.150:0/3824231541 wait complete. 2024-09-15T22:14:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.798+0000 7f723c878740 20 client.25330 trim_cache size 0 max 16384 2024-09-15T22:14:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.934+0000 7f723c878740 1 Processor -- start 2024-09-15T22:14:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 -- start start 2024-09-15T22:14:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db46cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48ba0 0x56068db59a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db47210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f72341a6e70 con 0x56068db48ba0 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72341a8aa0 con 0x56068db48260 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.937+0000 7f723c878740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72341a7540 con 0x56068db4dc30 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.938+0000 7f7233400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db47210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.938+0000 7f7233400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db47210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60272/0 (socket says 172.21.15.150:60272) 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.938+0000 7f7233400640 1 -- 172.21.15.150:0/4144312531 learned_addr learned my addr 172.21.15.150:0/4144312531 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.938+0000 7f7232a00640 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db46cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.939+0000 7f7233400640 1 -- 172.21.15.150:0/4144312531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 msgr2=0x56068db46cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.939+0000 7f7233400640 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db46cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.939+0000 7f7233400640 1 -- 172.21.15.150:0/4144312531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48ba0 msgr2=0x56068db59a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.939+0000 7f7233400640 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48ba0 0x56068db59a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.939+0000 7f7233400640 1 -- 172.21.15.150:0/4144312531 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56068db60830 con 0x56068db4dc30 2024-09-15T22:14:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.946+0000 7f7233400640 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db47210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7220005fd0 tx=0x7f72200a10a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1930115b60c73270 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.950+0000 7f721f400640 1 -- 172.21.15.150:0/4144312531 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220009b10 con 0x56068db4dc30 2024-09-15T22:14:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.950+0000 7f721f400640 1 -- 172.21.15.150:0/4144312531 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7220099ab0 con 0x56068db4dc30 2024-09-15T22:14:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.950+0000 7f721f400640 1 -- 172.21.15.150:0/4144312531 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722009a670 con 0x56068db4dc30 2024-09-15T22:14:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.951+0000 7f723c878740 1 -- 172.21.15.150:0/4144312531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 msgr2=0x56068db47210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.951+0000 7f723c878740 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db47210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7220005fd0 tx=0x7f72200a10a0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.956+0000 7f723c878740 1 -- 172.21.15.150:0/4144312531 shutdown_connections 2024-09-15T22:14:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.956+0000 7f723c878740 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db47210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.956+0000 7f723c878740 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48ba0 0x56068db59a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.956+0000 7f723c878740 1 --2- 172.21.15.150:0/4144312531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48260 0x56068db46cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.956+0000 7f723c878740 1 -- 172.21.15.150:0/4144312531 >> 172.21.15.150:0/4144312531 conn(0x56068db438d0 msgr2=0x56068db42a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.968+0000 7f723c878740 1 -- 172.21.15.150:0/4144312531 shutdown_connections 2024-09-15T22:14:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.969+0000 7f723c878740 1 -- 172.21.15.150:0/4144312531 wait complete. 2024-09-15T22:14:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.971+0000 7f723c878740 1 -- start start 2024-09-15T22:14:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.975+0000 7f723c878740 1 Processor -- start 2024-09-15T22:14:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.980+0000 7f723c878740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db56af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.981+0000 7f7232a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db56af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.981+0000 7f7232a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db56af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55464/0 (socket says 172.21.15.150:55464) 2024-09-15T22:14:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.982+0000 7f7232a00640 1 -- 172.21.15.150:0/2520036585 learned_addr learned my addr 172.21.15.150:0/2520036585 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:14:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.982+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db57030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.983+0000 7f7232000640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db57030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.983+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db57ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f72341a83a0 con 0x56068db48260 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72341a7c10 con 0x56068db48ba0 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72341a4e50 con 0x56068db4dc30 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f7233400640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db57ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f7233400640 1 -- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 msgr2=0x56068db57030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f7233400640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db57030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f7233400640 1 -- 172.21.15.150:0/2520036585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 msgr2=0x56068db56af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f7233400640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db56af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.985+0000 7f7233400640 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56068db58600 con 0x56068db4dc30 2024-09-15T22:14:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.986+0000 7f723c878740 10 client.0 _ll_register_callbacks cb 0x7f722009b580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.987+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7220099ab0 con 0x56068db4dc30 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.987+0000 7f7232a00640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db56af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.987+0000 7f7232000640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db57030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.987+0000 7f7233400640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db57ff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7220099a60 tx=0x7f722009ae10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb2d2e1019ddf05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.987+0000 7f721cc00640 10 client.25336 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.988+0000 7f721cc00640 1 -- 172.21.15.150:0/2520036585 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220009b10 con 0x56068db4dc30 2024-09-15T22:14:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.988+0000 7f721cc00640 1 -- 172.21.15.150:0/2520036585 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f722009a880 con 0x56068db4dc30 2024-09-15T22:14:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:45.989+0000 7f721cc00640 1 -- 172.21.15.150:0/2520036585 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f722009fb60 con 0x56068db4dc30 2024-09-15T22:14:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.002+0000 7f723c878740 10 client.25336 fetch_fsmap learned FSMap version 33 2024-09-15T22:14:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.002+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=33}) -- 0x56068db58600 con 0x56068db4dc30 2024-09-15T22:14:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.004+0000 7f721cc00640 1 -- 172.21.15.150:0/2520036585 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f722009f5f0 con 0x56068db4dc30 2024-09-15T22:14:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.004+0000 7f723c878740 10 client.25336 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:14:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.004+0000 7f723c878740 10 client.25336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:14:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.004+0000 7f723c878740 20 client.25336 populate_metadata read hostname 'smithi150' 2024-09-15T22:14:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.004+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068dbc8d40 0x56068dbcb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.004+0000 7f7232a00640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068dbc8d40 0x56068dbcb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.005+0000 7f723c878740 4 client.25336 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:14:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.005+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56068daba830 con 0x56068dbc8d40 2024-09-15T22:14:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.005+0000 7f7232a00640 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068dbc8d40 0x56068dbcb130 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e7dac087f61023 server_cookie=3d172c2c844e4c53 in_seq=0 out_seq=0 2024-09-15T22:14:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:46.005+0000 7f721cc00640 10 client.25336 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:48 smithi150 ceph-mon[30886]: pgmap v436: 97 pgs: 97 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-15T22:14:48.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:48 smithi169 ceph-mon[35850]: pgmap v436: 97 pgs: 97 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-15T22:14:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:48 smithi154 ceph-mon[34853]: pgmap v436: 97 pgs: 97 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-15T22:14:50.689 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:50 smithi150 ceph-mon[30886]: pgmap v437: 97 pgs: 97 active+clean; 296 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 223 op/s 2024-09-15T22:14:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:50 smithi169 ceph-mon[35850]: pgmap v437: 97 pgs: 97 active+clean; 296 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 223 op/s 2024-09-15T22:14:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:50 smithi154 ceph-mon[34853]: pgmap v437: 97 pgs: 97 active+clean; 296 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 223 op/s 2024-09-15T22:14:51.662 INFO:tasks.workunit.client.0.smithi150.stdout: 118 495550 805 369477 991 99749 35 2024-09-15T22:14:52.305 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:52 smithi150 ceph-mon[30886]: pgmap v438: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 319 op/s 2024-09-15T22:14:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:52 smithi169 ceph-mon[35850]: pgmap v438: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 319 op/s 2024-09-15T22:14:52.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:52 smithi154 ceph-mon[34853]: pgmap v438: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 319 op/s 2024-09-15T22:14:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.528+0000 7f721cc00640 1 -- 172.21.15.150:0/2520036585 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56068daba830 con 0x56068dbc8d40 2024-09-15T22:14:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.528+0000 7f721cc00640 10 client.25336 handle_command_reply: tid=0 2024-09-15T22:14:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.528+0000 7f723c878740 1 client.25336 shutdown 2024-09-15T22:14:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 msgr2=0x56068db57ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db57ff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7220099a60 tx=0x7f722009ae10 comp rx=0 tx=0).stop 2024-09-15T22:14:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 shutdown_connections 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56068dbc8d40 0x56068dbcb130 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56068db4dc30 0x56068db57ff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56068db48ba0 0x56068db57030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 --2- 172.21.15.150:0/2520036585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56068db48260 0x56068db56af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f721cc00640 0 client.25336 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 >> 172.21.15.150:0/2520036585 conn(0x56068db438d0 msgr2=0x56068db45cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 shutdown_connections 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 1 -- 172.21.15.150:0/2520036585 wait complete. 2024-09-15T22:14:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.529+0000 7f723c878740 20 client.25336 trim_cache size 0 max 16384 2024-09-15T22:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f72180a3450 msgr2=0x7f72180a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f72180a3450 0x7f72180a5910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7234072030 tx=0x7f722c00f8a0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109b40 msgr2=0x7f723419d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109b40 0x7f723419d340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f722000d6b0 tx=0x7f722000db70 comp rx=0 tx=0).stop 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 shutdown_connections 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7234109b40 0x7f723419d340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f72180a3450 0x7f72180a5910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7234109180 0x7f7234071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 --2- 172.21.15.150:0/2085199358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7234108470 0x7f7234070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 >> 172.21.15.150:0/2085199358 conn(0x7f7234077470 msgr2=0x7f723410c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 shutdown_connections 2024-09-15T22:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:14:54.530+0000 7f7233e00640 1 -- 172.21.15.150:0/2085199358 wait complete. 2024-09-15T22:14:54.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:54 smithi150 ceph-mon[30886]: pgmap v439: 97 pgs: 97 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 340 op/s 2024-09-15T22:14:54.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:54 smithi169 ceph-mon[35850]: pgmap v439: 97 pgs: 97 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 340 op/s 2024-09-15T22:14:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:54 smithi154 ceph-mon[34853]: pgmap v439: 97 pgs: 97 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 340 op/s 2024-09-15T22:14:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:56 smithi150 ceph-mon[30886]: pgmap v440: 97 pgs: 97 active+clean; 406 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 617 op/s 2024-09-15T22:14:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:56 smithi169 ceph-mon[35850]: pgmap v440: 97 pgs: 97 active+clean; 406 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 617 op/s 2024-09-15T22:14:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:56 smithi154 ceph-mon[34853]: pgmap v440: 97 pgs: 97 active+clean; 406 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 617 op/s 2024-09-15T22:14:58.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:58 smithi150 ceph-mon[30886]: pgmap v441: 97 pgs: 97 active+clean; 440 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 673 op/s 2024-09-15T22:14:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:58 smithi169 ceph-mon[35850]: pgmap v441: 97 pgs: 97 active+clean; 440 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 673 op/s 2024-09-15T22:14:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:58 smithi154 ceph-mon[34853]: pgmap v441: 97 pgs: 97 active+clean; 440 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 673 op/s 2024-09-15T22:14:59.693 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:14:59 smithi150 ceph-mon[30886]: pgmap v442: 97 pgs: 97 active+clean; 444 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-15T22:14:59.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:14:59 smithi169 ceph-mon[35850]: pgmap v442: 97 pgs: 97 active+clean; 444 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-15T22:14:59.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:14:59 smithi154 ceph-mon[34853]: pgmap v442: 97 pgs: 97 active+clean; 444 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-15T22:15:01.662 INFO:tasks.workunit.client.0.smithi150.stdout: 147 433121 1472 315762 1239 83172 499 2024-09-15T22:15:02.623 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:02 smithi150 ceph-mon[30886]: pgmap v443: 97 pgs: 97 active+clean; 447 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 608 op/s 2024-09-15T22:15:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:02 smithi169 ceph-mon[35850]: pgmap v443: 97 pgs: 97 active+clean; 447 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 608 op/s 2024-09-15T22:15:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:02 smithi154 ceph-mon[34853]: pgmap v443: 97 pgs: 97 active+clean; 447 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 14 MiB/s wr, 608 op/s 2024-09-15T22:15:04.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:04 smithi150 ceph-mon[30886]: pgmap v444: 97 pgs: 97 active+clean; 447 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 506 op/s 2024-09-15T22:15:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:04 smithi169 ceph-mon[35850]: pgmap v444: 97 pgs: 97 active+clean; 447 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 506 op/s 2024-09-15T22:15:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:04 smithi154 ceph-mon[34853]: pgmap v444: 97 pgs: 97 active+clean; 447 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 506 op/s 2024-09-15T22:15:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:06 smithi150 ceph-mon[30886]: pgmap v445: 97 pgs: 97 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 517 op/s 2024-09-15T22:15:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:06 smithi169 ceph-mon[35850]: pgmap v445: 97 pgs: 97 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 517 op/s 2024-09-15T22:15:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:06 smithi154 ceph-mon[34853]: pgmap v445: 97 pgs: 97 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 517 op/s 2024-09-15T22:15:08.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:08 smithi150 ceph-mon[30886]: pgmap v446: 97 pgs: 97 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 243 op/s 2024-09-15T22:15:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:08 smithi169 ceph-mon[35850]: pgmap v446: 97 pgs: 97 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 243 op/s 2024-09-15T22:15:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:08 smithi154 ceph-mon[34853]: pgmap v446: 97 pgs: 97 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 243 op/s 2024-09-15T22:15:10.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.118+0000 7f4db7600640 1 -- 172.21.15.150:0/3468378042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 msgr2=0x7f4db0073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.118+0000 7f4db7600640 1 --2- 172.21.15.150:0/3468378042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db0073180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4da801af10 tx=0x7f4da803bb80 comp rx=0 tx=0).stop 2024-09-15T22:15:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.122+0000 7f4db7600640 1 -- 172.21.15.150:0/3468378042 shutdown_connections 2024-09-15T22:15:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.122+0000 7f4db7600640 1 --2- 172.21.15.150:0/3468378042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 0x7f4db0119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.122+0000 7f4db7600640 1 --2- 172.21.15.150:0/3468378042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db0073180 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.122+0000 7f4db7600640 1 --2- 172.21.15.150:0/3468378042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db0109700 0x7f4db0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.122+0000 7f4db7600640 1 -- 172.21.15.150:0/3468378042 >> 172.21.15.150:0/3468378042 conn(0x7f4db006ece0 msgr2=0x7f4db0071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.140+0000 7f4db7600640 1 -- 172.21.15.150:0/3468378042 shutdown_connections 2024-09-15T22:15:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.143+0000 7f4db7600640 1 -- 172.21.15.150:0/3468378042 wait complete. 2024-09-15T22:15:10.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.144+0000 7f4db7600640 1 Processor -- start 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 -- start start 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 0x7f4db019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db0109700 0x7f4db01a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4db0113630 con 0x7f4db0072d20 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01134b0 con 0x7f4db0109700 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.149+0000 7f4db7600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01137b0 con 0x7f4db00736c0 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.150+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 0x7f4db019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.150+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 0x7f4db019ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44092/0 (socket says 172.21.15.150:44092) 2024-09-15T22:15:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.150+0000 7f4dafe00640 1 -- 172.21.15.150:0/1257370273 learned_addr learned my addr 172.21.15.150:0/1257370273 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.151+0000 7f4db4c00640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.151+0000 7f4db4c00640 1 -- 172.21.15.150:0/1257370273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 msgr2=0x7f4db019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.151+0000 7f4db4c00640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 0x7f4db019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.151+0000 7f4db4c00640 1 -- 172.21.15.150:0/1257370273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db0109700 msgr2=0x7f4db01a5b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.151+0000 7f4db4c00640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db0109700 0x7f4db01a5b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.151+0000 7f4db4c00640 1 -- 172.21.15.150:0/1257370273 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db01a61b0 con 0x7f4db0072d20 2024-09-15T22:15:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.152+0000 7f4db4c00640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db019e8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00b750 tx=0x7f4d9c00bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.162+0000 7f4dad600640 1 -- 172.21.15.150:0/1257370273 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c019070 con 0x7f4db0072d20 2024-09-15T22:15:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.162+0000 7f4dad600640 1 -- 172.21.15.150:0/1257370273 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d9c00cc00 con 0x7f4db0072d20 2024-09-15T22:15:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.162+0000 7f4dad600640 1 -- 172.21.15.150:0/1257370273 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c014df0 con 0x7f4db0072d20 2024-09-15T22:15:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.168+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db01a64a0 con 0x7f4db0072d20 2024-09-15T22:15:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.168+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db01a69f0 con 0x7f4db0072d20 2024-09-15T22:15:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.228+0000 7f4dad600640 1 -- 172.21.15.150:0/1257370273 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f4d9c00c720 con 0x7f4db0072d20 2024-09-15T22:15:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.232+0000 7f4dba44c740 1 Processor -- start 2024-09-15T22:15:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.232+0000 7f4dba44c740 1 -- start start 2024-09-15T22:15:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.232+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b321490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.232+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b326490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.232+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b328f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.233+0000 7f4db5600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b321490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.233+0000 7f4db5600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b321490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:47778/0 (socket says 172.21.15.150:47778) 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.233+0000 7f4db4c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b326490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.233+0000 7f4db4c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b326490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44102/0 (socket says 172.21.15.150:44102) 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.234+0000 7f4dba44c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ba9b286100 con 0x55ba9b326a60 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.234+0000 7f4dba44c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ba9b22e1b0 con 0x55ba9b321090 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.234+0000 7f4dba44c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba9b2820c0 con 0x55ba9b3219d0 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.234+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b328f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.234+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b328f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:47562/0 (socket says 172.21.15.150:47562) 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.234+0000 7f4dafe00640 1 -- 172.21.15.150:0/2566423447 learned_addr learned my addr 172.21.15.150:0/2566423447 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.235+0000 7f4dafe00640 1 -- 172.21.15.150:0/2566423447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 msgr2=0x55ba9b326490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.235+0000 7f4dafe00640 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b326490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.235+0000 7f4dafe00640 1 -- 172.21.15.150:0/2566423447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 msgr2=0x55ba9b321490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.235+0000 7f4dafe00640 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b321490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.235+0000 7f4dafe00640 1 -- 172.21.15.150:0/2566423447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9af99210 con 0x55ba9b326a60 2024-09-15T22:15:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.236+0000 7f4dafe00640 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b328f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4da80454d0 tx=0x7f4da8045500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade9f5b9fe61f559 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.237+0000 7f4db5600640 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b321490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-15T22:15:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.237+0000 7f4db4c00640 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b326490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-15T22:15:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.240+0000 7f4dad600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4d940a3530 0x7f4d940a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.248+0000 7f4da5c00640 1 -- 172.21.15.150:0/2566423447 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8054020 con 0x55ba9b326a60 2024-09-15T22:15:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.248+0000 7f4da5c00640 1 -- 172.21.15.150:0/2566423447 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da8003970 con 0x55ba9b326a60 2024-09-15T22:15:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.248+0000 7f4da5c00640 1 -- 172.21.15.150:0/2566423447 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8004480 con 0x55ba9b326a60 2024-09-15T22:15:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.248+0000 7f4dad600640 1 -- 172.21.15.150:0/1257370273 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4d9c0ce780 con 0x7f4db0072d20 2024-09-15T22:15:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.250+0000 7f4db5600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4d940a3530 0x7f4d940a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.252+0000 7f4db5600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4d940a3530 0x7f4d940a59f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4da000a7b0 tx=0x7f4da0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.260+0000 7f4dba44c740 1 -- 172.21.15.150:0/2566423447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 msgr2=0x55ba9b328f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.260+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b328f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4da80454d0 tx=0x7f4da8045500 comp rx=0 tx=0).stop 2024-09-15T22:15:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.275+0000 7f4dba44c740 1 -- 172.21.15.150:0/2566423447 shutdown_connections 2024-09-15T22:15:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.275+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b328f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.275+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b326490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.275+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2566423447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b321490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.275+0000 7f4dba44c740 1 -- 172.21.15.150:0/2566423447 >> 172.21.15.150:0/2566423447 conn(0x55ba9b31c700 msgr2=0x55ba9b31cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.289+0000 7f4dba44c740 1 -- 172.21.15.150:0/2566423447 shutdown_connections 2024-09-15T22:15:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.289+0000 7f4dba44c740 1 -- 172.21.15.150:0/2566423447 wait complete. 2024-09-15T22:15:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.289+0000 7f4dba44c740 1 -- start start 2024-09-15T22:15:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.290+0000 7f4dba44c740 1 Processor -- start 2024-09-15T22:15:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 0x55ba9b32b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b3219d0 0x55ba9b32b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b326a60 0x55ba9b332700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ba9b3299d0 con 0x55ba9b321090 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ba9b20f090 con 0x55ba9b3219d0 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba9b329b50 con 0x55ba9b326a60 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.298+0000 7f4dba44c740 10 client.0 _ll_register_callbacks cb 0x55ba9b263f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.299+0000 7f4db5600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b326a60 0x55ba9b332700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.299+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b3219d0 0x55ba9b32b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.300+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b3219d0 0x55ba9b32b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:47792/0 (socket says 172.21.15.150:47792) 2024-09-15T22:15:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.300+0000 7f4dafe00640 1 -- 172.21.15.150:0/55170685 learned_addr learned my addr 172.21.15.150:0/55170685 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.306+0000 7f4db5600640 1 -- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b3219d0 msgr2=0x55ba9b32b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.306+0000 7f4db5600640 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b3219d0 0x55ba9b32b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.306+0000 7f4db5600640 1 -- 172.21.15.150:0/55170685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 msgr2=0x55ba9b32b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.306+0000 7f4db5600640 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 0x55ba9b32b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.306+0000 7f4db5600640 1 -- 172.21.15.150:0/55170685 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba9b065620 con 0x55ba9b326a60 2024-09-15T22:15:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.310+0000 7f4db5600640 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b326a60 0x55ba9b332700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4da000cd50 tx=0x7f4da0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89706c2641d90d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.312+0000 7f4d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:15:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.314+0000 7f4d9a000640 1 -- 172.21.15.150:0/55170685 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0021020 con 0x55ba9b326a60 2024-09-15T22:15:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.314+0000 7f4d9a000640 1 -- 172.21.15.150:0/55170685 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4da001d3f0 con 0x55ba9b326a60 2024-09-15T22:15:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.327+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da8003970 con 0x55ba9b326a60 2024-09-15T22:15:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.331+0000 7f4d9a000640 1 -- 172.21.15.150:0/55170685 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4da0019040 con 0x55ba9b326a60 2024-09-15T22:15:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.335+0000 7f4dba44c740 10 client.25342 fetch_fsmap learned FSMap version 33 2024-09-15T22:15:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.335+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ba9b335530 con 0x55ba9b326a60 2024-09-15T22:15:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4d9a000640 1 -- 172.21.15.150:0/55170685 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da8003970 con 0x55ba9b326a60 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4d9a000640 1 -- 172.21.15.150:0/55170685 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f4da001c030 con 0x55ba9b326a60 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4dba44c740 10 client.25342 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4dba44c740 10 client.25342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4dba44c740 20 client.25342 populate_metadata read hostname 'smithi150' 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4dba44c740 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b336c40 0x55ba9b3390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4dba44c740 4 client.25342 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:15:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.349+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba9b293830 con 0x55ba9b336c40 2024-09-15T22:15:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.351+0000 7f4db4c00640 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b336c40 0x55ba9b3390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.352+0000 7f4db4c00640 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b336c40 0x55ba9b3390d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e74930454f02a78 server_cookie=6d028f50521556d5 in_seq=0 out_seq=0 2024-09-15T22:15:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.352+0000 7f4d9a000640 10 client.25342 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.352+0000 7f4d9a000640 1 -- 172.21.15.150:0/55170685 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba9b293830 con 0x55ba9b336c40 2024-09-15T22:15:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.352+0000 7f4d9a000640 10 client.25342 handle_command_reply: tid=0 2024-09-15T22:15:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.352+0000 7f4dba44c740 1 client.25342 shutdown 2024-09-15T22:15:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.361+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b326a60 msgr2=0x55ba9b332700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.361+0000 7f4dba44c740 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b326a60 0x55ba9b332700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4da000cd50 tx=0x7f4da0004750 comp rx=0 tx=0).stop 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 shutdown_connections 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4dba44c740 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b336c40 0x55ba9b3390d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4dba44c740 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b326a60 0x55ba9b332700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4dba44c740 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b3219d0 0x55ba9b32b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4dba44c740 1 --2- 172.21.15.150:0/55170685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 0x55ba9b32b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 >> 172.21.15.150:0/55170685 conn(0x55ba9b31c700 msgr2=0x55ba9b31df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.365+0000 7f4d9a000640 0 client.25342 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.369+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 shutdown_connections 2024-09-15T22:15:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.393+0000 7f4dba44c740 1 -- 172.21.15.150:0/55170685 wait complete. 2024-09-15T22:15:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.397+0000 7f4dba44c740 20 client.25342 trim_cache size 0 max 16384 2024-09-15T22:15:10.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:10 smithi150 ceph-mon[30886]: pgmap v447: 97 pgs: 97 active+clean; 463 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 152 op/s 2024-09-15T22:15:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:10 smithi169 ceph-mon[35850]: pgmap v447: 97 pgs: 97 active+clean; 463 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 152 op/s 2024-09-15T22:15:10.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:10 smithi154 ceph-mon[34853]: pgmap v447: 97 pgs: 97 active+clean; 463 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 152 op/s 2024-09-15T22:15:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.799+0000 7f4dba44c740 1 Processor -- start 2024-09-15T22:15:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.799+0000 7f4dba44c740 1 -- start start 2024-09-15T22:15:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.799+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b3390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.802+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b3326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b31cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4dba44c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01af830 con 0x55ba9b326a60 2024-09-15T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4dba44c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01b1460 con 0x55ba9b321090 2024-09-15T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4dba44c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01aff00 con 0x55ba9b3219d0 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4db4c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b3390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4db4c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b3390c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:47808/0 (socket says 172.21.15.150:47808) 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4db4c00640 1 -- 172.21.15.150:0/3519042523 learned_addr learned my addr 172.21.15.150:0/3519042523 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.806+0000 7f4dafe00640 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b3326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.809+0000 7f4db5600640 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b31cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.810+0000 7f4db5600640 1 -- 172.21.15.150:0/3519042523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 msgr2=0x55ba9b3326c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.810+0000 7f4db5600640 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b3326c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.810+0000 7f4db5600640 1 -- 172.21.15.150:0/3519042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 msgr2=0x55ba9b3390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.810+0000 7f4db5600640 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b3390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.810+0000 7f4db5600640 1 -- 172.21.15.150:0/3519042523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9b32af30 con 0x55ba9b326a60 2024-09-15T22:15:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.811+0000 7f4db5600640 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b31cae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4da0025770 tx=0x7f4da0013d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd00cb3e2a3edcb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.814+0000 7f4da5200640 1 -- 172.21.15.150:0/3519042523 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0032070 con 0x55ba9b326a60 2024-09-15T22:15:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.814+0000 7f4da5200640 1 -- 172.21.15.150:0/3519042523 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da0025e40 con 0x55ba9b326a60 2024-09-15T22:15:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.814+0000 7f4da5200640 1 -- 172.21.15.150:0/3519042523 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0021070 con 0x55ba9b326a60 2024-09-15T22:15:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.830+0000 7f4dba44c740 1 -- 172.21.15.150:0/3519042523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 msgr2=0x55ba9b31cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.830+0000 7f4dba44c740 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b31cae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4da0025770 tx=0x7f4da0013d10 comp rx=0 tx=0).stop 2024-09-15T22:15:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.836+0000 7f4dba44c740 1 -- 172.21.15.150:0/3519042523 shutdown_connections 2024-09-15T22:15:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.836+0000 7f4dba44c740 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b326a60 0x55ba9b31cae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.836+0000 7f4dba44c740 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b3326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.836+0000 7f4dba44c740 1 --2- 172.21.15.150:0/3519042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b321090 0x55ba9b3390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.836+0000 7f4dba44c740 1 -- 172.21.15.150:0/3519042523 >> 172.21.15.150:0/3519042523 conn(0x55ba9b31c700 msgr2=0x55ba9b3389b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.836+0000 7f4dba44c740 1 -- 172.21.15.150:0/3519042523 shutdown_connections 2024-09-15T22:15:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.841+0000 7f4dba44c740 1 -- 172.21.15.150:0/3519042523 wait complete. 2024-09-15T22:15:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.841+0000 7f4dba44c740 1 -- start start 2024-09-15T22:15:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.841+0000 7f4dba44c740 1 Processor -- start 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 0x55ba9b32f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b32fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b326a60 0x55ba9b330e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01b0d60 con 0x55ba9b321090 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01b05d0 con 0x55ba9b326a60 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01ad810 con 0x55ba9b3219d0 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.842+0000 7f4dba44c740 10 client.0 _ll_register_callbacks cb 0x7f4da0006ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b32fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b32fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44140/0 (socket says 172.21.15.150:44140) 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 -- 172.21.15.150:0/2882296210 learned_addr learned my addr 172.21.15.150:0/2882296210 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4db5600640 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b326a60 0x55ba9b330e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 -- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b326a60 msgr2=0x55ba9b330e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b326a60 0x55ba9b330e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 -- 172.21.15.150:0/2882296210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 msgr2=0x55ba9b32f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.843+0000 7f4dafe00640 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 0x55ba9b32f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.844+0000 7f4dafe00640 1 -- 172.21.15.150:0/2882296210 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba9b331430 con 0x55ba9b3219d0 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.848+0000 7f4dafe00640 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b32fe60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4da8045570 tx=0x7f4da801a370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d6ce319b9d43a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.848+0000 7f4d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.848+0000 7f4d9a000640 1 -- 172.21.15.150:0/2882296210 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8054050 con 0x55ba9b3219d0 2024-09-15T22:15:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.848+0000 7f4d9a000640 1 -- 172.21.15.150:0/2882296210 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4da8003db0 con 0x55ba9b3219d0 2024-09-15T22:15:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.853+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da0025e40 con 0x55ba9b3219d0 2024-09-15T22:15:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.857+0000 7f4d9a000640 1 -- 172.21.15.150:0/2882296210 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4da8004040 con 0x55ba9b3219d0 2024-09-15T22:15:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.857+0000 7f4dba44c740 10 client.25348 fetch_fsmap learned FSMap version 33 2024-09-15T22:15:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.857+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ba9b332740 con 0x55ba9b3219d0 2024-09-15T22:15:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.861+0000 7f4d9a000640 1 -- 172.21.15.150:0/2882296210 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da0025e40 con 0x55ba9b3219d0 2024-09-15T22:15:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.861+0000 7f4d9a000640 1 -- 172.21.15.150:0/2882296210 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f4da803da50 con 0x55ba9b3219d0 2024-09-15T22:15:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.862+0000 7f4dba44c740 10 client.25348 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:15:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.862+0000 7f4dba44c740 10 client.25348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:15:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.862+0000 7f4dba44c740 20 client.25348 populate_metadata read hostname 'smithi150' 2024-09-15T22:15:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.862+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b3a1a00 0x55ba9b3a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.862+0000 7f4dba44c740 4 client.25348 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:15:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.862+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba9b28db80 con 0x55ba9b3a1a00 2024-09-15T22:15:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.863+0000 7f4db4c00640 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b3a1a00 0x55ba9b3a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.875+0000 7f4db4c00640 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b3a1a00 0x55ba9b3a3df0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19f5db16502e3449 server_cookie=62a99b694f91a3b in_seq=0 out_seq=0 2024-09-15T22:15:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:10.875+0000 7f4d9a000640 10 client.25348 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:11.673 INFO:tasks.workunit.client.0.smithi150.stdout: 176 737941 1783 522630 1613 130060 810 2024-09-15T22:15:11.693 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:11.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:11.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:12.687 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:12 smithi150 ceph-mon[30886]: pgmap v448: 97 pgs: 97 active+clean; 471 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 170 op/s 2024-09-15T22:15:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:12 smithi169 ceph-mon[35850]: pgmap v448: 97 pgs: 97 active+clean; 471 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 170 op/s 2024-09-15T22:15:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:12 smithi154 ceph-mon[34853]: pgmap v448: 97 pgs: 97 active+clean; 471 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 170 op/s 2024-09-15T22:15:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.043+0000 7f4d9a000640 1 -- 172.21.15.150:0/2882296210 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba9b28db80 con 0x55ba9b3a1a00 2024-09-15T22:15:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.043+0000 7f4d9a000640 10 client.25348 handle_command_reply: tid=0 2024-09-15T22:15:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.048+0000 7f4dba44c740 1 client.25348 shutdown 2024-09-15T22:15:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.049+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 msgr2=0x55ba9b32fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.049+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b32fe60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4da8045570 tx=0x7f4da801a370 comp rx=0 tx=0).stop 2024-09-15T22:15:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 shutdown_connections 2024-09-15T22:15:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55ba9b3a1a00 0x55ba9b3a3df0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba9b326a60 0x55ba9b330e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9b3219d0 0x55ba9b32fe60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4dba44c740 1 --2- 172.21.15.150:0/2882296210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ba9b321090 0x55ba9b32f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 >> 172.21.15.150:0/2882296210 conn(0x55ba9b31c700 msgr2=0x55ba9b31b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.059+0000 7f4d9a000640 0 client.25348 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.069+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 shutdown_connections 2024-09-15T22:15:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.078+0000 7f4dba44c740 1 -- 172.21.15.150:0/2882296210 wait complete. 2024-09-15T22:15:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.091+0000 7f4dba44c740 20 client.25348 trim_cache size 0 max 16384 2024-09-15T22:15:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:15:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:15:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:15:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:15:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.117+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4d940a3530 msgr2=0x7f4d940a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.117+0000 7f4db7600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4d940a3530 0x7f4d940a59f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4da000a7b0 tx=0x7f4da0008040 comp rx=0 tx=0).stop 2024-09-15T22:15:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.117+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 msgr2=0x7f4db019e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.117+0000 7f4db7600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db019e8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00b750 tx=0x7f4d9c00bc10 comp rx=0 tx=0).stop 2024-09-15T22:15:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.118+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 shutdown_connections 2024-09-15T22:15:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.118+0000 7f4db7600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4db0109700 0x7f4db01a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.118+0000 7f4db7600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db00736c0 0x7f4db019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.118+0000 7f4db7600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4d940a3530 0x7f4d940a59f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.118+0000 7f4db7600640 1 --2- 172.21.15.150:0/1257370273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4db0072d20 0x7f4db019e8f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.118+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 >> 172.21.15.150:0/1257370273 conn(0x7f4db006ece0 msgr2=0x7f4db01161b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.125+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 shutdown_connections 2024-09-15T22:15:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:13.132+0000 7f4db7600640 1 -- 172.21.15.150:0/1257370273 wait complete. 2024-09-15T22:15:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:14 smithi150 ceph-mon[30886]: pgmap v449: 97 pgs: 97 active+clean; 471 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 219 op/s 2024-09-15T22:15:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:14 smithi169 ceph-mon[35850]: pgmap v449: 97 pgs: 97 active+clean; 471 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 219 op/s 2024-09-15T22:15:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:14 smithi154 ceph-mon[34853]: pgmap v449: 97 pgs: 97 active+clean; 471 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 219 op/s 2024-09-15T22:15:16.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:16 smithi150 ceph-mon[30886]: pgmap v450: 97 pgs: 97 active+clean; 488 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 746 op/s 2024-09-15T22:15:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:16 smithi169 ceph-mon[35850]: pgmap v450: 97 pgs: 97 active+clean; 488 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 746 op/s 2024-09-15T22:15:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:16 smithi154 ceph-mon[34853]: pgmap v450: 97 pgs: 97 active+clean; 488 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 746 op/s 2024-09-15T22:15:17.684 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:17 smithi150 ceph-mon[30886]: pgmap v451: 97 pgs: 97 active+clean; 499 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 918 op/s 2024-09-15T22:15:17.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:17 smithi169 ceph-mon[35850]: pgmap v451: 97 pgs: 97 active+clean; 499 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 918 op/s 2024-09-15T22:15:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:17 smithi154 ceph-mon[34853]: pgmap v451: 97 pgs: 97 active+clean; 499 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 918 op/s 2024-09-15T22:15:20.537 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:20 smithi150 ceph-mon[30886]: pgmap v452: 97 pgs: 97 active+clean; 517 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 973 op/s 2024-09-15T22:15:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:20 smithi169 ceph-mon[35850]: pgmap v452: 97 pgs: 97 active+clean; 517 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 973 op/s 2024-09-15T22:15:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:20 smithi154 ceph-mon[34853]: pgmap v452: 97 pgs: 97 active+clean; 517 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 973 op/s 2024-09-15T22:15:21.685 INFO:tasks.workunit.client.0.smithi150.stdout: 201 604356 1180 435561 1208 99311 175 2024-09-15T22:15:22.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:22 smithi150 ceph-mon[30886]: pgmap v453: 97 pgs: 97 active+clean; 583 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-09-15T22:15:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:22 smithi169 ceph-mon[35850]: pgmap v453: 97 pgs: 97 active+clean; 583 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-09-15T22:15:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:22 smithi154 ceph-mon[34853]: pgmap v453: 97 pgs: 97 active+clean; 583 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-09-15T22:15:24.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:24 smithi150 ceph-mon[30886]: pgmap v454: 97 pgs: 97 active+clean; 605 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2024-09-15T22:15:24.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:24 smithi169 ceph-mon[35850]: pgmap v454: 97 pgs: 97 active+clean; 605 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2024-09-15T22:15:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:24 smithi154 ceph-mon[34853]: pgmap v454: 97 pgs: 97 active+clean; 605 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2024-09-15T22:15:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:25 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:25.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:15:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:25 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:25.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:25.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:25.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:15:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:25 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:15:26.632 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:26 smithi150 ceph-mon[30886]: pgmap v455: 97 pgs: 97 active+clean; 675 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 19 MiB/s wr, 1.42k op/s 2024-09-15T22:15:26.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:26 smithi169 ceph-mon[35850]: pgmap v455: 97 pgs: 97 active+clean; 675 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 19 MiB/s wr, 1.42k op/s 2024-09-15T22:15:26.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:26 smithi154 ceph-mon[34853]: pgmap v455: 97 pgs: 97 active+clean; 675 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 19 MiB/s wr, 1.42k op/s 2024-09-15T22:15:27.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:27 smithi150 ceph-mon[30886]: pgmap v456: 97 pgs: 97 active+clean; 682 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 929 op/s 2024-09-15T22:15:27.712 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:27 smithi169 ceph-mon[35850]: pgmap v456: 97 pgs: 97 active+clean; 682 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 929 op/s 2024-09-15T22:15:27.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:27 smithi154 ceph-mon[34853]: pgmap v456: 97 pgs: 97 active+clean; 682 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 929 op/s 2024-09-15T22:15:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.499+0000 7fdc1a200640 1 -- 172.21.15.150:0/3412061875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 msgr2=0x7fdc140730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.499+0000 7fdc1a200640 1 --2- 172.21.15.150:0/3412061875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc140730b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009950 tx=0x7fdc0402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.531+0000 7fdc1a200640 1 -- 172.21.15.150:0/3412061875 shutdown_connections 2024-09-15T22:15:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.531+0000 7fdc1a200640 1 --2- 172.21.15.150:0/3412061875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc1410dbb0 0x7fdc14110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.531+0000 7fdc1a200640 1 --2- 172.21.15.150:0/3412061875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc14073680 0x7fdc1410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.531+0000 7fdc1a200640 1 --2- 172.21.15.150:0/3412061875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc140730b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.531+0000 7fdc1a200640 1 -- 172.21.15.150:0/3412061875 >> 172.21.15.150:0/3412061875 conn(0x7fdc1406eb50 msgr2=0x7fdc14070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.534+0000 7fdc1a200640 1 -- 172.21.15.150:0/3412061875 shutdown_connections 2024-09-15T22:15:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.534+0000 7fdc1a200640 1 -- 172.21.15.150:0/3412061875 wait complete. 2024-09-15T22:15:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.536+0000 7fdc1a200640 1 Processor -- start 2024-09-15T22:15:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.540+0000 7fdc1a200640 1 -- start start 2024-09-15T22:15:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.551+0000 7fdc1a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc1419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.553+0000 7fdc18e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc1419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.553+0000 7fdc1a200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 0x7fdc1419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.553+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 0x7fdc1419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.553+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 0x7fdc1419ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:33122/0 (socket says 172.21.15.150:33122) 2024-09-15T22:15:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.554+0000 7fdc18e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc1419e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59206/0 (socket says 172.21.15.150:59206) 2024-09-15T22:15:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.555+0000 7fdc1a200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc1410dbb0 0x7fdc141a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.555+0000 7fdc13e00640 1 -- 172.21.15.150:0/733366372 learned_addr learned my addr 172.21.15.150:0/733366372 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.556+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141135a0 con 0x7fdc14072cb0 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.556+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14113420 con 0x7fdc1410dbb0 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.556+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14113720 con 0x7fdc14073680 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.556+0000 7fdc19800640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc1410dbb0 0x7fdc141a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.557+0000 7fdc13e00640 1 -- 172.21.15.150:0/733366372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc1410dbb0 msgr2=0x7fdc141a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.557+0000 7fdc13e00640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc1410dbb0 0x7fdc141a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.557+0000 7fdc13e00640 1 -- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 msgr2=0x7fdc1419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.557+0000 7fdc13e00640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc1419e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.557+0000 7fdc13e00640 1 -- 172.21.15.150:0/733366372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc141a5f00 con 0x7fdc14073680 2024-09-15T22:15:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.566+0000 7fdc18e00640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc1419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-15T22:15:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.571+0000 7fdc13e00640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 0x7fdc1419ec30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdc0001ea00 tx=0x7fdc0001eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.572+0000 7fdc11600640 1 -- 172.21.15.150:0/733366372 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00028070 con 0x7fdc14073680 2024-09-15T22:15:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.572+0000 7fdc11600640 1 -- 172.21.15.150:0/733366372 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc00021470 con 0x7fdc14073680 2024-09-15T22:15:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.572+0000 7fdc11600640 1 -- 172.21.15.150:0/733366372 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00020630 con 0x7fdc14073680 2024-09-15T22:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.587+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc141a61f0 con 0x7fdc14073680 2024-09-15T22:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.588+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc141a66c0 con 0x7fdc14073680 2024-09-15T22:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.614+0000 7fdc11600640 1 -- 172.21.15.150:0/733366372 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fdc0002b070 con 0x7fdc14073680 2024-09-15T22:15:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.617+0000 7fdc11600640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdbf80a33d0 0x7fdbf80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.617+0000 7fdc11600640 1 -- 172.21.15.150:0/733366372 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fdc000e0410 con 0x7fdc14073680 2024-09-15T22:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.621+0000 7fdc18e00640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdbf80a33d0 0x7fdbf80a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.623+0000 7fdc18e00640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdbf80a33d0 0x7fdbf80a5890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc04005c40 tx=0x7fdc04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.668 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.656+0000 7fdc1e82a740 1 Processor -- start 2024-09-15T22:15:29.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 -- start start 2024-09-15T22:15:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f82660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f87660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0ee7100 con 0x55d7e0f82260 2024-09-15T22:15:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0e8f1b0 con 0x55d7e0f82ba0 2024-09-15T22:15:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.667+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0ee30c0 con 0x55d7e0f87c30 2024-09-15T22:15:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.673+0000 7fdc19800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.674+0000 7fdc19800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:33134/0 (socket says 172.21.15.150:33134) 2024-09-15T22:15:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.674+0000 7fdc19800640 1 -- 172.21.15.150:0/1229958439 learned_addr learned my addr 172.21.15.150:0/1229958439 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:29.683 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.678+0000 7fdc19800640 1 -- 172.21.15.150:0/1229958439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 msgr2=0x55d7e0f87660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.678+0000 7fdc19800640 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f87660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.678+0000 7fdc19800640 1 -- 172.21.15.150:0/1229958439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 msgr2=0x55d7e0f82660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.678+0000 7fdc19800640 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f82660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.678+0000 7fdc19800640 1 -- 172.21.15.150:0/1229958439 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e0bfa210 con 0x55d7e0f87c30 2024-09-15T22:15:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.691+0000 7fdc19800640 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8a0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c010370 tx=0x7fdc0c010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9eb5e4ccf4dc738 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.695+0000 7fdc0a000640 1 -- 172.21.15.150:0/1229958439 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c016070 con 0x55d7e0f87c30 2024-09-15T22:15:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.695+0000 7fdc0a000640 1 -- 172.21.15.150:0/1229958439 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc0c004d20 con 0x55d7e0f87c30 2024-09-15T22:15:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.695+0000 7fdc0a000640 1 -- 172.21.15.150:0/1229958439 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0054e0 con 0x55d7e0f87c30 2024-09-15T22:15:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.700+0000 7fdc1e82a740 1 -- 172.21.15.150:0/1229958439 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 msgr2=0x55d7e0f8a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.700+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8a0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c010370 tx=0x7fdc0c010830 comp rx=0 tx=0).stop 2024-09-15T22:15:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.729+0000 7fdc1e82a740 1 -- 172.21.15.150:0/1229958439 shutdown_connections 2024-09-15T22:15:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.729+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8a0f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.729+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f87660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.729+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/1229958439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f82660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.729+0000 7fdc1e82a740 1 -- 172.21.15.150:0/1229958439 >> 172.21.15.150:0/1229958439 conn(0x55d7e0f7d8d0 msgr2=0x55d7e0f7dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.737+0000 7fdc1e82a740 1 -- 172.21.15.150:0/1229958439 shutdown_connections 2024-09-15T22:15:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.748+0000 7fdc1e82a740 1 -- 172.21.15.150:0/1229958439 wait complete. 2024-09-15T22:15:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.748+0000 7fdc1e82a740 1 -- start start 2024-09-15T22:15:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.749+0000 7fdc1e82a740 1 Processor -- start 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82260 0x55d7e0f8c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 0x55d7e0f93b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0f8ac00 con 0x55d7e0f87c30 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0e70090 con 0x55d7e0f82260 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0f8ad80 con 0x55d7e0f82ba0 2024-09-15T22:15:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.760+0000 7fdc1e82a740 10 client.0 _ll_register_callbacks cb 0x55d7e0ec4f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.761+0000 7fdc19800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 0x55d7e0f93b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.761+0000 7fdc19800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 0x55d7e0f93b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59208/0 (socket says 172.21.15.150:59208) 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.761+0000 7fdc19800640 1 -- 172.21.15.150:0/2165996271 learned_addr learned my addr 172.21.15.150:0/2165996271 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.762+0000 7fdc19800640 1 -- 172.21.15.150:0/2165996271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82ba0 msgr2=0x55d7e0f8cad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.762+0000 7fdc19800640 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f8cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.762+0000 7fdc19800640 1 -- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82260 msgr2=0x55d7e0f8c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.762+0000 7fdc19800640 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82260 0x55d7e0f8c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.762+0000 7fdc19800640 1 -- 172.21.15.150:0/2165996271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e0cc6620 con 0x55d7e0f87c30 2024-09-15T22:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.762+0000 7fdc19800640 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 0x55d7e0f93b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c006010 tx=0x7fdc0c003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6328cf8897d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.770+0000 7fdbfea00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:15:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.770+0000 7fdbfea00640 1 -- 172.21.15.150:0/2165996271 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c016070 con 0x55d7e0f87c30 2024-09-15T22:15:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.770+0000 7fdbfea00640 1 -- 172.21.15.150:0/2165996271 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fdc0c003ce0 con 0x55d7e0f87c30 2024-09-15T22:15:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.774+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc0c004d20 con 0x55d7e0f87c30 2024-09-15T22:15:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.779+0000 7fdbfea00640 1 -- 172.21.15.150:0/2165996271 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdc0c02c050 con 0x55d7e0f87c30 2024-09-15T22:15:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.779+0000 7fdc1e82a740 10 client.15345 fetch_fsmap learned FSMap version 35 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.779+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d7e0f96900 con 0x55d7e0f87c30 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.780+0000 7fdbfea00640 1 -- 172.21.15.150:0/2165996271 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc0c004d20 con 0x55d7e0f87c30 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.780+0000 7fdbfea00640 1 -- 172.21.15.150:0/2165996271 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fdc0c02f020 con 0x55d7e0f87c30 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.781+0000 7fdc1e82a740 10 client.15345 fetch_fsmap finished waiting for FSMap version 35 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.781+0000 7fdc1e82a740 10 client.15345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.781+0000 7fdc1e82a740 20 client.15345 populate_metadata read hostname 'smithi150' 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.781+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e0f97d10 0x55d7e0f9a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.781+0000 7fdc1e82a740 4 client.15345 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:15:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.781+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7e0ef4830 con 0x55d7e0f97d10 2024-09-15T22:15:29.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.782+0000 7fdc18e00640 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e0f97d10 0x55d7e0f9a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.789+0000 7fdc18e00640 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e0f97d10 0x55d7e0f9a100 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=599fd69b3306fdfb server_cookie=9fdd0c9ed35d727c in_seq=0 out_seq=0 2024-09-15T22:15:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.791+0000 7fdbfea00640 10 client.15345 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.791+0000 7fdbfea00640 1 -- 172.21.15.150:0/2165996271 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7e0ef4830 con 0x55d7e0f97d10 2024-09-15T22:15:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.791+0000 7fdbfea00640 10 client.15345 handle_command_reply: tid=0 2024-09-15T22:15:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.794+0000 7fdc1e82a740 1 client.15345 shutdown 2024-09-15T22:15:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.805+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 msgr2=0x55d7e0f93b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.805+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 0x55d7e0f93b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c006010 tx=0x7fdc0c003bc0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 shutdown_connections 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e0f97d10 0x55d7e0f9a100 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f87c30 0x55d7e0f93b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f8cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/2165996271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82260 0x55d7e0f8c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 >> 172.21.15.150:0/2165996271 conn(0x55d7e0f7d8d0 msgr2=0x55d7e0f7f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdbfea00640 0 client.15345 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 shutdown_connections 2024-09-15T22:15:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.806+0000 7fdc1e82a740 1 -- 172.21.15.150:0/2165996271 wait complete. 2024-09-15T22:15:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:29.807+0000 7fdc1e82a740 20 client.15345 trim_cache size 0 max 16384 2024-09-15T22:15:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.232+0000 7fdc1e82a740 1 Processor -- start 2024-09-15T22:15:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.232+0000 7fdc1e82a740 1 -- start start 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82260 0x55d7e0f8c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f93ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141af790 con 0x55d7e0f82ba0 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141b1450 con 0x55d7e0f87c30 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc1e82a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141afe60 con 0x55d7e0f82260 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.237+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f93ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f93ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44216/0 (socket says 172.21.15.150:44216) 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 -- 172.21.15.150:0/4199145593 learned_addr learned my addr 172.21.15.150:0/4199145593 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 -- 172.21.15.150:0/4199145593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82260 msgr2=0x55d7e0f8c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82260 0x55d7e0f8c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 -- 172.21.15.150:0/4199145593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f87c30 msgr2=0x55d7e0f8cad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.238+0000 7fdc13e00640 1 -- 172.21.15.150:0/4199145593 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e0f7d6f0 con 0x55d7e0f82ba0 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.239+0000 7fdc13e00640 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f93ad0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc000a9450 tx=0x7fdc000ad180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fd2c7708f276da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.240+0000 7fdc09600640 1 -- 172.21.15.150:0/4199145593 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc000b56f0 con 0x55d7e0f82ba0 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.240+0000 7fdc09600640 1 -- 172.21.15.150:0/4199145593 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc000aab20 con 0x55d7e0f82ba0 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.240+0000 7fdc09600640 1 -- 172.21.15.150:0/4199145593 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc000b5260 con 0x55d7e0f82ba0 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.241+0000 7fdc1e82a740 1 -- 172.21.15.150:0/4199145593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 msgr2=0x55d7e0f93ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.241+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f93ad0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc000a9450 tx=0x7fdc000ad180 comp rx=0 tx=0).stop 2024-09-15T22:15:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 -- 172.21.15.150:0/4199145593 shutdown_connections 2024-09-15T22:15:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f87c30 0x55d7e0f8cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f93ad0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/4199145593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f82260 0x55d7e0f8c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 -- 172.21.15.150:0/4199145593 >> 172.21.15.150:0/4199145593 conn(0x55d7e0f7d8d0 msgr2=0x55d7e0f83f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 -- 172.21.15.150:0/4199145593 shutdown_connections 2024-09-15T22:15:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.242+0000 7fdc1e82a740 1 -- 172.21.15.150:0/4199145593 wait complete. 2024-09-15T22:15:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.244+0000 7fdc1e82a740 1 -- start start 2024-09-15T22:15:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.245+0000 7fdc1e82a740 1 Processor -- start 2024-09-15T22:15:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.245+0000 7fdc1e82a740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f93900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.247+0000 7fdc18e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f93900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.247+0000 7fdc18e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f93900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44222/0 (socket says 172.21.15.150:44222) 2024-09-15T22:15:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.247+0000 7fdc18e00640 1 -- 172.21.15.150:0/3072963885 learned_addr learned my addr 172.21.15.150:0/3072963885 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.247+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f903a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.248+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f908e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.248+0000 7fdc13e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f903a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.248+0000 7fdc19800640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.248+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141b0cc0 con 0x55d7e0f82260 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.248+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141b0530 con 0x55d7e0f82ba0 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.248+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141ad770 con 0x55d7e0f87c30 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.249+0000 7fdc18e00640 1 -- 172.21.15.150:0/3072963885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 msgr2=0x55d7e0f908e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.249+0000 7fdc18e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f908e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.249+0000 7fdc18e00640 1 -- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 msgr2=0x55d7e0f903a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.249+0000 7fdc18e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f903a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.249+0000 7fdc18e00640 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e1000970 con 0x55d7e0f82260 2024-09-15T22:15:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.250+0000 7fdc18e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f93900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009950 tx=0x7fdc0402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f28da7809c71c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.254+0000 7fdc1e82a740 10 client.0 _ll_register_callbacks cb 0x7fdc0c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.254+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc000aab20 con 0x55d7e0f82260 2024-09-15T22:15:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.269+0000 7fdbfea00640 10 client.15351 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:15:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.269+0000 7fdbfea00640 1 -- 172.21.15.150:0/3072963885 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc040048d0 con 0x55d7e0f82260 2024-09-15T22:15:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.269+0000 7fdc13e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f903a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.269+0000 7fdbfea00640 1 -- 172.21.15.150:0/3072963885 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fdc040050c0 con 0x55d7e0f82260 2024-09-15T22:15:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.269+0000 7fdc19800640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f908e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.269+0000 7fdbfea00640 1 -- 172.21.15.150:0/3072963885 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdc04060050 con 0x55d7e0f82260 2024-09-15T22:15:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdc1e82a740 10 client.15351 fetch_fsmap learned FSMap version 35 2024-09-15T22:15:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55d7e1001be0 con 0x55d7e0f82260 2024-09-15T22:15:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdbfea00640 1 -- 172.21.15.150:0/3072963885 <== mon.0 v2:172.21.15.150:3300/0 4 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fdc040052c0 con 0x55d7e0f82260 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdc1e82a740 10 client.15351 fetch_fsmap finished waiting for FSMap version 35 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdc1e82a740 10 client.15351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdc1e82a740 20 client.15351 populate_metadata read hostname 'smithi150' 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.294+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e10024a0 0x55d7e10048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.295+0000 7fdc1e82a740 4 client.15351 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.295+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fdc000aab20 con 0x55d7e10024a0 2024-09-15T22:15:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.295+0000 7fdc13e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e10024a0 0x55d7e10048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.296+0000 7fdc13e00640 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e10024a0 0x55d7e10048c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d669b812157954 server_cookie=b7d1931be0dea3d6 in_seq=0 out_seq=0 2024-09-15T22:15:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:30.296+0000 7fdbfea00640 10 client.15351 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:30.394 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:30 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:30.394 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:30 smithi150 ceph-mon[30886]: pgmap v457: 97 pgs: 97 active+clean; 689 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 744 op/s 2024-09-15T22:15:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:30 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:30 smithi169 ceph-mon[35850]: pgmap v457: 97 pgs: 97 active+clean; 689 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 744 op/s 2024-09-15T22:15:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:30 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:30 smithi154 ceph-mon[34853]: pgmap v457: 97 pgs: 97 active+clean; 689 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 744 op/s 2024-09-15T22:15:31.692 INFO:tasks.workunit.client.0.smithi150.stdout: 235 719525 1916 509602 1903 124162 1854 2024-09-15T22:15:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.695+0000 7fdbfea00640 1 -- 172.21.15.150:0/3072963885 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fdc000aab20 con 0x55d7e10024a0 2024-09-15T22:15:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.695+0000 7fdbfea00640 10 client.15351 handle_command_reply: tid=0 2024-09-15T22:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.756+0000 7fdc1e82a740 1 client.15351 shutdown 2024-09-15T22:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 msgr2=0x55d7e0f93900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f93900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009950 tx=0x7fdc0402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 shutdown_connections 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d7e10024a0 0x55d7e10048c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d7e0f87c30 0x55d7e0f908e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d7e0f82ba0 0x55d7e0f903a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 --2- 172.21.15.150:0/3072963885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7e0f82260 0x55d7e0f93900 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009950 tx=0x7fdc0402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 >> 172.21.15.150:0/3072963885 conn(0x55d7e0f7d8d0 msgr2=0x55d7e0f8c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.763+0000 7fdbfea00640 0 client.15351 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.788+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 shutdown_connections 2024-09-15T22:15:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.790+0000 7fdc1e82a740 1 -- 172.21.15.150:0/3072963885 wait complete. 2024-09-15T22:15:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.799+0000 7fdc1e82a740 20 client.15351 trim_cache size 0 max 16384 2024-09-15T22:15:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:15:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:15:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:15:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:15:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.823+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdbf80a33d0 msgr2=0x7fdbf80a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.825+0000 7fdc1a200640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdbf80a33d0 0x7fdbf80a5890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc04005c40 tx=0x7fdc04000bc0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.825+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 msgr2=0x7fdc1419ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.825+0000 7fdc1a200640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 0x7fdc1419ec30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdc0001ea00 tx=0x7fdc0001eec0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.825+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 shutdown_connections 2024-09-15T22:15:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.825+0000 7fdc1a200640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc1410dbb0 0x7fdc141a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.826+0000 7fdc1a200640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc14073680 0x7fdc1419ec30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.826+0000 7fdc1a200640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fdbf80a33d0 0x7fdbf80a5890 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.826+0000 7fdc1a200640 1 --2- 172.21.15.150:0/733366372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc14072cb0 0x7fdc1419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.826+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 >> 172.21.15.150:0/733366372 conn(0x7fdc1406eb50 msgr2=0x7fdc14070880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.826+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 shutdown_connections 2024-09-15T22:15:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:31.826+0000 7fdc1a200640 1 -- 172.21.15.150:0/733366372 wait complete. 2024-09-15T22:15:32.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:32 smithi150 ceph-mon[30886]: pgmap v458: 97 pgs: 97 active+clean; 693 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 754 op/s 2024-09-15T22:15:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:32 smithi169 ceph-mon[35850]: pgmap v458: 97 pgs: 97 active+clean; 693 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 754 op/s 2024-09-15T22:15:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:32 smithi154 ceph-mon[34853]: pgmap v458: 97 pgs: 97 active+clean; 693 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 754 op/s 2024-09-15T22:15:34.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:34 smithi150 ceph-mon[30886]: pgmap v459: 97 pgs: 97 active+clean; 691 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 558 op/s 2024-09-15T22:15:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:34 smithi169 ceph-mon[35850]: pgmap v459: 97 pgs: 97 active+clean; 691 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 558 op/s 2024-09-15T22:15:34.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:34 smithi154 ceph-mon[34853]: pgmap v459: 97 pgs: 97 active+clean; 691 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 558 op/s 2024-09-15T22:15:35.467 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:35 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:35.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:35 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:35 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:36 smithi150 ceph-mon[30886]: pgmap v460: 97 pgs: 97 active+clean; 693 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.6 MiB/s wr, 816 op/s 2024-09-15T22:15:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:36 smithi169 ceph-mon[35850]: pgmap v460: 97 pgs: 97 active+clean; 693 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.6 MiB/s wr, 816 op/s 2024-09-15T22:15:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:36 smithi154 ceph-mon[34853]: pgmap v460: 97 pgs: 97 active+clean; 693 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.6 MiB/s wr, 816 op/s 2024-09-15T22:15:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:38 smithi150 ceph-mon[30886]: pgmap v461: 97 pgs: 97 active+clean; 708 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 678 op/s 2024-09-15T22:15:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:38 smithi169 ceph-mon[35850]: pgmap v461: 97 pgs: 97 active+clean; 708 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 678 op/s 2024-09-15T22:15:38.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:38 smithi154 ceph-mon[34853]: pgmap v461: 97 pgs: 97 active+clean; 708 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 678 op/s 2024-09-15T22:15:39.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:39 smithi150 ceph-mon[30886]: pgmap v462: 97 pgs: 97 active+clean; 719 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 709 op/s 2024-09-15T22:15:39.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:39 smithi169 ceph-mon[35850]: pgmap v462: 97 pgs: 97 active+clean; 719 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 709 op/s 2024-09-15T22:15:39.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:39 smithi154 ceph-mon[34853]: pgmap v462: 97 pgs: 97 active+clean; 719 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 709 op/s 2024-09-15T22:15:40.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:40 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:40 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:40 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:15:41.469 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:41 smithi150 ceph-mon[30886]: pgmap v463: 97 pgs: 97 active+clean; 740 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.5 MiB/s wr, 774 op/s 2024-09-15T22:15:41.702 INFO:tasks.workunit.client.0.smithi150.stdout: 264 670233 1438 485653 1719 139543 1420 2024-09-15T22:15:41.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:41 smithi169 ceph-mon[35850]: pgmap v463: 97 pgs: 97 active+clean; 740 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.5 MiB/s wr, 774 op/s 2024-09-15T22:15:41.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:41 smithi154 ceph-mon[34853]: pgmap v463: 97 pgs: 97 active+clean; 740 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.5 MiB/s wr, 774 op/s 2024-09-15T22:15:44.549 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:44 smithi150 ceph-mon[30886]: pgmap v464: 97 pgs: 97 active+clean; 756 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2024-09-15T22:15:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:44 smithi169 ceph-mon[35850]: pgmap v464: 97 pgs: 97 active+clean; 756 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2024-09-15T22:15:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:44 smithi154 ceph-mon[34853]: pgmap v464: 97 pgs: 97 active+clean; 756 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2024-09-15T22:15:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.239+0000 7f8a86a00640 1 -- 172.21.15.150:0/576876158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a800736c0 msgr2=0x7f8a80119130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.239+0000 7f8a86a00640 1 --2- 172.21.15.150:0/576876158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a800736c0 0x7f8a80119130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009c30 tx=0x7f8a7802a720 comp rx=0 tx=0).stop 2024-09-15T22:15:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.245+0000 7f8a86a00640 1 -- 172.21.15.150:0/576876158 shutdown_connections 2024-09-15T22:15:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.245+0000 7f8a86a00640 1 --2- 172.21.15.150:0/576876158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a800736c0 0x7f8a80119130 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.245+0000 7f8a86a00640 1 --2- 172.21.15.150:0/576876158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a80072d20 0x7f8a80073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.245+0000 7f8a86a00640 1 --2- 172.21.15.150:0/576876158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 0x7f8a80109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.245+0000 7f8a86a00640 1 -- 172.21.15.150:0/576876158 >> 172.21.15.150:0/576876158 conn(0x7f8a8006ece0 msgr2=0x7f8a80071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.258+0000 7f8a86a00640 1 -- 172.21.15.150:0/576876158 shutdown_connections 2024-09-15T22:15:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.263+0000 7f8a86a00640 1 -- 172.21.15.150:0/576876158 wait complete. 2024-09-15T22:15:45.279 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.268+0000 7f8a86a00640 1 Processor -- start 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 -- start start 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 0x7f8a80115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 0x7f8a80116280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 0x7f8a801b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8011c630 con 0x7f8a80072d20 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8011c4b0 con 0x7f8a800736c0 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a86a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8011c7b0 con 0x7f8a80109700 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 0x7f8a80115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a7f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 0x7f8a80116280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a7f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 0x7f8a80116280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38306/0 (socket says 172.21.15.150:38306) 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 0x7f8a80115d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53792/0 (socket says 172.21.15.150:53792) 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.281+0000 7f8a7f400640 1 -- 172.21.15.150:0/3551397626 learned_addr learned my addr 172.21.15.150:0/3551397626 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a7fe00640 1 -- 172.21.15.150:0/3551397626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 msgr2=0x7f8a801b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 0x7f8a801b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 0x7f8a801b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a7fe00640 1 -- 172.21.15.150:0/3551397626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 msgr2=0x7f8a80116280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 0x7f8a80116280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a7fe00640 1 -- 172.21.15.150:0/3551397626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a80119400 con 0x7f8a80072d20 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 0x7f8a801b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.286+0000 7f8a7f400640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 0x7f8a80116280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:45.291 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.288+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 0x7f8a80115d40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000e9e0 tx=0x7f8a7000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.294+0000 7f8a7cc00640 1 -- 172.21.15.150:0/3551397626 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000cba0 con 0x7f8a80072d20 2024-09-15T22:15:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.294+0000 7f8a7cc00640 1 -- 172.21.15.150:0/3551397626 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a7000cd40 con 0x7f8a80072d20 2024-09-15T22:15:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.294+0000 7f8a7cc00640 1 -- 172.21.15.150:0/3551397626 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70018840 con 0x7f8a80072d20 2024-09-15T22:15:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.301+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a801b7340 con 0x7f8a80072d20 2024-09-15T22:15:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.302+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a801b7890 con 0x7f8a80072d20 2024-09-15T22:15:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.324+0000 7f8a897dd740 1 Processor -- start 2024-09-15T22:15:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.324+0000 7f8a897dd740 1 -- start start 2024-09-15T22:15:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.324+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd992490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.325+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9929d0 0x5562dd997490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.325+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd997a60 0x5562dd999f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.325+0000 7f8a84a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd992490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a897dd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5562dd8f7100 con 0x5562dd9929d0 2024-09-15T22:15:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a897dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5562dd89f1b0 con 0x5562dd997a60 2024-09-15T22:15:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a897dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5562dd8f30c0 con 0x5562dd992090 2024-09-15T22:15:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd992490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:51832/0 (socket says 172.21.15.150:51832) 2024-09-15T22:15:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 -- 172.21.15.150:0/3601617601 learned_addr learned my addr 172.21.15.150:0/3601617601 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a7f400640 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd997a60 0x5562dd999f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 -- 172.21.15.150:0/3601617601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd997a60 msgr2=0x5562dd999f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd997a60 0x5562dd999f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 -- 172.21.15.150:0/3601617601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9929d0 msgr2=0x5562dd997490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9929d0 0x5562dd997490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.326+0000 7f8a84a00640 1 -- 172.21.15.150:0/3601617601 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562dd60a210 con 0x5562dd992090 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.327+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd992490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a78034040 tx=0x7f8a78030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf34794bbf503f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.330+0000 7f8a75200640 1 -- 172.21.15.150:0/3601617601 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78040020 con 0x5562dd992090 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.330+0000 7f8a75200640 1 -- 172.21.15.150:0/3601617601 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a78003970 con 0x5562dd992090 2024-09-15T22:15:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.330+0000 7f8a75200640 1 -- 172.21.15.150:0/3601617601 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78036040 con 0x5562dd992090 2024-09-15T22:15:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.332+0000 7f8a897dd740 1 -- 172.21.15.150:0/3601617601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 msgr2=0x5562dd992490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.332+0000 7f8a897dd740 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd992490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a78034040 tx=0x7f8a78030430 comp rx=0 tx=0).stop 2024-09-15T22:15:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.332+0000 7f8a897dd740 1 -- 172.21.15.150:0/3601617601 shutdown_connections 2024-09-15T22:15:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.332+0000 7f8a897dd740 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd997a60 0x5562dd999f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.332+0000 7f8a897dd740 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9929d0 0x5562dd997490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.332+0000 7f8a897dd740 1 --2- 172.21.15.150:0/3601617601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd992490 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.333+0000 7f8a897dd740 1 -- 172.21.15.150:0/3601617601 >> 172.21.15.150:0/3601617601 conn(0x5562dd98d700 msgr2=0x5562dd98db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:45.346 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.345+0000 7f8a897dd740 1 -- 172.21.15.150:0/3601617601 shutdown_connections 2024-09-15T22:15:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.347+0000 7f8a897dd740 1 -- 172.21.15.150:0/3601617601 wait complete. 2024-09-15T22:15:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.347+0000 7f8a897dd740 1 -- start start 2024-09-15T22:15:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.348+0000 7f8a897dd740 1 Processor -- start 2024-09-15T22:15:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.347+0000 7f8a7cc00640 1 -- 172.21.15.150:0/3551397626 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f8a700189e0 con 0x7f8a80072d20 2024-09-15T22:15:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.350+0000 7f8a7cc00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8a640a3440 0x7f8a640a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.350+0000 7f8a7cc00640 1 -- 172.21.15.150:0/3551397626 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f8a700cfaa0 con 0x7f8a80072d20 2024-09-15T22:15:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.351+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8a640a3440 0x7f8a640a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.352+0000 7f8a84a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8a640a3440 0x7f8a640a5900 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a7802ad10 tx=0x7f8a7802ac20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.373+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd992090 0x5562dd99c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.373+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 0x5562dd99c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.373+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd9a1920 0x5562dd9a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.373+0000 7f8a897dd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5562dd99a9d0 con 0x5562dd997a60 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.373+0000 7f8a897dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5562dd880090 con 0x5562dd992090 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.373+0000 7f8a897dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5562dd99ab50 con 0x5562dd9a1920 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.374+0000 7f8a897dd740 10 client.0 _ll_register_callbacks cb 0x5562dd8d4f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.374+0000 7f8a7f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 0x5562dd99c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.374+0000 7f8a7f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 0x5562dd99c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53804/0 (socket says 172.21.15.150:53804) 2024-09-15T22:15:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.374+0000 7f8a7f400640 1 -- 172.21.15.150:0/586032075 learned_addr learned my addr 172.21.15.150:0/586032075 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.374+0000 7f8a84a00640 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd9a1920 0x5562dd9a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.375+0000 7f8a7f400640 1 -- 172.21.15.150:0/586032075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd9a1920 msgr2=0x5562dd9a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.375+0000 7f8a7f400640 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd9a1920 0x5562dd9a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.375+0000 7f8a7f400640 1 -- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd992090 msgr2=0x5562dd99c3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:15:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.375+0000 7f8a7f400640 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd992090 0x5562dd99c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.375+0000 7f8a7f400640 1 -- 172.21.15.150:0/586032075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562dd6d6620 con 0x5562dd997a60 2024-09-15T22:15:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.394+0000 7f8a7f400640 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 0x5562dd99c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007f90 tx=0x7f8a6c010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84e8e6159b1027 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.396+0000 7f8a69600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:15:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.398+0000 7f8a69600640 1 -- 172.21.15.150:0/586032075 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c03a070 con 0x5562dd997a60 2024-09-15T22:15:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.398+0000 7f8a69600640 1 -- 172.21.15.150:0/586032075 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f8a6c036710 con 0x5562dd997a60 2024-09-15T22:15:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.417+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a78003970 con 0x5562dd997a60 2024-09-15T22:15:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.486+0000 7f8a69600640 1 -- 172.21.15.150:0/586032075 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8a6c044050 con 0x5562dd997a60 2024-09-15T22:15:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.486+0000 7f8a897dd740 10 client.15360 fetch_fsmap learned FSMap version 37 2024-09-15T22:15:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.486+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5562dd9a6c20 con 0x5562dd997a60 2024-09-15T22:15:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.491+0000 7f8a69600640 1 -- 172.21.15.150:0/586032075 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a78003970 con 0x5562dd997a60 2024-09-15T22:15:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.491+0000 7f8a69600640 1 -- 172.21.15.150:0/586032075 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7f8a6c03fc20 con 0x5562dd997a60 2024-09-15T22:15:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.494+0000 7f8a897dd740 10 client.15360 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:15:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.494+0000 7f8a897dd740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:15:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.494+0000 7f8a897dd740 20 client.15360 populate_metadata read hostname 'smithi150' 2024-09-15T22:15:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.494+0000 7f8a897dd740 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dd9a83d0 0x5562dd9aa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.494+0000 7f8a897dd740 4 client.15360 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:15:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.494+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562dd904830 con 0x5562dd9a83d0 2024-09-15T22:15:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.552+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dd9a83d0 0x5562dd9aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.580+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dd9a83d0 0x5562dd9aa820 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2fc2c70c7be920 server_cookie=96442a4dd15c8a3a in_seq=0 out_seq=0 2024-09-15T22:15:45.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.580+0000 7f8a69600640 10 client.15360 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.582+0000 7f8a69600640 1 -- 172.21.15.150:0/586032075 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562dd904830 con 0x5562dd9a83d0 2024-09-15T22:15:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.582+0000 7f8a69600640 10 client.15360 handle_command_reply: tid=0 2024-09-15T22:15:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.586+0000 7f8a897dd740 1 client.15360 shutdown 2024-09-15T22:15:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.623+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 msgr2=0x5562dd99c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.623+0000 7f8a897dd740 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 0x5562dd99c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007f90 tx=0x7f8a6c010960 comp rx=0 tx=0).stop 2024-09-15T22:15:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 shutdown_connections 2024-09-15T22:15:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a897dd740 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dd9a83d0 0x5562dd9aa820 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a897dd740 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd9a1920 0x5562dd9a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a897dd740 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd997a60 0x5562dd99c8f0 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007f90 tx=0x7f8a6c010960 comp rx=0 tx=0).stop 2024-09-15T22:15:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a897dd740 1 --2- 172.21.15.150:0/586032075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd992090 0x5562dd99c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 >> 172.21.15.150:0/586032075 conn(0x5562dd98d700 msgr2=0x5562dd98ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.632+0000 7f8a69600640 0 client.15360 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.655+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 shutdown_connections 2024-09-15T22:15:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.669+0000 7f8a897dd740 1 -- 172.21.15.150:0/586032075 wait complete. 2024-09-15T22:15:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:45.677+0000 7f8a897dd740 20 client.15360 trim_cache size 0 max 16384 2024-09-15T22:15:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.024+0000 7f8a897dd740 1 Processor -- start 2024-09-15T22:15:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.028+0000 7f8a897dd740 1 -- start start 2024-09-15T22:15:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.028+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd992090 0x5562dd98c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.032+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd9a1920 0x5562dd98eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.032+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 0x5562dd98f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.032+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd992090 0x5562dd98c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.032+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd992090 0x5562dd98c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53812/0 (socket says 172.21.15.150:53812) 2024-09-15T22:15:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.032+0000 7f8a7f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd9a1920 0x5562dd98eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.032+0000 7f8a7f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd9a1920 0x5562dd98eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38318/0 (socket says 172.21.15.150:38318) 2024-09-15T22:15:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.035+0000 7f8a897dd740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80125b20 con 0x5562dd992090 2024-09-15T22:15:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.035+0000 7f8a897dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a801277e0 con 0x5562dd9a1920 2024-09-15T22:15:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.035+0000 7f8a897dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a801261f0 con 0x5562dd988b00 2024-09-15T22:15:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.035+0000 7f8a84a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 0x5562dd98f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.035+0000 7f8a84a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 0x5562dd98f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:51850/0 (socket says 172.21.15.150:51850) 2024-09-15T22:15:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.035+0000 7f8a84a00640 1 -- 172.21.15.150:0/576651694 learned_addr learned my addr 172.21.15.150:0/576651694 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.037+0000 7f8a84a00640 1 -- 172.21.15.150:0/576651694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd9a1920 msgr2=0x5562dd98eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.037+0000 7f8a84a00640 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd9a1920 0x5562dd98eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.037+0000 7f8a84a00640 1 -- 172.21.15.150:0/576651694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd992090 msgr2=0x5562dd98c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.037+0000 7f8a84a00640 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd992090 0x5562dd98c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.037+0000 7f8a84a00640 1 -- 172.21.15.150:0/576651694 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562dd99d230 con 0x5562dd988b00 2024-09-15T22:15:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.039+0000 7f8a84a00640 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 0x5562dd98f030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a7802ac90 tx=0x7f8a78046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35e5944f0f42066b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.046+0000 7f8a6be00640 1 -- 172.21.15.150:0/576651694 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78056070 con 0x5562dd988b00 2024-09-15T22:15:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.046+0000 7f8a6be00640 1 -- 172.21.15.150:0/576651694 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a78030cd0 con 0x5562dd988b00 2024-09-15T22:15:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.046+0000 7f8a6be00640 1 -- 172.21.15.150:0/576651694 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78040040 con 0x5562dd988b00 2024-09-15T22:15:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.062+0000 7f8a897dd740 1 -- 172.21.15.150:0/576651694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 msgr2=0x5562dd98f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.062+0000 7f8a897dd740 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 0x5562dd98f030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a7802ac90 tx=0x7f8a78046000 comp rx=0 tx=0).stop 2024-09-15T22:15:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.079+0000 7f8a897dd740 1 -- 172.21.15.150:0/576651694 shutdown_connections 2024-09-15T22:15:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.079+0000 7f8a897dd740 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd988b00 0x5562dd98f030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.079+0000 7f8a897dd740 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd9a1920 0x5562dd98eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.079+0000 7f8a897dd740 1 --2- 172.21.15.150:0/576651694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd992090 0x5562dd98c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.079+0000 7f8a897dd740 1 -- 172.21.15.150:0/576651694 >> 172.21.15.150:0/576651694 conn(0x5562dd98d700 msgr2=0x5562dd98c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.083+0000 7f8a897dd740 1 -- 172.21.15.150:0/576651694 shutdown_connections 2024-09-15T22:15:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.083+0000 7f8a897dd740 1 -- 172.21.15.150:0/576651694 wait complete. 2024-09-15T22:15:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.083+0000 7f8a897dd740 1 -- start start 2024-09-15T22:15:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.084+0000 7f8a897dd740 1 Processor -- start 2024-09-15T22:15:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.085+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 0x5562dd9ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.085+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd9ba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.085+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 0x5562dd9ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.085+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 0x5562dd9ba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:38322/0 (socket says 172.21.15.150:38322) 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.085+0000 7f8a897dd740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9a1920 0x5562dd9bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.085+0000 7f8a7fe00640 1 -- 172.21.15.150:0/512676953 learned_addr learned my addr 172.21.15.150:0/512676953 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.086+0000 7f8a84a00640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9a1920 0x5562dd9bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.086+0000 7f8a7f400640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd9ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.086+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80127050 con 0x5562dd9a1920 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.086+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a801268c0 con 0x5562dd988b00 2024-09-15T22:15:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.086+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80123b00 con 0x5562dd992090 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.087+0000 7f8a7fe00640 1 -- 172.21.15.150:0/512676953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 msgr2=0x5562dd9ba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.087+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd9ba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.087+0000 7f8a7fe00640 1 -- 172.21.15.150:0/512676953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9a1920 msgr2=0x5562dd9bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.087+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9a1920 0x5562dd9bb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.087+0000 7f8a7fe00640 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562dd9bbc80 con 0x5562dd988b00 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.087+0000 7f8a84a00640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9a1920 0x5562dd9bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.088+0000 7f8a897dd740 10 client.0 _ll_register_callbacks cb 0x7f8a6c0075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.088+0000 7f8a7fe00640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 0x5562dd9ba120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fd0 tx=0x7f8a7000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee1cfd27a9f2bad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.088+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a78030cd0 con 0x5562dd988b00 2024-09-15T22:15:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.088+0000 7f8a69600640 10 client.25385 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:15:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.088+0000 7f8a69600640 1 -- 172.21.15.150:0/512676953 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7009c030 con 0x5562dd988b00 2024-09-15T22:15:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.089+0000 7f8a69600640 1 -- 172.21.15.150:0/512676953 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f8a700cd620 con 0x5562dd988b00 2024-09-15T22:15:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.089+0000 7f8a69600640 1 -- 172.21.15.150:0/512676953 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8a700a03e0 con 0x5562dd988b00 2024-09-15T22:15:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 10 client.25385 fetch_fsmap learned FSMap version 37 2024-09-15T22:15:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=37}) -- 0x5562dda130a0 con 0x5562dd988b00 2024-09-15T22:15:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a69600640 1 -- 172.21.15.150:0/512676953 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7f8a70020030 con 0x5562dd988b00 2024-09-15T22:15:46.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 10 client.25385 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:15:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:15:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 20 client.25385 populate_metadata read hostname 'smithi150' 2024-09-15T22:15:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dda13a40 0x5562dda15f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 4 client.25385 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:15:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.091+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8a78030cd0 con 0x5562dda13a40 2024-09-15T22:15:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.092+0000 7f8a7f400640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dda13a40 0x5562dda15f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.093+0000 7f8a7f400640 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dda13a40 0x5562dda15f00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96bfd928bf972707 server_cookie=1885d3e4921d885b in_seq=0 out_seq=0 2024-09-15T22:15:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:46.093+0000 7f8a69600640 10 client.25385 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:46.690 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:46 smithi150 ceph-mon[30886]: pgmap v465: 97 pgs: 97 active+clean; 881 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 1.23k op/s 2024-09-15T22:15:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:46 smithi169 ceph-mon[35850]: pgmap v465: 97 pgs: 97 active+clean; 881 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 1.23k op/s 2024-09-15T22:15:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:46 smithi154 ceph-mon[34853]: pgmap v465: 97 pgs: 97 active+clean; 881 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 1.23k op/s 2024-09-15T22:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.137+0000 7f8a69600640 1 -- 172.21.15.150:0/512676953 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8a78030cd0 con 0x5562dda13a40 2024-09-15T22:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.137+0000 7f8a69600640 10 client.25385 handle_command_reply: tid=0 2024-09-15T22:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.140+0000 7f8a897dd740 1 client.25385 shutdown 2024-09-15T22:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.143+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 msgr2=0x5562dd9ba120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.143+0000 7f8a897dd740 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 0x5562dd9ba120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fd0 tx=0x7f8a7000c820 comp rx=0 tx=0).stop 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.143+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 shutdown_connections 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.143+0000 7f8a897dd740 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5562dda13a40 0x5562dda15f00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.143+0000 7f8a897dd740 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562dd9a1920 0x5562dd9bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.144+0000 7f8a897dd740 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5562dd992090 0x5562dd9ba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.144+0000 7f8a897dd740 1 --2- 172.21.15.150:0/512676953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562dd988b00 0x5562dd9ba120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.144+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 >> 172.21.15.150:0/512676953 conn(0x5562dd98d700 msgr2=0x5562dd98c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.144+0000 7f8a69600640 0 client.25385 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:15:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.150+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 shutdown_connections 2024-09-15T22:15:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.156+0000 7f8a897dd740 1 -- 172.21.15.150:0/512676953 wait complete. 2024-09-15T22:15:47.180 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.178+0000 7f8a897dd740 20 client.25385 trim_cache size 0 max 16384 2024-09-15T22:15:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:15:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:15:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:15:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:15:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8a640a3440 msgr2=0x7f8a640a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8a640a3440 0x7f8a640a5900 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a7802ad10 tx=0x7f8a7802ac20 comp rx=0 tx=0).stop 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 msgr2=0x7f8a80115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 0x7f8a80115d40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000e9e0 tx=0x7f8a7000eea0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 shutdown_connections 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a80109700 0x7f8a801b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a800736c0 0x7f8a80116280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8a640a3440 0x7f8a640a5900 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 --2- 172.21.15.150:0/3551397626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a80072d20 0x7f8a80115d40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.240+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 >> 172.21.15.150:0/3551397626 conn(0x7f8a8006ece0 msgr2=0x7f8a8010c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.241+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 shutdown_connections 2024-09-15T22:15:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:15:47.241+0000 7f8a86a00640 1 -- 172.21.15.150:0/3551397626 wait complete. 2024-09-15T22:15:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:48 smithi150 ceph-mon[30886]: pgmap v466: 97 pgs: 97 active+clean; 920 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.11k op/s 2024-09-15T22:15:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:48 smithi169 ceph-mon[35850]: pgmap v466: 97 pgs: 97 active+clean; 920 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.11k op/s 2024-09-15T22:15:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:48 smithi154 ceph-mon[34853]: pgmap v466: 97 pgs: 97 active+clean; 920 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.11k op/s 2024-09-15T22:15:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:50 smithi150 ceph-mon[30886]: pgmap v467: 97 pgs: 97 active+clean; 915 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-09-15T22:15:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:50 smithi169 ceph-mon[35850]: pgmap v467: 97 pgs: 97 active+clean; 915 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-09-15T22:15:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:50 smithi154 ceph-mon[34853]: pgmap v467: 97 pgs: 97 active+clean; 915 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 19 MiB/s wr, 1.09k op/s 2024-09-15T22:15:51.709 INFO:tasks.workunit.client.0.smithi150.stdout: 289 628394 1515 456001 1244 136035 966 2024-09-15T22:15:52.685 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:52 smithi150 ceph-mon[30886]: pgmap v468: 97 pgs: 97 active+clean; 918 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 19 MiB/s wr, 1.20k op/s 2024-09-15T22:15:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:52 smithi169 ceph-mon[35850]: pgmap v468: 97 pgs: 97 active+clean; 918 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 19 MiB/s wr, 1.20k op/s 2024-09-15T22:15:52.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:52 smithi154 ceph-mon[34853]: pgmap v468: 97 pgs: 97 active+clean; 918 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 19 MiB/s wr, 1.20k op/s 2024-09-15T22:15:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:53 smithi150 ceph-mon[30886]: pgmap v469: 97 pgs: 97 active+clean; 920 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-09-15T22:15:53.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:53 smithi169 ceph-mon[35850]: pgmap v469: 97 pgs: 97 active+clean; 920 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-09-15T22:15:53.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:53 smithi154 ceph-mon[34853]: pgmap v469: 97 pgs: 97 active+clean; 920 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-09-15T22:15:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:56 smithi150 ceph-mon[30886]: pgmap v470: 97 pgs: 97 active+clean; 932 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-09-15T22:15:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:56 smithi169 ceph-mon[35850]: pgmap v470: 97 pgs: 97 active+clean; 932 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-09-15T22:15:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:56 smithi154 ceph-mon[34853]: pgmap v470: 97 pgs: 97 active+clean; 932 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2024-09-15T22:15:58.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:15:58 smithi150 ceph-mon[30886]: pgmap v471: 97 pgs: 97 active+clean; 932 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 601 op/s 2024-09-15T22:15:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:15:58 smithi169 ceph-mon[35850]: pgmap v471: 97 pgs: 97 active+clean; 932 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 601 op/s 2024-09-15T22:15:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:15:58 smithi154 ceph-mon[34853]: pgmap v471: 97 pgs: 97 active+clean; 932 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 601 op/s 2024-09-15T22:16:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:00 smithi150 ceph-mon[30886]: pgmap v472: 97 pgs: 97 active+clean; 936 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 411 op/s 2024-09-15T22:16:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:00 smithi169 ceph-mon[35850]: pgmap v472: 97 pgs: 97 active+clean; 936 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 411 op/s 2024-09-15T22:16:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:00 smithi154 ceph-mon[34853]: pgmap v472: 97 pgs: 97 active+clean; 936 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 411 op/s 2024-09-15T22:16:01.724 INFO:tasks.workunit.client.0.smithi150.stdout: 327 746340 2188 525453 1999 168937 1218 2024-09-15T22:16:02.595 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:02 smithi150 ceph-mon[30886]: pgmap v473: 97 pgs: 97 active+clean; 942 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 328 op/s 2024-09-15T22:16:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:02 smithi169 ceph-mon[35850]: pgmap v473: 97 pgs: 97 active+clean; 942 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 328 op/s 2024-09-15T22:16:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.715+0000 7ff506600640 1 -- 172.21.15.150:0/1903162496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 msgr2=0x7ff500110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.715+0000 7ff506600640 1 --2- 172.21.15.150:0/1903162496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff500110350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4f801acb0 tx=0x7ff4f803b920 comp rx=0 tx=0).stop 2024-09-15T22:16:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.746+0000 7ff506600640 1 -- 172.21.15.150:0/1903162496 shutdown_connections 2024-09-15T22:16:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.746+0000 7ff506600640 1 --2- 172.21.15.150:0/1903162496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff500110350 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.746+0000 7ff506600640 1 --2- 172.21.15.150:0/1903162496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff50010b4e0 0x7ff50010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.746+0000 7ff506600640 1 --2- 172.21.15.150:0/1903162496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff500072d80 0x7ff500073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.746+0000 7ff506600640 1 -- 172.21.15.150:0/1903162496 >> 172.21.15.150:0/1903162496 conn(0x7ff50006eb50 msgr2=0x7ff500070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.765+0000 7ff506600640 1 -- 172.21.15.150:0/1903162496 shutdown_connections 2024-09-15T22:16:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.765+0000 7ff506600640 1 -- 172.21.15.150:0/1903162496 wait complete. 2024-09-15T22:16:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:02 smithi154 ceph-mon[34853]: pgmap v473: 97 pgs: 97 active+clean; 942 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 328 op/s 2024-09-15T22:16:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.778+0000 7ff506600640 1 Processor -- start 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 -- start start 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff500072d80 0x7ff50019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff50010b4e0 0x7ff50019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff5001a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff500113630 con 0x7ff50010de90 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001134b0 con 0x7ff50010b4e0 2024-09-15T22:16:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.790+0000 7ff506600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5001137b0 con 0x7ff500072d80 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.791+0000 7ff4ffe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff5001a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.791+0000 7ff4ffe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff5001a5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38158/0 (socket says 172.21.15.150:38158) 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.791+0000 7ff4ffe00640 1 -- 172.21.15.150:0/1434358222 learned_addr learned my addr 172.21.15.150:0/1434358222 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.792+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff50010b4e0 0x7ff50019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.792+0000 7ff4ffe00640 1 -- 172.21.15.150:0/1434358222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff500072d80 msgr2=0x7ff50019e740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.792+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff500072d80 0x7ff50019e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.792+0000 7ff4ffe00640 1 -- 172.21.15.150:0/1434358222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff50010b4e0 msgr2=0x7ff50019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.792+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff50010b4e0 0x7ff50019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.792+0000 7ff4ffe00640 1 -- 172.21.15.150:0/1434358222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5001a6000 con 0x7ff50010de90 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.793+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff5001a5960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4f801ac00 tx=0x7ff4f8040c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.794+0000 7ff4f7e00640 1 -- 172.21.15.150:0/1434358222 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8045030 con 0x7ff50010de90 2024-09-15T22:16:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.794+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5001a6290 con 0x7ff50010de90 2024-09-15T22:16:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.794+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5001a6850 con 0x7ff50010de90 2024-09-15T22:16:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.804+0000 7ff4f7e00640 1 -- 172.21.15.150:0/1434358222 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4f804f070 con 0x7ff50010de90 2024-09-15T22:16:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.804+0000 7ff4f7e00640 1 -- 172.21.15.150:0/1434358222 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8054470 con 0x7ff50010de90 2024-09-15T22:16:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.804+0000 7ff4f7e00640 1 -- 172.21.15.150:0/1434358222 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7ff4f8048020 con 0x7ff50010de90 2024-09-15T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.811+0000 7ff509642740 1 Processor -- start 2024-09-15T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.811+0000 7ff4f7e00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff4e40a33b0 0x7ff4e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.812+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff4e40a33b0 0x7ff4e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.813+0000 7ff4f7e00640 1 -- 172.21.15.150:0/1434358222 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7ff4f8102c50 con 0x7ff50010de90 2024-09-15T22:16:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.814+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff4e40a33b0 0x7ff4e40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec006fd0 tx=0x7ff4ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.816+0000 7ff509642740 1 -- start start 2024-09-15T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.821+0000 7ff509642740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 0x564141d95660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.821+0000 7ff509642740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95ba0 0x564141d9a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.821+0000 7ff509642740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d9ac30 0x564141d9d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.821+0000 7ff509642740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x564141cfa100 con 0x564141d9ac30 2024-09-15T22:16:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.821+0000 7ff509642740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564141ca21b0 con 0x564141d95ba0 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.821+0000 7ff509642740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564141cf60c0 con 0x564141d95260 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.822+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 0x564141d95660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.822+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 0x564141d95660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:57332/0 (socket says 172.21.15.150:57332) 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.822+0000 7ff4ff400640 1 -- 172.21.15.150:0/1346259787 learned_addr learned my addr 172.21.15.150:0/1346259787 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.822+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95ba0 0x564141d9a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.823+0000 7ff4ff400640 1 -- 172.21.15.150:0/1346259787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95ba0 msgr2=0x564141d9a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.823+0000 7ff4ff400640 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95ba0 0x564141d9a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.823+0000 7ff4ff400640 1 -- 172.21.15.150:0/1346259787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d9ac30 msgr2=0x564141d9d0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.823+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d9ac30 0x564141d9d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.823+0000 7ff4ff400640 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d9ac30 0x564141d9d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.823+0000 7ff4ff400640 1 -- 172.21.15.150:0/1346259787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564141a0d210 con 0x564141d95260 2024-09-15T22:16:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.824+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d9ac30 0x564141d9d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.824+0000 7ff4ff400640 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 0x564141d95660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009770 tx=0x7ff4f0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a46e4f02fa5415b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.826+0000 7ff4f4c00640 1 -- 172.21.15.150:0/1346259787 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0015020 con 0x564141d95260 2024-09-15T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.826+0000 7ff4f4c00640 1 -- 172.21.15.150:0/1346259787 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4f0011420 con 0x564141d95260 2024-09-15T22:16:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.826+0000 7ff4f4c00640 1 -- 172.21.15.150:0/1346259787 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00105c0 con 0x564141d95260 2024-09-15T22:16:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.832+0000 7ff509642740 1 -- 172.21.15.150:0/1346259787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 msgr2=0x564141d95660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.832+0000 7ff509642740 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 0x564141d95660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009770 tx=0x7ff4f0009c30 comp rx=0 tx=0).stop 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 -- 172.21.15.150:0/1346259787 shutdown_connections 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d9ac30 0x564141d9d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95ba0 0x564141d9a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 --2- 172.21.15.150:0/1346259787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d95260 0x564141d95660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 -- 172.21.15.150:0/1346259787 >> 172.21.15.150:0/1346259787 conn(0x564141d908d0 msgr2=0x564141d90cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 -- 172.21.15.150:0/1346259787 shutdown_connections 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.856+0000 7ff509642740 1 -- 172.21.15.150:0/1346259787 wait complete. 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.857+0000 7ff509642740 1 -- start start 2024-09-15T22:16:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.857+0000 7ff509642740 1 Processor -- start 2024-09-15T22:16:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.858+0000 7ff509642740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d9f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.859+0000 7ff509642740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 0x564141d9f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.859+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d9f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.859+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d9f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:59186/0 (socket says 172.21.15.150:59186) 2024-09-15T22:16:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.860+0000 7ff4fea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 0x564141d9f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.860+0000 7ff4fea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 0x564141d9f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38174/0 (socket says 172.21.15.150:38174) 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.861+0000 7ff4ff400640 1 -- 172.21.15.150:0/1295235786 learned_addr learned my addr 172.21.15.150:0/1295235786 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.861+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.861+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.861+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x564141d9dc00 con 0x564141d95ba0 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.861+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564141c83090 con 0x564141d95260 2024-09-15T22:16:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.861+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564141d9dd80 con 0x564141d9ac30 2024-09-15T22:16:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.863+0000 7ff4fea00640 1 -- 172.21.15.150:0/1295235786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 msgr2=0x564141da6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.863+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.863+0000 7ff4fea00640 1 -- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 msgr2=0x564141d9f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.863+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d9f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.863+0000 7ff4fea00640 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564141ad9620 con 0x564141d95ba0 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.863+0000 7ff4fea00640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 0x564141d9f9c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564141d965d0 tx=0x7ff4ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9fd8ed1e37b11f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.864+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.864+0000 7ff4e9600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.864+0000 7ff4e9600640 1 -- 172.21.15.150:0/1295235786 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec024020 con 0x564141d95ba0 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.864+0000 7ff4e9600640 1 -- 172.21.15.150:0/1295235786 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7ff4ec00f040 con 0x564141d95ba0 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.865+0000 7ff509642740 10 client.0 _ll_register_callbacks cb 0x564141cd7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.865+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f0011420 con 0x564141d95ba0 2024-09-15T22:16:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.866+0000 7ff4e9600640 1 -- 172.21.15.150:0/1295235786 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff4ec012560 con 0x564141d95ba0 2024-09-15T22:16:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.892+0000 7ff509642740 10 client.15375 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.892+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({fsmap=37}) -- 0x564141da9680 con 0x564141d95ba0 2024-09-15T22:16:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff4e9600640 1 -- 172.21.15.150:0/1295235786 <== mon.0 v2:172.21.15.150:3300/0 4 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7ff4ec013070 con 0x564141d95ba0 2024-09-15T22:16:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff509642740 10 client.15375 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff509642740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff509642740 20 client.15375 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141daae20 0x564141dad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff509642740 4 client.15375 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.908+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4f0011420 con 0x564141daae20 2024-09-15T22:16:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.921+0000 7ff4ff400640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141daae20 0x564141dad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.933+0000 7ff4ff400640 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141daae20 0x564141dad2e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d95ff06af03559 server_cookie=9f09087617f3846e in_seq=0 out_seq=0 2024-09-15T22:16:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.937+0000 7ff4e9600640 10 client.15375 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.937+0000 7ff4e9600640 1 -- 172.21.15.150:0/1295235786 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff4f0011420 con 0x564141daae20 2024-09-15T22:16:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.937+0000 7ff4e9600640 10 client.15375 handle_command_reply: tid=0 2024-09-15T22:16:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.937+0000 7ff509642740 1 client.15375 shutdown 2024-09-15T22:16:02.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 msgr2=0x564141d9f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:02.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 0x564141d9f9c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564141d965d0 tx=0x7ff4ec004770 comp rx=0 tx=0).stop 2024-09-15T22:16:02.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 shutdown_connections 2024-09-15T22:16:02.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141daae20 0x564141dad2e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95ba0 0x564141d9f9c0 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564141d965d0 tx=0x7ff4ec004770 comp rx=0 tx=0).stop 2024-09-15T22:16:02.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 --2- 172.21.15.150:0/1295235786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d9f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:02.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.971+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 >> 172.21.15.150:0/1295235786 conn(0x564141d908d0 msgr2=0x564141d920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:02.977+0000 7ff4e9600640 0 client.15375 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.016+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 shutdown_connections 2024-09-15T22:16:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.020+0000 7ff509642740 1 -- 172.21.15.150:0/1295235786 wait complete. 2024-09-15T22:16:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.020+0000 7ff509642740 20 client.15375 trim_cache size 0 max 16384 2024-09-15T22:16:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.114+0000 7ff509642740 1 Processor -- start 2024-09-15T22:16:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.114+0000 7ff509642740 1 -- start start 2024-09-15T22:16:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff509642740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d96de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff509642740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d96de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d96de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:59192/0 (socket says 172.21.15.150:59192) 2024-09-15T22:16:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff4fea00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff4fea00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:57360/0 (socket says 172.21.15.150:57360) 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.118+0000 7ff509642740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d97320 0x564141d9f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.119+0000 7ff4fea00640 1 -- 172.21.15.150:0/235857813 learned_addr learned my addr 172.21.15.150:0/235857813 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.119+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d97320 0x564141d9f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.119+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e000e5e0 con 0x564141d97320 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.119+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e00102a0 con 0x564141d95260 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.119+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e000ecb0 con 0x564141d9ac30 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.120+0000 7ff4ff400640 1 -- 172.21.15.150:0/235857813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 msgr2=0x564141da69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.120+0000 7ff4ff400640 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.120+0000 7ff4ff400640 1 -- 172.21.15.150:0/235857813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d97320 msgr2=0x564141d9f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.120+0000 7ff4ff400640 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d97320 0x564141d9f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.120+0000 7ff4ff400640 1 -- 172.21.15.150:0/235857813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564141d906f0 con 0x564141d95260 2024-09-15T22:16:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.121+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d97320 0x564141d9f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.121+0000 7ff4ff400640 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d96de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0006f00 tx=0x7ff4f0011e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b87b0e784c56a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.121+0000 7ff4ebe00640 1 -- 172.21.15.150:0/235857813 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0015040 con 0x564141d95260 2024-09-15T22:16:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.122+0000 7ff4ebe00640 1 -- 172.21.15.150:0/235857813 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4f0011b90 con 0x564141d95260 2024-09-15T22:16:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.122+0000 7ff4ebe00640 1 -- 172.21.15.150:0/235857813 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0004040 con 0x564141d95260 2024-09-15T22:16:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.126+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 msgr2=0x564141d96de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.126+0000 7ff509642740 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d96de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0006f00 tx=0x7ff4f0011e00 comp rx=0 tx=0).stop 2024-09-15T22:16:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 shutdown_connections 2024-09-15T22:16:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d97320 0x564141d9f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d9ac30 0x564141da69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 --2- 172.21.15.150:0/235857813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d95260 0x564141d96de0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 >> 172.21.15.150:0/235857813 conn(0x564141d908d0 msgr2=0x564141d90cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 shutdown_connections 2024-09-15T22:16:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.127+0000 7ff509642740 1 -- 172.21.15.150:0/235857813 wait complete. 2024-09-15T22:16:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.128+0000 7ff509642740 1 -- start start 2024-09-15T22:16:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.128+0000 7ff509642740 1 Processor -- start 2024-09-15T22:16:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.135+0000 7ff509642740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 0x564141da3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.136+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 0x564141da3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.136+0000 7ff4ff400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 0x564141da3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38190/0 (socket says 172.21.15.150:38190) 2024-09-15T22:16:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.137+0000 7ff4ff400640 1 -- 172.21.15.150:0/585984410 learned_addr learned my addr 172.21.15.150:0/585984410 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.137+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d97320 0x564141da4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d9ac30 0x564141da5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e000fb10 con 0x564141d95260 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e000f380 con 0x564141d9ac30 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e000c550 con 0x564141d97320 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff509642740 10 client.0 _ll_register_callbacks cb 0x7ff4ec00d890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff4fea00640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d97320 0x564141da4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.141+0000 7ff4ffe00640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d9ac30 0x564141da5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.142+0000 7ff4fea00640 1 -- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d9ac30 msgr2=0x564141da5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.142+0000 7ff4fea00640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d9ac30 0x564141da5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.142+0000 7ff4fea00640 1 -- 172.21.15.150:0/585984410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 msgr2=0x564141da3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.142+0000 7ff4fea00640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 0x564141da3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.142+0000 7ff4fea00640 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564141da5980 con 0x564141d97320 2024-09-15T22:16:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.142+0000 7ff4ff400640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 0x564141da3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.145+0000 7ff4fea00640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d97320 0x564141da4360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000c00 tx=0x7ff4ec014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c30f3a15ad232349 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.147+0000 7ff4e9600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:16:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.147+0000 7ff4e9600640 1 -- 172.21.15.150:0/585984410 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec024040 con 0x564141d97320 2024-09-15T22:16:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.147+0000 7ff4e9600640 1 -- 172.21.15.150:0/585984410 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7ff4ec00f040 con 0x564141d97320 2024-09-15T22:16:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.147+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f0011b90 con 0x564141d97320 2024-09-15T22:16:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.148+0000 7ff4e9600640 1 -- 172.21.15.150:0/585984410 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff4ec011550 con 0x564141d97320 2024-09-15T22:16:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.148+0000 7ff509642740 10 client.25381 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.148+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564141da6d00 con 0x564141d97320 2024-09-15T22:16:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.148+0000 7ff4e9600640 1 -- 172.21.15.150:0/585984410 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4ec004020 con 0x564141d97320 2024-09-15T22:16:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff4e9600640 1 -- 172.21.15.150:0/585984410 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7ff4ec0041d0 con 0x564141d97320 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff509642740 10 client.25381 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff509642740 10 client.25381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff509642740 20 client.25381 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141e16440 0x564141e18860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff509642740 4 client.25381 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff4f0011b90 con 0x564141e16440 2024-09-15T22:16:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.150+0000 7ff4ff400640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141e16440 0x564141e18860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.151+0000 7ff4ff400640 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141e16440 0x564141e18860 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1df25a6fac55d4bf server_cookie=67bb236f3f3bbdbb in_seq=0 out_seq=0 2024-09-15T22:16:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:03.151+0000 7ff4e9600640 10 client.25381 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.100+0000 7ff4e9600640 1 -- 172.21.15.150:0/585984410 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff4f0011b90 con 0x564141e16440 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.100+0000 7ff4e9600640 10 client.25381 handle_command_reply: tid=0 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.104+0000 7ff509642740 1 client.25381 shutdown 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.105+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d97320 msgr2=0x564141da4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.105+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d97320 0x564141da4360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000c00 tx=0x7ff4ec014000 comp rx=0 tx=0).stop 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 shutdown_connections 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564141e16440 0x564141e18860 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564141d9ac30 0x564141da5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564141d97320 0x564141da4360 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000c00 tx=0x7ff4ec014000 comp rx=0 tx=0).stop 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff509642740 1 --2- 172.21.15.150:0/585984410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564141d95260 0x564141da3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff4e9600640 0 client.25381 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.106+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 >> 172.21.15.150:0/585984410 conn(0x564141d908d0 msgr2=0x564141d8f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.120+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 shutdown_connections 2024-09-15T22:16:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.132+0000 7ff509642740 1 -- 172.21.15.150:0/585984410 wait complete. 2024-09-15T22:16:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.135+0000 7ff509642740 20 client.25381 trim_cache size 0 max 16384 2024-09-15T22:16:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:16:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:16:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:16:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:16:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.175+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff4e40a33b0 msgr2=0x7ff4e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.175+0000 7ff506600640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff4e40a33b0 0x7ff4e40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec006fd0 tx=0x7ff4ec008040 comp rx=0 tx=0).stop 2024-09-15T22:16:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.175+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 msgr2=0x7ff5001a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.175+0000 7ff506600640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff5001a5960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4f801ac00 tx=0x7ff4f8040c60 comp rx=0 tx=0).stop 2024-09-15T22:16:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.176+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 shutdown_connections 2024-09-15T22:16:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.176+0000 7ff506600640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff4e40a33b0 0x7ff4e40a5870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.176+0000 7ff506600640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff50010de90 0x7ff5001a5960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.176+0000 7ff506600640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff50010b4e0 0x7ff50019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.176+0000 7ff506600640 1 --2- 172.21.15.150:0/1434358222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff500072d80 0x7ff50019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.176+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 >> 172.21.15.150:0/1434358222 conn(0x7ff50006eb50 msgr2=0x7ff50010c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.177+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 shutdown_connections 2024-09-15T22:16:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:04.177+0000 7ff506600640 1 -- 172.21.15.150:0/1434358222 wait complete. 2024-09-15T22:16:04.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:04 smithi150 ceph-mon[30886]: pgmap v474: 97 pgs: 97 active+clean; 943 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 162 op/s 2024-09-15T22:16:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:04 smithi169 ceph-mon[35850]: pgmap v474: 97 pgs: 97 active+clean; 943 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 162 op/s 2024-09-15T22:16:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:04 smithi154 ceph-mon[34853]: pgmap v474: 97 pgs: 97 active+clean; 943 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 162 op/s 2024-09-15T22:16:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:06 smithi150 ceph-mon[30886]: pgmap v475: 97 pgs: 97 active+clean; 973 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.7 MiB/s wr, 494 op/s 2024-09-15T22:16:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:06 smithi169 ceph-mon[35850]: pgmap v475: 97 pgs: 97 active+clean; 973 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.7 MiB/s wr, 494 op/s 2024-09-15T22:16:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:06 smithi154 ceph-mon[34853]: pgmap v475: 97 pgs: 97 active+clean; 973 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.7 MiB/s wr, 494 op/s 2024-09-15T22:16:08.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:08 smithi150 ceph-mon[30886]: pgmap v476: 97 pgs: 97 active+clean; 979 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 570 op/s 2024-09-15T22:16:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:08 smithi169 ceph-mon[35850]: pgmap v476: 97 pgs: 97 active+clean; 979 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 570 op/s 2024-09-15T22:16:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:08 smithi154 ceph-mon[34853]: pgmap v476: 97 pgs: 97 active+clean; 979 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 570 op/s 2024-09-15T22:16:09.411 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:09 smithi150 ceph-mon[30886]: pgmap v477: 97 pgs: 97 active+clean; 1015 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.7 MiB/s wr, 810 op/s 2024-09-15T22:16:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:09 smithi169 ceph-mon[35850]: pgmap v477: 97 pgs: 97 active+clean; 1015 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.7 MiB/s wr, 810 op/s 2024-09-15T22:16:09.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:09 smithi154 ceph-mon[34853]: pgmap v477: 97 pgs: 97 active+clean; 1015 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.7 MiB/s wr, 810 op/s 2024-09-15T22:16:11.714 INFO:tasks.workunit.client.0.smithi150.stdout: 343 537568 1116 368848 598 123069 841 2024-09-15T22:16:12.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:12 smithi150 ceph-mon[30886]: pgmap v478: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.13k op/s 2024-09-15T22:16:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:12 smithi169 ceph-mon[35850]: pgmap v478: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.13k op/s 2024-09-15T22:16:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:12 smithi154 ceph-mon[34853]: pgmap v478: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.13k op/s 2024-09-15T22:16:14.430 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:14 smithi150 ceph-mon[30886]: pgmap v479: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 1.19k op/s 2024-09-15T22:16:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:14 smithi169 ceph-mon[35850]: pgmap v479: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 1.19k op/s 2024-09-15T22:16:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:14 smithi154 ceph-mon[34853]: pgmap v479: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 1.19k op/s 2024-09-15T22:16:16.326 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:16 smithi150 ceph-mon[30886]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 23 MiB/s wr, 1.46k op/s 2024-09-15T22:16:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:16 smithi169 ceph-mon[35850]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 23 MiB/s wr, 1.46k op/s 2024-09-15T22:16:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:16 smithi154 ceph-mon[34853]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 23 MiB/s wr, 1.46k op/s 2024-09-15T22:16:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:18 smithi150 ceph-mon[30886]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 23 MiB/s wr, 1.27k op/s 2024-09-15T22:16:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:18 smithi169 ceph-mon[35850]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 23 MiB/s wr, 1.27k op/s 2024-09-15T22:16:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:18 smithi154 ceph-mon[34853]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 23 MiB/s wr, 1.27k op/s 2024-09-15T22:16:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.326+0000 7fc571e00640 1 -- 172.21.15.150:0/858716375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c109700 msgr2=0x7fc56c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.326+0000 7fc571e00640 1 --2- 172.21.15.150:0/858716375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c109700 0x7fc56c109b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009860 tx=0x7fc55c02a380 comp rx=0 tx=0).stop 2024-09-15T22:16:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.348+0000 7fc571e00640 1 -- 172.21.15.150:0/858716375 shutdown_connections 2024-09-15T22:16:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.348+0000 7fc571e00640 1 --2- 172.21.15.150:0/858716375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c0736c0 0x7fc56c119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.348+0000 7fc571e00640 1 --2- 172.21.15.150:0/858716375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc56c072d20 0x7fc56c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.348+0000 7fc571e00640 1 --2- 172.21.15.150:0/858716375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c109700 0x7fc56c109b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.348+0000 7fc571e00640 1 -- 172.21.15.150:0/858716375 >> 172.21.15.150:0/858716375 conn(0x7fc56c06ece0 msgr2=0x7fc56c071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.350+0000 7fc571e00640 1 -- 172.21.15.150:0/858716375 shutdown_connections 2024-09-15T22:16:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.350+0000 7fc571e00640 1 -- 172.21.15.150:0/858716375 wait complete. 2024-09-15T22:16:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.351+0000 7fc571e00640 1 Processor -- start 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 -- start start 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc56c072d20 0x7fc56c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c0736c0 0x7fc56c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 0x7fc56c1a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c113580 con 0x7fc56c109700 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c113400 con 0x7fc56c072d20 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.377+0000 7fc571e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c113700 con 0x7fc56c0736c0 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.378+0000 7fc56b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 0x7fc56c1a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.378+0000 7fc56b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 0x7fc56c1a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37040/0 (socket says 172.21.15.150:37040) 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.378+0000 7fc56b400640 1 -- 172.21.15.150:0/1492104565 learned_addr learned my addr 172.21.15.150:0/1492104565 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.379+0000 7fc56a000640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c0736c0 0x7fc56c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.379+0000 7fc56b400640 1 -- 172.21.15.150:0/1492104565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c0736c0 msgr2=0x7fc56c19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.379+0000 7fc56b400640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c0736c0 0x7fc56c19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.379+0000 7fc56b400640 1 -- 172.21.15.150:0/1492104565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc56c072d20 msgr2=0x7fc56c19e8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.379+0000 7fc56b400640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc56c072d20 0x7fc56c19e8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.379+0000 7fc56b400640 1 -- 172.21.15.150:0/1492104565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c1a5ff0 con 0x7fc56c109700 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.380+0000 7fc56b400640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 0x7fc56c1a5980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc564009fd0 tx=0x7fc56400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.381+0000 7fc570a00640 1 -- 172.21.15.150:0/1492104565 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564017070 con 0x7fc56c109700 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.381+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c074480 con 0x7fc56c109700 2024-09-15T22:16:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.381+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c0749d0 con 0x7fc56c109700 2024-09-15T22:16:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.393+0000 7fc570a00640 1 -- 172.21.15.150:0/1492104565 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564003e50 con 0x7fc56c109700 2024-09-15T22:16:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.393+0000 7fc570a00640 1 -- 172.21.15.150:0/1492104565 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5640106c0 con 0x7fc56c109700 2024-09-15T22:16:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.395+0000 7fc574bca740 1 Processor -- start 2024-09-15T22:16:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.399+0000 7fc570a00640 1 -- 172.21.15.150:0/1492104565 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fc564010920 con 0x7fc56c109700 2024-09-15T22:16:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 -- start start 2024-09-15T22:16:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559052281090 0x559052281490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x559052286490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052286a60 0x559052288f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5590521e6100 con 0x559052286a60 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55905218e1b0 con 0x559052281090 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.401+0000 7fc574bca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5590521e20c0 con 0x5590522819d0 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.402+0000 7fc56aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x559052286490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.402+0000 7fc56aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x559052286490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:55756/0 (socket says 172.21.15.150:55756) 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.402+0000 7fc56aa00640 1 -- 172.21.15.150:0/1257992084 learned_addr learned my addr 172.21.15.150:0/1257992084 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.402+0000 7fc56a000640 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559052281090 0x559052281490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.403+0000 7fc56a000640 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052286a60 0x559052288f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.404+0000 7fc56a000640 1 -- 172.21.15.150:0/1257992084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 msgr2=0x559052286490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.404+0000 7fc56a000640 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x559052286490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.404+0000 7fc56a000640 1 -- 172.21.15.150:0/1257992084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559052281090 msgr2=0x559052281490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.404+0000 7fc56a000640 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559052281090 0x559052281490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.404+0000 7fc56a000640 1 -- 172.21.15.150:0/1257992084 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559051ef9210 con 0x559052286a60 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.404+0000 7fc56a000640 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052286a60 0x559052288f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc55801af80 tx=0x7fc558004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461863e3be2b98c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.429+0000 7fc557e00640 1 -- 172.21.15.150:0/1257992084 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558026da0 con 0x559052286a60 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.429+0000 7fc557e00640 1 -- 172.21.15.150:0/1257992084 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558005500 con 0x559052286a60 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.429+0000 7fc557e00640 1 -- 172.21.15.150:0/1257992084 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558004a00 con 0x559052286a60 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 -- 172.21.15.150:0/1257992084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052286a60 msgr2=0x559052288f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052286a60 0x559052288f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc55801af80 tx=0x7fc558004730 comp rx=0 tx=0).stop 2024-09-15T22:16:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 -- 172.21.15.150:0/1257992084 shutdown_connections 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052286a60 0x559052288f20 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc55801af80 tx=0x7fc558004730 comp rx=0 tx=0).stop 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x559052286490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 --2- 172.21.15.150:0/1257992084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559052281090 0x559052281490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.433+0000 7fc574bca740 1 -- 172.21.15.150:0/1257992084 >> 172.21.15.150:0/1257992084 conn(0x55905227c700 msgr2=0x55905227cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.434+0000 7fc574bca740 1 -- 172.21.15.150:0/1257992084 shutdown_connections 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.434+0000 7fc574bca740 1 -- 172.21.15.150:0/1257992084 wait complete. 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.434+0000 7fc574bca740 1 -- start start 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.435+0000 7fc574bca740 1 Processor -- start 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x5590522cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x5590522d6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559052289a30 con 0x559052281090 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55905216f090 con 0x5590522d4a10 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559052289bb0 con 0x5590522819d0 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc574bca740 10 client.0 _ll_register_callbacks cb 0x5590521c3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc56aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x5590522cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc56aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x5590522cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:55770/0 (socket says 172.21.15.150:55770) 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.441+0000 7fc56aa00640 1 -- 172.21.15.150:0/2043084067 learned_addr learned my addr 172.21.15.150:0/2043084067 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.442+0000 7fc56aa00640 1 -- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 msgr2=0x5590522d6e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.442+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x5590522d6e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.442+0000 7fc56aa00640 1 -- 172.21.15.150:0/2043084067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 msgr2=0x5590522cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.442+0000 7fc56a000640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.442+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.443+0000 7fc56aa00640 1 -- 172.21.15.150:0/2043084067 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559051fc5620 con 0x5590522819d0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.443+0000 7fc56a000640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.443+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x5590522cf9e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009860 tx=0x7fc55c0308e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6650f430005cd712 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.443+0000 7fc554c00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.444+0000 7fc554c00640 1 -- 172.21.15.150:0/2043084067 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c037040 con 0x5590522819d0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.444+0000 7fc554c00640 1 -- 172.21.15.150:0/2043084067 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc55c004030 con 0x5590522819d0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.445+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc558005500 con 0x5590522819d0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.446+0000 7fc554c00640 1 -- 172.21.15.150:0/2043084067 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc55c037040 con 0x5590522819d0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.446+0000 7fc574bca740 10 client.25390 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.446+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5590522d9c60 con 0x5590522819d0 2024-09-15T22:16:20.454 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.447+0000 7fc554c00640 1 -- 172.21.15.150:0/2043084067 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc55c030a50 con 0x5590522819d0 2024-09-15T22:16:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc554c00640 1 -- 172.21.15.150:0/2043084067 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7fc55c044030 con 0x5590522819d0 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc574bca740 10 client.25390 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc574bca740 10 client.25390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc574bca740 20 client.25390 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc574bca740 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5590522db8d0 0x5590522ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc574bca740 4 client.25390 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.448+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc558005500 con 0x5590522db8d0 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.449+0000 7fc56a000640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5590522db8d0 0x5590522ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.450+0000 7fc56a000640 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5590522db8d0 0x5590522ddd70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd03ff4daf0b041 server_cookie=5df50168088c48af in_seq=0 out_seq=0 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.450+0000 7fc554c00640 10 client.25390 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.451+0000 7fc570a00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc5500c5360 0x7fc5500c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.451+0000 7fc570a00640 1 -- 172.21.15.150:0/1492104565 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc5640cf770 con 0x7fc56c109700 2024-09-15T22:16:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.452+0000 7fc56a000640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc5500c5360 0x7fc5500c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.453+0000 7fc56a000640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc5500c5360 0x7fc5500c7820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5590522de620 tx=0x7fc55800e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.453+0000 7fc554c00640 1 -- 172.21.15.150:0/2043084067 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc558005500 con 0x5590522db8d0 2024-09-15T22:16:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.453+0000 7fc554c00640 10 client.25390 handle_command_reply: tid=0 2024-09-15T22:16:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.453+0000 7fc574bca740 1 client.25390 shutdown 2024-09-15T22:16:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.457+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 msgr2=0x5590522cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.457+0000 7fc574bca740 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x5590522cf9e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009860 tx=0x7fc55c0308e0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.459+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 shutdown_connections 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.459+0000 7fc574bca740 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5590522db8d0 0x5590522ddd70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.459+0000 7fc574bca740 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x5590522d6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.459+0000 7fc574bca740 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590522819d0 0x5590522cf9e0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009860 tx=0x7fc55c0308e0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.459+0000 7fc574bca740 1 --2- 172.21.15.150:0/2043084067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.459+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 >> 172.21.15.150:0/2043084067 conn(0x55905227c700 msgr2=0x55905227df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.461+0000 7fc554c00640 0 client.25390 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.461+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 shutdown_connections 2024-09-15T22:16:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.461+0000 7fc574bca740 1 -- 172.21.15.150:0/2043084067 wait complete. 2024-09-15T22:16:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.461+0000 7fc574bca740 20 client.25390 trim_cache size 0 max 16384 2024-09-15T22:16:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.560+0000 7fc574bca740 1 Processor -- start 2024-09-15T22:16:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.567+0000 7fc574bca740 1 -- start start 2024-09-15T22:16:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.569+0000 7fc574bca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052281090 0x559052289910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.570+0000 7fc574bca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x55905227b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.570+0000 7fc574bca740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 0x55905227daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.572+0000 7fc56b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 0x55905227daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.572+0000 7fc56b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 0x55905227daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37070/0 (socket says 172.21.15.150:37070) 2024-09-15T22:16:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.572+0000 7fc56b400640 1 -- 172.21.15.150:0/3688663786 learned_addr learned my addr 172.21.15.150:0/3688663786 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.572+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00e440 con 0x559052283360 2024-09-15T22:16:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.572+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c010100 con 0x5590522d4a10 2024-09-15T22:16:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.572+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00eb10 con 0x559052281090 2024-09-15T22:16:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.573+0000 7fc56b400640 1 -- 172.21.15.150:0/3688663786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052281090 msgr2=0x559052289910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.573+0000 7fc56aa00640 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052281090 0x559052289910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.573+0000 7fc56b400640 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052281090 0x559052289910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.573+0000 7fc56b400640 1 -- 172.21.15.150:0/3688663786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 msgr2=0x55905227b770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:16:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.573+0000 7fc56b400640 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x55905227b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.573+0000 7fc56b400640 1 -- 172.21.15.150:0/3688663786 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559052277d60 con 0x559052283360 2024-09-15T22:16:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.575+0000 7fc56b400640 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 0x55905227daf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc56409cac0 tx=0x7fc56409cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241a0b0f433087aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.576+0000 7fc557400640 1 -- 172.21.15.150:0/3688663786 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564020070 con 0x559052283360 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.576+0000 7fc557400640 1 -- 172.21.15.150:0/3688663786 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5640cd350 con 0x559052283360 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.576+0000 7fc557400640 1 -- 172.21.15.150:0/3688663786 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56409c210 con 0x559052283360 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.590+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 msgr2=0x55905227daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.590+0000 7fc574bca740 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 0x55905227daf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc56409cac0 tx=0x7fc56409cdc0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.592+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 shutdown_connections 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.592+0000 7fc574bca740 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052283360 0x55905227daf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.592+0000 7fc574bca740 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x55905227b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.592+0000 7fc574bca740 1 --2- 172.21.15.150:0/3688663786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052281090 0x559052289910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.592+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 >> 172.21.15.150:0/3688663786 conn(0x55905227c700 msgr2=0x55905227b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.599+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 shutdown_connections 2024-09-15T22:16:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.599+0000 7fc574bca740 1 -- 172.21.15.150:0/3688663786 wait complete. 2024-09-15T22:16:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.600+0000 7fc574bca740 1 -- start start 2024-09-15T22:16:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.600+0000 7fc574bca740 1 Processor -- start 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.615+0000 7fc574bca740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.615+0000 7fc574bca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052283360 0x5590522edb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.615+0000 7fc574bca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x5590522eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc574bca740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00f970 con 0x559052281090 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc574bca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00f1e0 con 0x5590522d4a10 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc574bca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00c4d0 con 0x559052283360 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc574bca740 10 client.0 _ll_register_callbacks cb 0x7fc55c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc56a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052283360 0x5590522edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc56a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052283360 0x5590522edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:55790/0 (socket says 172.21.15.150:55790) 2024-09-15T22:16:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.616+0000 7fc56a000640 1 -- 172.21.15.150:0/2529784169 learned_addr learned my addr 172.21.15.150:0/2529784169 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.617+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.623+0000 7fc56aa00640 1 -- 172.21.15.150:0/2529784169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052283360 msgr2=0x5590522edb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.623+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052283360 0x5590522edb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.623+0000 7fc56aa00640 1 -- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 msgr2=0x5590522eeb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:16:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.623+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x5590522eeb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.623+0000 7fc56aa00640 1 -- 172.21.15.150:0/2529784169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590522867c0 con 0x559052281090 2024-09-15T22:16:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.625+0000 7fc56aa00640 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522ed5c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc55c033000 tx=0x7fc55c005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c7f88515fdb2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.641+0000 7fc554c00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.641+0000 7fc554c00640 1 -- 172.21.15.150:0/2529784169 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c052020 con 0x559052281090 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.641+0000 7fc554c00640 1 -- 172.21.15.150:0/2529784169 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc55c005130 con 0x559052281090 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.654+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5640cd350 con 0x559052281090 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.662+0000 7fc554c00640 1 -- 172.21.15.150:0/2529784169 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc55c005370 con 0x559052281090 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.662+0000 7fc574bca740 10 client.15393 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.662+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5590523465a0 con 0x559052281090 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc554c00640 1 -- 172.21.15.150:0/2529784169 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5640cd350 con 0x559052281090 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc554c00640 1 -- 172.21.15.150:0/2529784169 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7fc55c04d070 con 0x559052281090 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc574bca740 10 client.15393 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc574bca740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc574bca740 20 client.15393 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc574bca740 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559052346f60 0x559052349380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc574bca740 4 client.15393 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:16:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.663+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590521f3830 con 0x559052346f60 2024-09-15T22:16:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.669+0000 7fc56a000640 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559052346f60 0x559052349380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.672+0000 7fc56a000640 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559052346f60 0x559052349380 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d991196424489a server_cookie=7bc1d57bf647f108 in_seq=0 out_seq=0 2024-09-15T22:16:20.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:20 smithi150 ceph-mon[30886]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 23 MiB/s wr, 1.17k op/s 2024-09-15T22:16:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:20.675+0000 7fc554c00640 10 client.15393 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:20 smithi169 ceph-mon[35850]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 23 MiB/s wr, 1.17k op/s 2024-09-15T22:16:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:20 smithi154 ceph-mon[34853]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 23 MiB/s wr, 1.17k op/s 2024-09-15T22:16:21.716 INFO:tasks.workunit.client.0.smithi150.stdout: 380 642021 1775 440844 1620 153761 2207 2024-09-15T22:16:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.058+0000 7fc554c00640 1 -- 172.21.15.150:0/2529784169 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590521f3830 con 0x559052346f60 2024-09-15T22:16:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.058+0000 7fc554c00640 10 client.15393 handle_command_reply: tid=0 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 client.15393 shutdown 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 msgr2=0x5590522ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522ed5c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc55c033000 tx=0x7fc55c005f80 comp rx=0 tx=0).stop 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 shutdown_connections 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559052346f60 0x559052349380 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590522d4a10 0x5590522eeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559052283360 0x5590522edb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 --2- 172.21.15.150:0/2529784169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559052281090 0x5590522ed5c0 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc55c033000 tx=0x7fc55c005f80 comp rx=0 tx=0).stop 2024-09-15T22:16:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.059+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 >> 172.21.15.150:0/2529784169 conn(0x55905227c700 msgr2=0x55905227b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.060+0000 7fc554c00640 0 client.15393 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.065+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 shutdown_connections 2024-09-15T22:16:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.068+0000 7fc574bca740 1 -- 172.21.15.150:0/2529784169 wait complete. 2024-09-15T22:16:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.068+0000 7fc574bca740 20 client.15393 trim_cache size 0 max 16384 2024-09-15T22:16:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:16:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:16:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:16:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:16:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc5500c5360 msgr2=0x7fc5500c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc5500c5360 0x7fc5500c7820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5590522de620 tx=0x7fc55800e040 comp rx=0 tx=0).stop 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 msgr2=0x7fc56c1a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 0x7fc56c1a5980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc564009fd0 tx=0x7fc56400b260 comp rx=0 tx=0).stop 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 shutdown_connections 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc5500c5360 0x7fc5500c7820 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc56c109700 0x7fc56c1a5980 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc56c0736c0 0x7fc56c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 --2- 172.21.15.150:0/1492104565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc56c072d20 0x7fc56c19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.097+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 >> 172.21.15.150:0/1492104565 conn(0x7fc56c06ece0 msgr2=0x7fc56c115ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.113+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 shutdown_connections 2024-09-15T22:16:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:22.117+0000 7fc571e00640 1 -- 172.21.15.150:0/1492104565 wait complete. 2024-09-15T22:16:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:22 smithi150 ceph-mon[30886]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 20 MiB/s wr, 988 op/s 2024-09-15T22:16:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:22 smithi169 ceph-mon[35850]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 20 MiB/s wr, 988 op/s 2024-09-15T22:16:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:22 smithi154 ceph-mon[34853]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 20 MiB/s wr, 988 op/s 2024-09-15T22:16:24.690 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:24 smithi150 ceph-mon[30886]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 688 op/s 2024-09-15T22:16:24.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:24 smithi169 ceph-mon[35850]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 688 op/s 2024-09-15T22:16:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:24 smithi154 ceph-mon[34853]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 688 op/s 2024-09-15T22:16:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:25 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:25.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:25 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:25 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:26.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:26 smithi150 ceph-mon[30886]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 969 op/s 2024-09-15T22:16:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:26 smithi169 ceph-mon[35850]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 969 op/s 2024-09-15T22:16:26.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:26 smithi154 ceph-mon[34853]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 969 op/s 2024-09-15T22:16:27.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:27 smithi150 ceph-mon[30886]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.4 MiB/s wr, 830 op/s 2024-09-15T22:16:27.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:27 smithi169 ceph-mon[35850]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.4 MiB/s wr, 830 op/s 2024-09-15T22:16:27.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:27 smithi154 ceph-mon[34853]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.4 MiB/s wr, 830 op/s 2024-09-15T22:16:30.683 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:30 smithi150 ceph-mon[30886]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 721 op/s 2024-09-15T22:16:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:30 smithi169 ceph-mon[35850]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 721 op/s 2024-09-15T22:16:30.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:30 smithi154 ceph-mon[34853]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 721 op/s 2024-09-15T22:16:31.718 INFO:tasks.workunit.client.0.smithi150.stdout: 415 676579 2121 459625 1807 167436 724 2024-09-15T22:16:32.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:32 smithi150 ceph-mon[30886]: pgmap v488: 97 pgs: 97 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 779 op/s 2024-09-15T22:16:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:32 smithi169 ceph-mon[35850]: pgmap v488: 97 pgs: 97 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 779 op/s 2024-09-15T22:16:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:32 smithi154 ceph-mon[34853]: pgmap v488: 97 pgs: 97 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 779 op/s 2024-09-15T22:16:34.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:34 smithi150 ceph-mon[30886]: pgmap v489: 97 pgs: 97 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 736 op/s 2024-09-15T22:16:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:34 smithi169 ceph-mon[35850]: pgmap v489: 97 pgs: 97 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 736 op/s 2024-09-15T22:16:34.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:34 smithi154 ceph-mon[34853]: pgmap v489: 97 pgs: 97 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 736 op/s 2024-09-15T22:16:36.526 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:36 smithi150 ceph-mon[30886]: pgmap v490: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.8 MiB/s wr, 809 op/s 2024-09-15T22:16:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:36 smithi169 ceph-mon[35850]: pgmap v490: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.8 MiB/s wr, 809 op/s 2024-09-15T22:16:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:36 smithi154 ceph-mon[34853]: pgmap v490: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.8 MiB/s wr, 809 op/s 2024-09-15T22:16:37.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:37 smithi150 ceph-mon[30886]: pgmap v491: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.9 MiB/s wr, 574 op/s 2024-09-15T22:16:37.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:37 smithi169 ceph-mon[35850]: pgmap v491: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.9 MiB/s wr, 574 op/s 2024-09-15T22:16:37.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:37 smithi154 ceph-mon[34853]: pgmap v491: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.9 MiB/s wr, 574 op/s 2024-09-15T22:16:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.886+0000 7fd3f1200640 1 -- 172.21.15.150:0/2218399125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a56a0 msgr2=0x7fd3e40a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.886+0000 7fd3f1200640 1 --2- 172.21.15.150:0/2218399125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40a5b20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009860 tx=0x7fd3dc02a3d0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.892+0000 7fd3f1200640 1 -- 172.21.15.150:0/2218399125 shutdown_connections 2024-09-15T22:16:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.892+0000 7fd3f1200640 1 --2- 172.21.15.150:0/2218399125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e40a6060 0x7fd3e40aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.892+0000 7fd3f1200640 1 --2- 172.21.15.150:0/2218399125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40a5b20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.892+0000 7fd3f1200640 1 --2- 172.21.15.150:0/2218399125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a4570 0x7fd3e40a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.892+0000 7fd3f1200640 1 -- 172.21.15.150:0/2218399125 >> 172.21.15.150:0/2218399125 conn(0x7fd3e409fbd0 msgr2=0x7fd3e40a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.894+0000 7fd3f1200640 1 -- 172.21.15.150:0/2218399125 shutdown_connections 2024-09-15T22:16:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.894+0000 7fd3f1200640 1 -- 172.21.15.150:0/2218399125 wait complete. 2024-09-15T22:16:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.895+0000 7fd3f1200640 1 Processor -- start 2024-09-15T22:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.902+0000 7fd3f1200640 1 -- start start 2024-09-15T22:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.903+0000 7fd3f1200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e40a4570 0x7fd3e40b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.903+0000 7fd3f1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.903+0000 7fd3f1200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a6060 0x7fd3e4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.903+0000 7fd3f1200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e40b89a0 con 0x7fd3e40a56a0 2024-09-15T22:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.903+0000 7fd3f1200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e40b8820 con 0x7fd3e40a4570 2024-09-15T22:16:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.903+0000 7fd3f1200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e40b8b20 con 0x7fd3e40a6060 2024-09-15T22:16:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.904+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.904+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37532/0 (socket says 172.21.15.150:37532) 2024-09-15T22:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.904+0000 7fd3e9400640 1 -- 172.21.15.150:0/952159573 learned_addr learned my addr 172.21.15.150:0/952159573 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.904+0000 7fd3ea800640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a6060 0x7fd3e4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.905+0000 7fd3e9400640 1 -- 172.21.15.150:0/952159573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a6060 msgr2=0x7fd3e4153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.905+0000 7fd3e9400640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a6060 0x7fd3e4153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.905+0000 7fd3e9400640 1 -- 172.21.15.150:0/952159573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e40a4570 msgr2=0x7fd3e40b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.905+0000 7fd3e9400640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e40a4570 0x7fd3e40b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.905+0000 7fd3e9400640 1 -- 172.21.15.150:0/952159573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e40b6620 con 0x7fd3e40a56a0 2024-09-15T22:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.908+0000 7fd3e9400640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40b34a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0052e0 tx=0x7fd3dc005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.924+0000 7fd3e2a00640 1 -- 172.21.15.150:0/952159573 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc040070 con 0x7fd3e40a56a0 2024-09-15T22:16:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.924+0000 7fd3e2a00640 1 -- 172.21.15.150:0/952159573 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3dc0046c0 con 0x7fd3e40a56a0 2024-09-15T22:16:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.924+0000 7fd3e2a00640 1 -- 172.21.15.150:0/952159573 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0456c0 con 0x7fd3e40a56a0 2024-09-15T22:16:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.924+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e41535d0 con 0x7fd3e40a56a0 2024-09-15T22:16:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.924+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e4153980 con 0x7fd3e40a56a0 2024-09-15T22:16:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.947+0000 7fd3f40b1740 1 Processor -- start 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.958+0000 7fd3e2a00640 1 -- 172.21.15.150:0/952159573 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fd3dc039040 con 0x7fd3e40a56a0 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3e2a00640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3d00a3450 0x7fd3d00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 -- start start 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ce1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ce6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609ce90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559609c46100 con 0x559609ce1260 2024-09-15T22:16:39.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559609bee1b0 con 0x559609ce1ba0 2024-09-15T22:16:39.970 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.961+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559609c420c0 con 0x559609ce6c30 2024-09-15T22:16:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.975+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ce6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.976+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ce6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:35842/0 (socket says 172.21.15.150:35842) 2024-09-15T22:16:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.976+0000 7fd3e9400640 1 -- 172.21.15.150:0/2262786376 learned_addr learned my addr 172.21.15.150:0/2262786376 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.981+0000 7fd3e2a00640 1 -- 172.21.15.150:0/952159573 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fd3dc0f0a00 con 0x7fd3e40a56a0 2024-09-15T22:16:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.984+0000 7fd3ea800640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3d00a3450 0x7fd3d00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.985+0000 7fd3e9400640 1 -- 172.21.15.150:0/2262786376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 msgr2=0x559609ce90f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:16:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.985+0000 7fd3e9400640 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609ce90f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.985+0000 7fd3e9400640 1 -- 172.21.15.150:0/2262786376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 msgr2=0x559609ce1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.985+0000 7fd3e9400640 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ce1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.985+0000 7fd3e9400640 1 -- 172.21.15.150:0/2262786376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559609959210 con 0x559609ce1ba0 2024-09-15T22:16:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.991+0000 7fd3e9400640 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ce6660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0b93f0 tx=0x7fd3dc02a3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591b2ccea9ca42d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.993+0000 7fd3d7400640 1 -- 172.21.15.150:0/2262786376 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0dd070 con 0x559609ce1ba0 2024-09-15T22:16:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.993+0000 7fd3d7400640 1 -- 172.21.15.150:0/2262786376 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3dc0bd690 con 0x559609ce1ba0 2024-09-15T22:16:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.993+0000 7fd3d7400640 1 -- 172.21.15.150:0/2262786376 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004c00 con 0x559609ce1ba0 2024-09-15T22:16:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:39.995+0000 7fd3ea800640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3d00a3450 0x7fd3d00a5910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009bc0 tx=0x7fd3d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.007+0000 7fd3f40b1740 1 -- 172.21.15.150:0/2262786376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 msgr2=0x559609ce6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.007+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ce6660 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0b93f0 tx=0x7fd3dc02a3d0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.010+0000 7fd3f40b1740 1 -- 172.21.15.150:0/2262786376 shutdown_connections 2024-09-15T22:16:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.010+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609ce90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.010+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ce6660 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.010+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/2262786376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ce1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.010+0000 7fd3f40b1740 1 -- 172.21.15.150:0/2262786376 >> 172.21.15.150:0/2262786376 conn(0x559609cdc8d0 msgr2=0x559609cdccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.026+0000 7fd3f40b1740 1 -- 172.21.15.150:0/2262786376 shutdown_connections 2024-09-15T22:16:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.026+0000 7fd3f40b1740 1 -- 172.21.15.150:0/2262786376 wait complete. 2024-09-15T22:16:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.028+0000 7fd3f40b1740 1 -- start start 2024-09-15T22:16:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.029+0000 7fd3f40b1740 1 Processor -- start 2024-09-15T22:16:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.036+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ceb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.037+0000 7fd3e9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ceb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.038+0000 7fd3e9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ceb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37544/0 (socket says 172.21.15.150:37544) 2024-09-15T22:16:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.038+0000 7fd3e9e00640 1 -- 172.21.15.150:0/777242563 learned_addr learned my addr 172.21.15.150:0/777242563 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.038+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ceb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.039+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.040+0000 7fd3e9400640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ceb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.040+0000 7fd3ea800640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.042+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559609bee1b0 con 0x559609ce1260 2024-09-15T22:16:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.042+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559609bcf090 con 0x559609ce1ba0 2024-09-15T22:16:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.042+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559609ce99c0 con 0x559609ce6c30 2024-09-15T22:16:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.042+0000 7fd3f40b1740 10 client.0 _ll_register_callbacks cb 0x559609c23f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.043+0000 7fd3e9400640 1 -- 172.21.15.150:0/777242563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 msgr2=0x559609cf2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.043+0000 7fd3e9400640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.043+0000 7fd3e9400640 1 -- 172.21.15.150:0/777242563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 msgr2=0x559609ceb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.043+0000 7fd3e9400640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ceb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.043+0000 7fd3e9400640 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559609a25620 con 0x559609ce1ba0 2024-09-15T22:16:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.045+0000 7fd3ea800640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.048+0000 7fd3e9400640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ceb620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0bcf20 tx=0x7fd3dc004e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26fc840c7c913c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.059+0000 7fd3cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:16:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.059+0000 7fd3cbe00640 1 -- 172.21.15.150:0/777242563 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0c1340 con 0x559609ce1ba0 2024-09-15T22:16:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.059+0000 7fd3cbe00640 1 -- 172.21.15.150:0/777242563 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fd3dc0dbbd0 con 0x559609ce1ba0 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.065+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3dc0bd690 con 0x559609ce1ba0 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.066+0000 7fd3cbe00640 1 -- 172.21.15.150:0/777242563 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd3dc0cd050 con 0x559609ce1ba0 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.066+0000 7fd3f40b1740 10 client.25415 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.066+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559609cf5450 con 0x559609ce1ba0 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.067+0000 7fd3cbe00640 1 -- 172.21.15.150:0/777242563 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3dc0bd690 con 0x559609ce1ba0 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.067+0000 7fd3cbe00640 1 -- 172.21.15.150:0/777242563 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7fd3dc04d020 con 0x559609ce1ba0 2024-09-15T22:16:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.068+0000 7fd3f40b1740 10 client.25415 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.068+0000 7fd3f40b1740 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.068+0000 7fd3f40b1740 20 client.25415 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.069+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609cf67c0 0x559609cf8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.069+0000 7fd3f40b1740 4 client.25415 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.069+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559609c53830 con 0x559609cf67c0 2024-09-15T22:16:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.070+0000 7fd3e9e00640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609cf67c0 0x559609cf8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.083+0000 7fd3e9e00640 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609cf67c0 0x559609cf8bd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3ce1723cf71f2a server_cookie=8daf6c933946f85e in_seq=0 out_seq=0 2024-09-15T22:16:40.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.084+0000 7fd3cbe00640 10 client.25415 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:40.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.088+0000 7fd3cbe00640 1 -- 172.21.15.150:0/777242563 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559609c53830 con 0x559609cf67c0 2024-09-15T22:16:40.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.088+0000 7fd3cbe00640 10 client.25415 handle_command_reply: tid=0 2024-09-15T22:16:40.093 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.092+0000 7fd3f40b1740 1 client.25415 shutdown 2024-09-15T22:16:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.114+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 msgr2=0x559609ceb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.114+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ceb620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0bcf20 tx=0x7fd3dc004e30 comp rx=0 tx=0).stop 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 shutdown_connections 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609cf67c0 0x559609cf8bd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1ba0 0x559609ceb620 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0bcf20 tx=0x7fd3dc004e30 comp rx=0 tx=0).stop 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/777242563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce1260 0x559609ceb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 >> 172.21.15.150:0/777242563 conn(0x559609cdc8d0 msgr2=0x559609cde0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.123+0000 7fd3cbe00640 0 client.25415 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.150+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 shutdown_connections 2024-09-15T22:16:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.150+0000 7fd3f40b1740 1 -- 172.21.15.150:0/777242563 wait complete. 2024-09-15T22:16:40.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.151+0000 7fd3f40b1740 20 client.25415 trim_cache size 0 max 16384 2024-09-15T22:16:40.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:40 smithi150 ceph-mon[30886]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 731 op/s 2024-09-15T22:16:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:40 smithi169 ceph-mon[35850]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 731 op/s 2024-09-15T22:16:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:40 smithi154 ceph-mon[34853]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 731 op/s 2024-09-15T22:16:40.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.822+0000 7fd3f40b1740 1 Processor -- start 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 -- start start 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1260 0x559609cf2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609cdb900 0x559609cdbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc00e600 con 0x559609cdb900 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0102c0 con 0x559609ce1260 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.855+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc00ecd0 con 0x559609ce6c30 2024-09-15T22:16:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.856+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.856+0000 7fd3e9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:36732/0 (socket says 172.21.15.150:36732) 2024-09-15T22:16:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.856+0000 7fd3e9400640 1 -- 172.21.15.150:0/3089929427 learned_addr learned my addr 172.21.15.150:0/3089929427 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:40.862 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.857+0000 7fd3e9400640 1 -- 172.21.15.150:0/3089929427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1260 msgr2=0x559609cf2d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:16:40.862 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.857+0000 7fd3e9400640 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1260 0x559609cf2d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.857+0000 7fd3e9400640 1 -- 172.21.15.150:0/3089929427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609cdb900 msgr2=0x559609cdbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.857+0000 7fd3e9400640 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609cdb900 0x559609cdbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.857+0000 7fd3e9400640 1 -- 172.21.15.150:0/3089929427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559609cdc6f0 con 0x559609ce6c30 2024-09-15T22:16:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.862+0000 7fd3e9400640 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0b8c70 tx=0x7fd3dc02a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ba6a68ce58df67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:40.878 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.877+0000 7fd3d6a00640 1 -- 172.21.15.150:0/3089929427 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0c1340 con 0x559609ce6c30 2024-09-15T22:16:40.878 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.877+0000 7fd3d6a00640 1 -- 172.21.15.150:0/3089929427 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3dc0c5e50 con 0x559609ce6c30 2024-09-15T22:16:40.878 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.877+0000 7fd3d6a00640 1 -- 172.21.15.150:0/3089929427 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0bc5a0 con 0x559609ce6c30 2024-09-15T22:16:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.892+0000 7fd3f40b1740 1 -- 172.21.15.150:0/3089929427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 msgr2=0x559609cf2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.892+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0b8c70 tx=0x7fd3dc02a3d0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.929+0000 7fd3f40b1740 1 -- 172.21.15.150:0/3089929427 shutdown_connections 2024-09-15T22:16:40.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.929+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609cdb900 0x559609cdbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.929+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce6c30 0x559609cf2620 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.929+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/3089929427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609ce1260 0x559609cf2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.929+0000 7fd3f40b1740 1 -- 172.21.15.150:0/3089929427 >> 172.21.15.150:0/3089929427 conn(0x559609cdc8d0 msgr2=0x559609cdb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:40.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.958+0000 7fd3f40b1740 1 -- 172.21.15.150:0/3089929427 shutdown_connections 2024-09-15T22:16:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.979+0000 7fd3f40b1740 1 -- 172.21.15.150:0/3089929427 wait complete. 2024-09-15T22:16:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.979+0000 7fd3f40b1740 1 -- start start 2024-09-15T22:16:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.979+0000 7fd3f40b1740 1 Processor -- start 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609cdb900 0x559609cefb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce1260 0x559609cf0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 0x559609cf1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc00fb30 con 0x559609ce6c30 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc00f3a0 con 0x559609cdb900 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc00c5e0 con 0x559609ce1260 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.992+0000 7fd3f40b1740 10 client.0 _ll_register_callbacks cb 0x7fd3dc0bcd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.993+0000 7fd3ea800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 0x559609cf1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.993+0000 7fd3ea800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 0x559609cf1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:37556/0 (socket says 172.21.15.150:37556) 2024-09-15T22:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.993+0000 7fd3ea800640 1 -- 172.21.15.150:0/436812838 learned_addr learned my addr 172.21.15.150:0/436812838 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.994+0000 7fd3ea800640 1 -- 172.21.15.150:0/436812838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce1260 msgr2=0x559609cf0090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:16:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.994+0000 7fd3ea800640 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce1260 0x559609cf0090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.994+0000 7fd3ea800640 1 -- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609cdb900 msgr2=0x559609cefb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:16:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.994+0000 7fd3ea800640 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609cdb900 0x559609cefb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.994+0000 7fd3ea800640 1 -- 172.21.15.150:0/436812838 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559609cf1660 con 0x559609ce6c30 2024-09-15T22:16:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:40.995+0000 7fd3ea800640 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 0x559609cf1050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8012870 tx=0x7fd3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8afead5c807dc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.005+0000 7fd3cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.005+0000 7fd3cbe00640 1 -- 172.21.15.150:0/436812838 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800fce0 con 0x559609ce6c30 2024-09-15T22:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.010+0000 7fd3cbe00640 1 -- 172.21.15.150:0/436812838 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fd3d801f420 con 0x559609ce6c30 2024-09-15T22:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.011+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3dc0c5e50 con 0x559609ce6c30 2024-09-15T22:16:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.029+0000 7fd3cbe00640 1 -- 172.21.15.150:0/436812838 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd3d801f620 con 0x559609ce6c30 2024-09-15T22:16:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.053+0000 7fd3f40b1740 10 client.15405 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.053+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559609d614b0 con 0x559609ce6c30 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.089+0000 7fd3cbe00640 1 -- 172.21.15.150:0/436812838 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3dc0c5e50 con 0x559609ce6c30 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.089+0000 7fd3cbe00640 1 -- 172.21.15.150:0/436812838 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7fd3d8031860 con 0x559609ce6c30 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.090+0000 7fd3f40b1740 10 client.15405 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.090+0000 7fd3f40b1740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.090+0000 7fd3f40b1740 20 client.15405 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.091+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609d61d10 0x559609d64130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.091+0000 7fd3f40b1740 4 client.15405 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:16:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.091+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559609c4db80 con 0x559609d61d10 2024-09-15T22:16:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.091+0000 7fd3e9e00640 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609d61d10 0x559609d64130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.098+0000 7fd3e9e00640 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609d61d10 0x559609d64130 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21cae03c9596f1c server_cookie=b14c8b1feb545a4e in_seq=0 out_seq=0 2024-09-15T22:16:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:41.102+0000 7fd3cbe00640 10 client.15405 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:41.732 INFO:tasks.workunit.client.0.smithi150.stdout: 438 523480 1402 356705 1072 126130 972 2024-09-15T22:16:42.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:42 smithi150 ceph-mon[30886]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 19 MiB/s wr, 951 op/s 2024-09-15T22:16:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:42 smithi169 ceph-mon[35850]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 19 MiB/s wr, 951 op/s 2024-09-15T22:16:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.755+0000 7fd3cbe00640 1 -- 172.21.15.150:0/436812838 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559609c4db80 con 0x559609d61d10 2024-09-15T22:16:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.755+0000 7fd3cbe00640 10 client.15405 handle_command_reply: tid=0 2024-09-15T22:16:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.755+0000 7fd3f40b1740 1 client.15405 shutdown 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.755+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 msgr2=0x559609cf1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.755+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 0x559609cf1050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8012870 tx=0x7fd3d80046c0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 shutdown_connections 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559609d61d10 0x559609d64130 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559609ce6c30 0x559609cf1050 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559609ce1260 0x559609cf0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3f40b1740 1 --2- 172.21.15.150:0/436812838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559609cdb900 0x559609cefb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 >> 172.21.15.150:0/436812838 conn(0x559609cdc8d0 msgr2=0x559609cdccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.756+0000 7fd3cbe00640 0 client.15405 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:42 smithi154 ceph-mon[34853]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 19 MiB/s wr, 951 op/s 2024-09-15T22:16:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.832+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 shutdown_connections 2024-09-15T22:16:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.836+0000 7fd3f40b1740 1 -- 172.21.15.150:0/436812838 wait complete. 2024-09-15T22:16:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.836+0000 7fd3f40b1740 20 client.15405 trim_cache size 0 max 16384 2024-09-15T22:16:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:16:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:16:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:16:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:16:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.854+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3d00a3450 msgr2=0x7fd3d00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.854+0000 7fd3f1200640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3d00a3450 0x7fd3d00a5910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009bc0 tx=0x7fd3d8005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.854+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 msgr2=0x7fd3e40b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.854+0000 7fd3f1200640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40b34a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0052e0 tx=0x7fd3dc005310 comp rx=0 tx=0).stop 2024-09-15T22:16:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.882+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 shutdown_connections 2024-09-15T22:16:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.882+0000 7fd3f1200640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3e40a6060 0x7fd3e4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.882+0000 7fd3f1200640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fd3d00a3450 0x7fd3d00a5910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.882+0000 7fd3f1200640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e40a56a0 0x7fd3e40b34a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.882+0000 7fd3f1200640 1 --2- 172.21.15.150:0/952159573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e40a4570 0x7fd3e40b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.882+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 >> 172.21.15.150:0/952159573 conn(0x7fd3e409fbd0 msgr2=0x7fd3e40a88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.887+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 shutdown_connections 2024-09-15T22:16:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:42.887+0000 7fd3f1200640 1 -- 172.21.15.150:0/952159573 wait complete. 2024-09-15T22:16:44.609 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:44 smithi150 ceph-mon[30886]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 1.10k op/s 2024-09-15T22:16:44.609 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:44.609 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:44.609 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:44 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:16:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:44 smithi169 ceph-mon[35850]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 1.10k op/s 2024-09-15T22:16:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:44.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:44 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:16:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:44 smithi154 ceph-mon[34853]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 1.10k op/s 2024-09-15T22:16:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:44 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:16:46.355 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:46 smithi150 ceph-mon[30886]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 23 MiB/s wr, 1.41k op/s 2024-09-15T22:16:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:46 smithi169 ceph-mon[35850]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 23 MiB/s wr, 1.41k op/s 2024-09-15T22:16:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:46 smithi154 ceph-mon[34853]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 23 MiB/s wr, 1.41k op/s 2024-09-15T22:16:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:48 smithi150 ceph-mon[30886]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 20 MiB/s wr, 1.42k op/s 2024-09-15T22:16:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:48 smithi169 ceph-mon[35850]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 20 MiB/s wr, 1.42k op/s 2024-09-15T22:16:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:48 smithi154 ceph-mon[34853]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 20 MiB/s wr, 1.42k op/s 2024-09-15T22:16:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:50 smithi150 ceph-mon[30886]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 1.32k op/s 2024-09-15T22:16:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:50 smithi169 ceph-mon[35850]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 1.32k op/s 2024-09-15T22:16:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:50 smithi154 ceph-mon[34853]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 1.32k op/s 2024-09-15T22:16:51.730 INFO:tasks.workunit.client.0.smithi150.stdout: 467 693601 1870 473859 1899 177811 1511 2024-09-15T22:16:52.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:52 smithi150 ceph-mon[30886]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-09-15T22:16:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:52 smithi169 ceph-mon[35850]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-09-15T22:16:52.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:52 smithi154 ceph-mon[34853]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 1.05k op/s 2024-09-15T22:16:53.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:53 smithi150 ceph-mon[30886]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 805 op/s 2024-09-15T22:16:53.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:53 smithi169 ceph-mon[35850]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 805 op/s 2024-09-15T22:16:53.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:53 smithi154 ceph-mon[34853]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 805 op/s 2024-09-15T22:16:56.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:56 smithi150 ceph-mon[30886]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 648 op/s 2024-09-15T22:16:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:56 smithi169 ceph-mon[35850]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 648 op/s 2024-09-15T22:16:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:56 smithi154 ceph-mon[34853]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 648 op/s 2024-09-15T22:16:58.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:16:58 smithi150 ceph-mon[30886]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 350 op/s 2024-09-15T22:16:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:16:58 smithi169 ceph-mon[35850]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 350 op/s 2024-09-15T22:16:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:16:58 smithi154 ceph-mon[34853]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 350 op/s 2024-09-15T22:16:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.174+0000 7f51d4400640 1 -- 172.21.15.150:0/2625815248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc10a130 msgr2=0x7f51cc1109c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.174+0000 7f51d4400640 1 --2- 172.21.15.150:0/2625815248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc10a130 0x7f51cc1109c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009f00 tx=0x7f51c402ab40 comp rx=0 tx=0).stop 2024-09-15T22:16:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.175+0000 7f51d4400640 1 -- 172.21.15.150:0/2625815248 shutdown_connections 2024-09-15T22:16:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.175+0000 7f51d4400640 1 --2- 172.21.15.150:0/2625815248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc10a130 0x7f51cc1109c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.175+0000 7f51d4400640 1 --2- 172.21.15.150:0/2625815248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51cc109770 0x7f51cc109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.175+0000 7f51d4400640 1 --2- 172.21.15.150:0/2625815248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc073800 0x7f51cc073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.176+0000 7f51d4400640 1 -- 172.21.15.150:0/2625815248 >> 172.21.15.150:0/2625815248 conn(0x7f51cc06ece0 msgr2=0x7f51cc071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.176+0000 7f51d4400640 1 -- 172.21.15.150:0/2625815248 shutdown_connections 2024-09-15T22:16:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.176+0000 7f51d4400640 1 -- 172.21.15.150:0/2625815248 wait complete. 2024-09-15T22:16:59.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.181+0000 7f51d4400640 1 Processor -- start 2024-09-15T22:16:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.182+0000 7f51d4400640 1 -- start start 2024-09-15T22:16:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.182+0000 7f51d4400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51cc073800 0x7f51cc1a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.182+0000 7f51d4400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc109770 0x7f51cc1a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.182+0000 7f51d4400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 0x7f51cc1adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.182+0000 7f51d4400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc113dd0 con 0x7f51cc109770 2024-09-15T22:16:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.183+0000 7f51d4400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc113c50 con 0x7f51cc10a130 2024-09-15T22:16:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.183+0000 7f51d4400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc113f50 con 0x7f51cc073800 2024-09-15T22:16:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.183+0000 7f51d2400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 0x7f51cc1adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.183+0000 7f51d2400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 0x7f51cc1adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:44886/0 (socket says 172.21.15.150:44886) 2024-09-15T22:16:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.183+0000 7f51d2400640 1 -- 172.21.15.150:0/1937758987 learned_addr learned my addr 172.21.15.150:0/1937758987 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d1a00640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51cc073800 0x7f51cc1a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d2400640 1 -- 172.21.15.150:0/1937758987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51cc073800 msgr2=0x7f51cc1a69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d2400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51cc073800 0x7f51cc1a69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d2400640 1 -- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc109770 msgr2=0x7f51cc1a6f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d2400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc109770 0x7f51cc1a6f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d2400640 1 -- 172.21.15.150:0/1937758987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc19df10 con 0x7f51cc10a130 2024-09-15T22:16:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.184+0000 7f51d2400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 0x7f51cc1adf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51c402b0b0 tx=0x7f51c402d6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.185+0000 7f51ca000640 1 -- 172.21.15.150:0/1937758987 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4044070 con 0x7f51cc10a130 2024-09-15T22:16:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.185+0000 7f51ca000640 1 -- 172.21.15.150:0/1937758987 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c4004040 con 0x7f51cc10a130 2024-09-15T22:16:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.185+0000 7f51ca000640 1 -- 172.21.15.150:0/1937758987 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c403b070 con 0x7f51cc10a130 2024-09-15T22:16:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.186+0000 7f51d4400640 1 -- 172.21.15.150:0/1937758987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc19e1a0 con 0x7f51cc10a130 2024-09-15T22:16:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.186+0000 7f51d4400640 1 -- 172.21.15.150:0/1937758987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc19e550 con 0x7f51cc10a130 2024-09-15T22:16:59.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.199+0000 7f51ca000640 1 -- 172.21.15.150:0/1937758987 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f51c40041f0 con 0x7f51cc10a130 2024-09-15T22:16:59.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.201+0000 7f51ca000640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f51b40a3510 0x7f51b40a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.201+0000 7f51ca000640 1 -- 172.21.15.150:0/1937758987 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f51c40f0320 con 0x7f51cc10a130 2024-09-15T22:16:59.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.203+0000 7f51d7266740 1 Processor -- start 2024-09-15T22:16:59.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.203+0000 7f51d1a00640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f51b40a3510 0x7f51b40a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.205+0000 7f51d1a00640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f51b40a3510 0x7f51b40a59d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f51cc1095d0 tx=0x7f51b800c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.207+0000 7f51d7266740 1 -- start start 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.208+0000 7f51d7266740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef0a0 0x55e7580ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.208+0000 7f51d7266740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 0x55e7580f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.208+0000 7f51d7266740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.208+0000 7f51d7266740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e758054100 con 0x55e7580ef9e0 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.208+0000 7f51d7266740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e757ffc1b0 con 0x55e7580ef0a0 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.208+0000 7f51d7266740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7580500c0 con 0x55e7580f4a70 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 0x55e7580f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 0x55e7580f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54002/0 (socket says 172.21.15.150:54002) 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 -- 172.21.15.150:0/48235157 learned_addr learned my addr 172.21.15.150:0/48235157 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 -- 172.21.15.150:0/48235157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 msgr2=0x55e7580f6f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:16:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580f6f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 -- 172.21.15.150:0/48235157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef0a0 msgr2=0x55e7580ef4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:16:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef0a0 0x55e7580ef4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.209+0000 7f51d1000640 1 -- 172.21.15.150:0/48235157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e757d67210 con 0x55e7580ef9e0 2024-09-15T22:16:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.210+0000 7f51d1000640 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 0x55e7580f44a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009bc0 tx=0x7f51c000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4383d25f78c2f9f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.219+0000 7f51d4400640 1 -- 172.21.15.150:0/48235157 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0005020 con 0x55e7580ef9e0 2024-09-15T22:16:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.219+0000 7f51d4400640 1 -- 172.21.15.150:0/48235157 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c00047a0 con 0x55e7580ef9e0 2024-09-15T22:16:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.219+0000 7f51d4400640 1 -- 172.21.15.150:0/48235157 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c0010690 con 0x55e7580ef9e0 2024-09-15T22:16:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.220+0000 7f51d7266740 1 -- 172.21.15.150:0/48235157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 msgr2=0x55e7580f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.220+0000 7f51d7266740 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 0x55e7580f44a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009bc0 tx=0x7f51c000e720 comp rx=0 tx=0).stop 2024-09-15T22:16:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 -- 172.21.15.150:0/48235157 shutdown_connections 2024-09-15T22:16:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef9e0 0x55e7580f44a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 --2- 172.21.15.150:0/48235157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef0a0 0x55e7580ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 -- 172.21.15.150:0/48235157 >> 172.21.15.150:0/48235157 conn(0x55e7580ea900 msgr2=0x55e7580ead00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 -- 172.21.15.150:0/48235157 shutdown_connections 2024-09-15T22:16:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.252+0000 7f51d7266740 1 -- 172.21.15.150:0/48235157 wait complete. 2024-09-15T22:16:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.253+0000 7f51d7266740 1 -- start start 2024-09-15T22:16:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.253+0000 7f51d7266740 1 Processor -- start 2024-09-15T22:16:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 0x55e7580f9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e758100920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e7580f7a40 con 0x55e7580ef0a0 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e757fdd090 con 0x55e7580ef9e0 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7580f7bc0 con 0x55e7580f4a70 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.257+0000 7f51d7266740 10 client.0 _ll_register_callbacks cb 0x55e758031f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.261+0000 7f51d1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 0x55e7580f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 0x55e7580f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54010/0 (socket says 172.21.15.150:54010) 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 -- 172.21.15.150:0/3271141213 learned_addr learned my addr 172.21.15.150:0/3271141213 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 -- 172.21.15.150:0/3271141213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 msgr2=0x55e758100920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e758100920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 -- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 msgr2=0x55e7580f9950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f9950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.262+0000 7f51d1a00640 1 -- 172.21.15.150:0/3271141213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e757e33620 con 0x55e7580ef0a0 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.263+0000 7f51b3400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.263+0000 7f51d1a00640 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 0x55e7580f9410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51b80045e0 tx=0x7f51b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad4bbd57d9ddf92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.264+0000 7f51b3400640 1 -- 172.21.15.150:0/3271141213 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b8024420 con 0x55e7580ef0a0 2024-09-15T22:16:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.264+0000 7f51b3400640 1 -- 172.21.15.150:0/3271141213 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f51b8015410 con 0x55e7580ef0a0 2024-09-15T22:16:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.267+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51c00047a0 con 0x55e7580ef0a0 2024-09-15T22:16:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.271+0000 7f51b3400640 1 -- 172.21.15.150:0/3271141213 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f51b8015610 con 0x55e7580ef0a0 2024-09-15T22:16:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.291+0000 7f51d7266740 10 client.15414 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.291+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e7581037e0 con 0x55e7580ef0a0 2024-09-15T22:16:59.296 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.293+0000 7f51b3400640 1 -- 172.21.15.150:0/3271141213 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c00047a0 con 0x55e7580ef0a0 2024-09-15T22:16:59.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51b3400640 1 -- 172.21.15.150:0/3271141213 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7f51b8024ba0 con 0x55e7580ef0a0 2024-09-15T22:16:59.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d7266740 10 client.15414 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d7266740 10 client.15414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d7266740 20 client.15414 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d7266740 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758104f40 0x55e758107350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d7266740 4 client.15414 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e758061830 con 0x55e758104f40 2024-09-15T22:16:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.295+0000 7f51d1000640 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758104f40 0x55e758107350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.296+0000 7f51d1000640 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758104f40 0x55e758107350 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2cd160a21934814 server_cookie=f411f4b2bd6c213c in_seq=0 out_seq=0 2024-09-15T22:16:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.296+0000 7f51b3400640 10 client.15414 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.297+0000 7f51b3400640 1 -- 172.21.15.150:0/3271141213 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e758061830 con 0x55e758104f40 2024-09-15T22:16:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.297+0000 7f51b3400640 10 client.15414 handle_command_reply: tid=0 2024-09-15T22:16:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.297+0000 7f51d7266740 1 client.15414 shutdown 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 msgr2=0x55e7580f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 0x55e7580f9410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51b80045e0 tx=0x7f51b80046c0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 shutdown_connections 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758104f40 0x55e758107350 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e758100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 --2- 172.21.15.150:0/3271141213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580ef0a0 0x55e7580f9410 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51b80045e0 tx=0x7f51b80046c0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 >> 172.21.15.150:0/3271141213 conn(0x55e7580ea900 msgr2=0x55e7580eb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.301+0000 7f51b3400640 0 client.15414 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.302+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 shutdown_connections 2024-09-15T22:16:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.302+0000 7f51d7266740 1 -- 172.21.15.150:0/3271141213 wait complete. 2024-09-15T22:16:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.304+0000 7f51d7266740 20 client.15414 trim_cache size 0 max 16384 2024-09-15T22:16:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.422+0000 7f51d7266740 1 Processor -- start 2024-09-15T22:16:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.422+0000 7f51d7266740 1 -- start start 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.425+0000 7f51d7266740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.425+0000 7f51d7266740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 0x55e7581008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.425+0000 7f51d7266740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 0x55e7580e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.426+0000 7f51d1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 0x55e7581008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.426+0000 7f51d1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 0x55e7581008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54026/0 (socket says 172.21.15.150:54026) 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.426+0000 7f51d1a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.426+0000 7f51d1a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:44912/0 (socket says 172.21.15.150:44912) 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.427+0000 7f51d7266740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1af720 con 0x55e7580f4a70 2024-09-15T22:16:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.427+0000 7f51d2400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 0x55e7580e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.427+0000 7f51d2400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 0x55e7580e9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:39788/0 (socket says 172.21.15.150:39788) 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.427+0000 7f51d2400640 1 -- 172.21.15.150:0/1895494210 learned_addr learned my addr 172.21.15.150:0/1895494210 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.427+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1b13e0 con 0x55e7580ef9e0 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.427+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1afdf0 con 0x55e7580f1370 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51d2400640 1 -- 172.21.15.150:0/1895494210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 msgr2=0x55e7580f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51d2400640 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51d2400640 1 -- 172.21.15.150:0/1895494210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 msgr2=0x55e7581008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51d2400640 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 0x55e7581008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51d2400640 1 -- 172.21.15.150:0/1895494210 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7580efec0 con 0x55e7580f1370 2024-09-15T22:16:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51d2400640 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 0x55e7580e9d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51c402eff0 tx=0x7f51c40b8d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f0c2bd313f40244 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.428+0000 7f51be000640 1 -- 172.21.15.150:0/1895494210 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40d4020 con 0x55e7580f1370 2024-09-15T22:16:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.429+0000 7f51be000640 1 -- 172.21.15.150:0/1895494210 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c40d0e50 con 0x55e7580f1370 2024-09-15T22:16:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.429+0000 7f51be000640 1 -- 172.21.15.150:0/1895494210 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c402cb90 con 0x55e7580f1370 2024-09-15T22:16:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.429+0000 7f51d1000640 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 0x55e7581008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-15T22:16:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.431+0000 7f51d1a00640 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-15T22:16:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.431+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 msgr2=0x55e7580e9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.431+0000 7f51d7266740 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 0x55e7580e9d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51c402eff0 tx=0x7f51c40b8d00 comp rx=0 tx=0).stop 2024-09-15T22:16:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.433+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 shutdown_connections 2024-09-15T22:16:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.433+0000 7f51d7266740 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f1370 0x55e7580e9d00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.433+0000 7f51d7266740 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f4a70 0x55e7581008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.433+0000 7f51d7266740 1 --2- 172.21.15.150:0/1895494210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.433+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 >> 172.21.15.150:0/1895494210 conn(0x55e7580ea900 msgr2=0x55e7580e95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.433+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 shutdown_connections 2024-09-15T22:16:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.434+0000 7f51d7266740 1 -- 172.21.15.150:0/1895494210 wait complete. 2024-09-15T22:16:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.435+0000 7f51d7266740 1 -- start start 2024-09-15T22:16:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.435+0000 7f51d7266740 1 Processor -- start 2024-09-15T22:16:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.437+0000 7f51d7266740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.438+0000 7f51d1a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.438+0000 7f51d1a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:44918/0 (socket says 172.21.15.150:44918) 2024-09-15T22:16:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.438+0000 7f51d7266740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f1370 0x55e7580fed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.439+0000 7f51d1a00640 1 -- 172.21.15.150:0/2001503152 learned_addr learned my addr 172.21.15.150:0/2001503152 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:16:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.439+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.440+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1b0c50 con 0x55e7580f1370 2024-09-15T22:16:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.440+0000 7f51d1000640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f1370 0x55e7580fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.440+0000 7f51d2400640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.441+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1b04c0 con 0x55e7580ef9e0 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.441+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc1a56c0 con 0x55e7580f4a70 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.441+0000 7f51d7266740 10 client.0 _ll_register_callbacks cb 0x7f51b8009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.442+0000 7f51d2400640 1 -- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 msgr2=0x55e7580fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.442+0000 7f51d2400640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.442+0000 7f51d2400640 1 -- 172.21.15.150:0/2001503152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f1370 msgr2=0x55e7580fed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.443+0000 7f51d2400640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f1370 0x55e7580fed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.443+0000 7f51d2400640 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7581002e0 con 0x55e7580f4a70 2024-09-15T22:16:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.443+0000 7f51d1000640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f1370 0x55e7580fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.444+0000 7f51b3400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:16:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.444+0000 7f51d2400640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580ffcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f51c402d710 tx=0x7f51c40c0d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b303b3bca41935b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.444+0000 7f51b3400640 1 -- 172.21.15.150:0/2001503152 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40ca060 con 0x55e7580f4a70 2024-09-15T22:16:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.445+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51c40d0e50 con 0x55e7580f4a70 2024-09-15T22:16:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.445+0000 7f51b3400640 1 -- 172.21.15.150:0/2001503152 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f51c4004560 con 0x55e7580f4a70 2024-09-15T22:16:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.446+0000 7f51b3400640 1 -- 172.21.15.150:0/2001503152 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f51c40ca060 con 0x55e7580f4a70 2024-09-15T22:16:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.446+0000 7f51d7266740 10 client.25414 fetch_fsmap learned FSMap version 37 2024-09-15T22:16:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.446+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e7581703c0 con 0x55e7580f4a70 2024-09-15T22:16:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.447+0000 7f51b3400640 1 -- 172.21.15.150:0/2001503152 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c40d0e50 con 0x55e7580f4a70 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51b3400640 1 -- 172.21.15.150:0/2001503152 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7f51c40cd050 con 0x55e7580f4a70 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d7266740 10 client.25414 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d7266740 10 client.25414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d7266740 20 client.25414 populate_metadata read hostname 'smithi150' 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758170d60 0x55e758173180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d7266740 4 client.25414 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e75805bb80 con 0x55e758170d60 2024-09-15T22:16:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.448+0000 7f51d1a00640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758170d60 0x55e758173180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.450+0000 7f51b3400640 10 client.25414 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:16:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:16:59.450+0000 7f51d1a00640 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758170d60 0x55e758173180 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e797ce4c207645a9 server_cookie=4bf3992f9bceeabc in_seq=0 out_seq=0 2024-09-15T22:17:00.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:00 smithi150 ceph-mon[30886]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-09-15T22:17:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:00 smithi169 ceph-mon[35850]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-09-15T22:17:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:00 smithi154 ceph-mon[34853]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-09-15T22:17:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:00.980+0000 7f51b3400640 1 -- 172.21.15.150:0/2001503152 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e75805bb80 con 0x55e758170d60 2024-09-15T22:17:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:00.980+0000 7f51b3400640 10 client.25414 handle_command_reply: tid=0 2024-09-15T22:17:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:00.992+0000 7f51d7266740 1 client.25414 shutdown 2024-09-15T22:17:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.003+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 msgr2=0x55e7580ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.003+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580ffcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f51c402d710 tx=0x7f51c40c0d80 comp rx=0 tx=0).stop 2024-09-15T22:17:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 shutdown_connections 2024-09-15T22:17:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55e758170d60 0x55e758173180 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7580f4a70 0x55e7580ffcd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e7580f1370 0x55e7580fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51d7266740 1 --2- 172.21.15.150:0/2001503152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7580ef9e0 0x55e7580fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 >> 172.21.15.150:0/2001503152 conn(0x55e7580ea900 msgr2=0x55e7580eb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.007+0000 7f51b3400640 0 client.25414 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.011+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 shutdown_connections 2024-09-15T22:17:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.018+0000 7f51d7266740 1 -- 172.21.15.150:0/2001503152 wait complete. 2024-09-15T22:17:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.018+0000 7f51d7266740 20 client.25414 trim_cache size 0 max 16384 2024-09-15T22:17:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:17:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:17:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:17:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:17:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.039+0000 7f51bf400640 1 -- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f51b40a3510 msgr2=0x7f51b40a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.039+0000 7f51bf400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f51b40a3510 0x7f51b40a59d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f51cc1095d0 tx=0x7f51b800c040 comp rx=0 tx=0).stop 2024-09-15T22:17:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.039+0000 7f51bf400640 1 -- 172.21.15.150:0/1937758987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 msgr2=0x7f51cc1adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.039+0000 7f51bf400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 0x7f51cc1adf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51c402b0b0 tx=0x7f51c402d6a0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 -- 172.21.15.150:0/1937758987 shutdown_connections 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51cc10a130 0x7f51cc1adf80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f51b40a3510 0x7f51b40a59d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc109770 0x7f51cc1a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 --2- 172.21.15.150:0/1937758987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51cc073800 0x7f51cc1a69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 -- 172.21.15.150:0/1937758987 >> 172.21.15.150:0/1937758987 conn(0x7f51cc06ece0 msgr2=0x7f51cc071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 -- 172.21.15.150:0/1937758987 shutdown_connections 2024-09-15T22:17:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:01.040+0000 7f51bf400640 1 -- 172.21.15.150:0/1937758987 wait complete. 2024-09-15T22:17:01.728 INFO:tasks.workunit.client.0.smithi150.stdout: 497 642139 1552 437022 1562 158747 2007 2024-09-15T22:17:02.653 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:02 smithi150 ceph-mon[30886]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 460 op/s 2024-09-15T22:17:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:02 smithi169 ceph-mon[35850]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 460 op/s 2024-09-15T22:17:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:02 smithi154 ceph-mon[34853]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 460 op/s 2024-09-15T22:17:03.393 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:03 smithi150 ceph-mon[30886]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 628 op/s 2024-09-15T22:17:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:03 smithi169 ceph-mon[35850]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 628 op/s 2024-09-15T22:17:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:03 smithi154 ceph-mon[34853]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 628 op/s 2024-09-15T22:17:06.593 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:06 smithi150 ceph-mon[30886]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-15T22:17:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:06 smithi169 ceph-mon[35850]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-15T22:17:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:06 smithi154 ceph-mon[34853]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-15T22:17:08.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:08 smithi150 ceph-mon[30886]: pgmap v506: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.40k op/s 2024-09-15T22:17:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:08 smithi169 ceph-mon[35850]: pgmap v506: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.40k op/s 2024-09-15T22:17:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:08 smithi154 ceph-mon[34853]: pgmap v506: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.40k op/s 2024-09-15T22:17:09.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:09 smithi150 ceph-mon[30886]: pgmap v507: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-15T22:17:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:09 smithi169 ceph-mon[35850]: pgmap v507: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-15T22:17:09.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:09 smithi154 ceph-mon[34853]: pgmap v507: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-15T22:17:11.733 INFO:tasks.workunit.client.0.smithi150.stdout: 514 512414 736 348818 714 137323 1378 2024-09-15T22:17:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:12 smithi150 ceph-mon[30886]: pgmap v508: 97 pgs: 97 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-09-15T22:17:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:12 smithi169 ceph-mon[35850]: pgmap v508: 97 pgs: 97 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-09-15T22:17:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:12 smithi154 ceph-mon[34853]: pgmap v508: 97 pgs: 97 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-09-15T22:17:14.684 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:14 smithi150 ceph-mon[30886]: pgmap v509: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 22 MiB/s wr, 1.41k op/s 2024-09-15T22:17:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:14 smithi169 ceph-mon[35850]: pgmap v509: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 22 MiB/s wr, 1.41k op/s 2024-09-15T22:17:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:14 smithi154 ceph-mon[34853]: pgmap v509: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 22 MiB/s wr, 1.41k op/s 2024-09-15T22:17:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:16 smithi150 ceph-mon[30886]: pgmap v510: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.26k op/s 2024-09-15T22:17:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:16 smithi169 ceph-mon[35850]: pgmap v510: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.26k op/s 2024-09-15T22:17:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:16 smithi154 ceph-mon[34853]: pgmap v510: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.26k op/s 2024-09-15T22:17:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.220+0000 7fbabac00640 1 -- 172.21.15.150:0/894035216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4073680 msgr2=0x7fbab410d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.220+0000 7fbabac00640 1 --2- 172.21.15.150:0/894035216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4073680 0x7fbab410d4f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbaa801ab70 tx=0x7fbaa803b6d0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.231+0000 7fbabac00640 1 -- 172.21.15.150:0/894035216 shutdown_connections 2024-09-15T22:17:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.231+0000 7fbabac00640 1 --2- 172.21.15.150:0/894035216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 0x7fbab4110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.231+0000 7fbabac00640 1 --2- 172.21.15.150:0/894035216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4073680 0x7fbab410d4f0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbaa801ab70 tx=0x7fbaa803b6d0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.231+0000 7fbabac00640 1 --2- 172.21.15.150:0/894035216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab4072cb0 0x7fbab40730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.231+0000 7fbabac00640 1 -- 172.21.15.150:0/894035216 >> 172.21.15.150:0/894035216 conn(0x7fbab406eb50 msgr2=0x7fbab4070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.257+0000 7fbabac00640 1 -- 172.21.15.150:0/894035216 shutdown_connections 2024-09-15T22:17:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.268+0000 7fbabac00640 1 -- 172.21.15.150:0/894035216 wait complete. 2024-09-15T22:17:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.269+0000 7fbabac00640 1 Processor -- start 2024-09-15T22:17:17.282 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.280+0000 7fbabac00640 1 -- start start 2024-09-15T22:17:17.282 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.280+0000 7fbabac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 0x7fbab419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.283 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.281+0000 7fbabac00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 0x7fbab419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.283 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.281+0000 7fbab9800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 0x7fbab419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.283 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.281+0000 7fbab9800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 0x7fbab419e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44236/0 (socket says 172.21.15.150:44236) 2024-09-15T22:17:17.284 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.282+0000 7fbabac00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41a3bd0 0x7fbab41a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.284 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.282+0000 7fbab9800640 1 -- 172.21.15.150:0/2469925900 learned_addr learned my addr 172.21.15.150:0/2469925900 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:17.284 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.282+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41136a0 con 0x7fbab4072cb0 2024-09-15T22:17:17.284 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.282+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4113520 con 0x7fbab41a3bd0 2024-09-15T22:17:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.282+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4113820 con 0x7fbab410dbb0 2024-09-15T22:17:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.290+0000 7fbab9800640 1 -- 172.21.15.150:0/2469925900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 msgr2=0x7fbab419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.286+0000 7fbaba200640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41a3bd0 0x7fbab41a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.286+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 0x7fbab419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.294+0000 7fbab9800640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 0x7fbab419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.294+0000 7fbab9800640 1 -- 172.21.15.150:0/2469925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41a3bd0 msgr2=0x7fbab41a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.294+0000 7fbab9800640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41a3bd0 0x7fbab41a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.294+0000 7fbab9800640 1 -- 172.21.15.150:0/2469925900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41a66c0 con 0x7fbab4072cb0 2024-09-15T22:17:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.295+0000 7fbab9800640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 0x7fbab419e6f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000b6d0 tx=0x7fbaa000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.305+0000 7fbaba200640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41a3bd0 0x7fbab41a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.305+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 0x7fbab419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.314+0000 7fbab2000640 1 -- 172.21.15.150:0/2469925900 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0019070 con 0x7fbab4072cb0 2024-09-15T22:17:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.314+0000 7fbab2000640 1 -- 172.21.15.150:0/2469925900 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa000ccc0 con 0x7fbab4072cb0 2024-09-15T22:17:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.314+0000 7fbab2000640 1 -- 172.21.15.150:0/2469925900 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0012340 con 0x7fbab4072cb0 2024-09-15T22:17:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.325+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab41a69b0 con 0x7fbab4072cb0 2024-09-15T22:17:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.326+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab41a6f00 con 0x7fbab4072cb0 2024-09-15T22:17:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.373+0000 7fbabf049740 1 Processor -- start 2024-09-15T22:17:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.378+0000 7fbabf049740 1 -- start start 2024-09-15T22:17:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.378+0000 7fbabf049740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb8c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.384+0000 7fbab2000640 1 -- 172.21.15.150:0/2469925900 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fbaa000c7e0 con 0x7fbab4072cb0 2024-09-15T22:17:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.387+0000 7fbab2000640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba9c0a3490 0x7fba9c0a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.387+0000 7fbab2000640 1 -- 172.21.15.150:0/2469925900 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fbaa00ce890 con 0x7fbab4072cb0 2024-09-15T22:17:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.392+0000 7fbab9800640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba9c0a3490 0x7fba9c0a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.393+0000 7fbab9800640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba9c0a3490 0x7fba9c0a5950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00a3560 tx=0x7fbaa0006df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:17.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbabf049740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 0x5572bfb91660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbabf049740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbabf049740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5572bfaf1100 con 0x5572bfb8cba0 2024-09-15T22:17:17.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbabf049740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572bfa991b0 con 0x5572bfb91c30 2024-09-15T22:17:17.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbabf049740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572bfaed0c0 con 0x5572bfb8c260 2024-09-15T22:17:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 0x5572bfb91660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 0x5572bfb91660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:44246/0 (socket says 172.21.15.150:44246) 2024-09-15T22:17:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.408+0000 7fbab8e00640 1 -- 172.21.15.150:0/1205358061 learned_addr learned my addr 172.21.15.150:0/1205358061 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.409+0000 7fbaba200640 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.409+0000 7fbaba200640 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.414+0000 7fbab8e00640 1 -- 172.21.15.150:0/1205358061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 msgr2=0x5572bfb8c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.414+0000 7fbab8e00640 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb8c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.414+0000 7fbab8e00640 1 -- 172.21.15.150:0/1205358061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 msgr2=0x5572bfb940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.414+0000 7fbab8e00640 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.414+0000 7fbab8e00640 1 -- 172.21.15.150:0/1205358061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bf804210 con 0x5572bfb8cba0 2024-09-15T22:17:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.418+0000 7fbab8e00640 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 0x5572bfb91660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006010 tx=0x7fbaa801a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe134e19d28fb845 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.433+0000 7fbaa6a00640 1 -- 172.21.15.150:0/1205358061 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8051070 con 0x5572bfb8cba0 2024-09-15T22:17:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.433+0000 7fbaa6a00640 1 -- 172.21.15.150:0/1205358061 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa8004ba0 con 0x5572bfb8cba0 2024-09-15T22:17:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.433+0000 7fbaa6a00640 1 -- 172.21.15.150:0/1205358061 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8003850 con 0x5572bfb8cba0 2024-09-15T22:17:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.438+0000 7fbabf049740 1 -- 172.21.15.150:0/1205358061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 msgr2=0x5572bfb91660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:17.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.438+0000 7fbabf049740 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 0x5572bfb91660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006010 tx=0x7fbaa801a690 comp rx=0 tx=0).stop 2024-09-15T22:17:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.450+0000 7fbabf049740 1 -- 172.21.15.150:0/1205358061 shutdown_connections 2024-09-15T22:17:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.450+0000 7fbabf049740 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.450+0000 7fbabf049740 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8cba0 0x5572bfb91660 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.450+0000 7fbabf049740 1 --2- 172.21.15.150:0/1205358061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb8c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.450+0000 7fbabf049740 1 -- 172.21.15.150:0/1205358061 >> 172.21.15.150:0/1205358061 conn(0x5572bfb878d0 msgr2=0x5572bfb87cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:17.471 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.470+0000 7fbabf049740 1 -- 172.21.15.150:0/1205358061 shutdown_connections 2024-09-15T22:17:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.470+0000 7fbabf049740 1 -- 172.21.15.150:0/1205358061 wait complete. 2024-09-15T22:17:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.471+0000 7fbabf049740 1 -- start start 2024-09-15T22:17:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.471+0000 7fbabf049740 1 Processor -- start 2024-09-15T22:17:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.474+0000 7fbabf049740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.474+0000 7fbabf049740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 0x5572bfb96930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 0x5572bfb96930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 0x5572bfb96930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40474/0 (socket says 172.21.15.150:40474) 2024-09-15T22:17:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbabf049740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb9d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 -- 172.21.15.150:0/2265285004 learned_addr learned my addr 172.21.15.150:0/2265285004 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5572bfb94ba0 con 0x5572bfb8c260 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572bfa7a090 con 0x5572bfb91c30 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572bfb94d20 con 0x5572bfb8cba0 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 -- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 msgr2=0x5572bfb9d970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb9d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 -- 172.21.15.150:0/2265285004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 msgr2=0x5572bfb963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbaba200640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.475+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.476+0000 7fbab8e00640 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572bf8d0620 con 0x5572bfb8cba0 2024-09-15T22:17:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.476+0000 7fbaba200640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.476+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 0x5572bfb96930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbaa803b710 tx=0x7fbaa8004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a88fb999c587ecf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.476+0000 7fbabf049740 10 client.0 _ll_register_callbacks cb 0x5572bfacef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.476+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa8004ba0 con 0x5572bfb8cba0 2024-09-15T22:17:17.484 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.481+0000 7fba9b400640 10 client.25420 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:17:17.484 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.481+0000 7fba9b400640 1 -- 172.21.15.150:0/2265285004 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa805a070 con 0x5572bfb8cba0 2024-09-15T22:17:17.485 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.481+0000 7fba9b400640 1 -- 172.21.15.150:0/2265285004 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fbaa80046c0 con 0x5572bfb8cba0 2024-09-15T22:17:17.485 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.482+0000 7fba9b400640 1 -- 172.21.15.150:0/2265285004 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbaa8066050 con 0x5572bfb8cba0 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.482+0000 7fbabf049740 10 client.25420 fetch_fsmap learned FSMap version 37 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.482+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=37}) -- 0x5572bfba0380 con 0x5572bfb8cba0 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.482+0000 7fba9b400640 1 -- 172.21.15.150:0/2265285004 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7fbaa804b040 con 0x5572bfb8cba0 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbabf049740 10 client.25420 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbabf049740 10 client.25420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbabf049740 20 client.25420 populate_metadata read hostname 'smithi150' 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbabf049740 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfba19e0 0x5572bfba3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbabf049740 4 client.25420 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbaa8004ba0 con 0x5572bfba19e0 2024-09-15T22:17:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.483+0000 7fbaba200640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfba19e0 0x5572bfba3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.484+0000 7fbaba200640 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfba19e0 0x5572bfba3ea0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8523762921b976f6 server_cookie=98304cab353453ba in_seq=0 out_seq=0 2024-09-15T22:17:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.484+0000 7fba9b400640 10 client.25420 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.485+0000 7fba9b400640 1 -- 172.21.15.150:0/2265285004 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fbaa8004ba0 con 0x5572bfba19e0 2024-09-15T22:17:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.485+0000 7fba9b400640 10 client.25420 handle_command_reply: tid=0 2024-09-15T22:17:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.485+0000 7fbabf049740 1 client.25420 shutdown 2024-09-15T22:17:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.509+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 msgr2=0x5572bfb96930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 0x5572bfb96930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbaa803b710 tx=0x7fbaa8004530 comp rx=0 tx=0).stop 2024-09-15T22:17:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 shutdown_connections 2024-09-15T22:17:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfba19e0 0x5572bfba3ea0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fba9b400640 0 client.25420 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb91c30 0x5572bfb9d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8cba0 0x5572bfb96930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 --2- 172.21.15.150:0/2265285004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.510+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 >> 172.21.15.150:0/2265285004 conn(0x5572bfb878d0 msgr2=0x5572bfb890e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.511+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 shutdown_connections 2024-09-15T22:17:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.511+0000 7fbabf049740 1 -- 172.21.15.150:0/2265285004 wait complete. 2024-09-15T22:17:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.513+0000 7fbabf049740 20 client.25420 trim_cache size 0 max 16384 2024-09-15T22:17:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.584+0000 7fbabf049740 1 Processor -- start 2024-09-15T22:17:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 -- start start 2024-09-15T22:17:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb86900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb91c30 0x5572bfb959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41afc70 con 0x5572bfb8c260 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b1930 con 0x5572bfb8cba0 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbabf049740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b0340 con 0x5572bfb91c30 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:43140/0 (socket says 172.21.15.150:43140) 2024-09-15T22:17:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.586+0000 7fbab8e00640 1 -- 172.21.15.150:0/2305438328 learned_addr learned my addr 172.21.15.150:0/2305438328 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.587+0000 7fbab8e00640 1 -- 172.21.15.150:0/2305438328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb91c30 msgr2=0x5572bfb959f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.587+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb91c30 0x5572bfb959f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.587+0000 7fbab8e00640 1 -- 172.21.15.150:0/2305438328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 msgr2=0x5572bfb86900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.587+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb86900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.587+0000 7fbab8e00640 1 -- 172.21.15.150:0/2305438328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bfb8d080 con 0x5572bfb8cba0 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.587+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9d930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8004ff0 tx=0x7fbaa8051000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cf2997ce2acaaa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.588+0000 7fbaa6000640 1 -- 172.21.15.150:0/2305438328 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa805a040 con 0x5572bfb8cba0 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.588+0000 7fbaa6000640 1 -- 172.21.15.150:0/2305438328 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa8004990 con 0x5572bfb8cba0 2024-09-15T22:17:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.588+0000 7fbaa6000640 1 -- 172.21.15.150:0/2305438328 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8051070 con 0x5572bfb8cba0 2024-09-15T22:17:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.590+0000 7fbabf049740 1 -- 172.21.15.150:0/2305438328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 msgr2=0x5572bfb9d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.590+0000 7fbabf049740 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9d930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8004ff0 tx=0x7fbaa8051000 comp rx=0 tx=0).stop 2024-09-15T22:17:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.590+0000 7fbabf049740 1 -- 172.21.15.150:0/2305438328 shutdown_connections 2024-09-15T22:17:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.590+0000 7fbabf049740 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb91c30 0x5572bfb959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.594+0000 7fbabf049740 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9d930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.594+0000 7fbabf049740 1 --2- 172.21.15.150:0/2305438328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb8c260 0x5572bfb86900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.594+0000 7fbabf049740 1 -- 172.21.15.150:0/2305438328 >> 172.21.15.150:0/2305438328 conn(0x5572bfb878d0 msgr2=0x5572bfb861f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.594+0000 7fbabf049740 1 -- 172.21.15.150:0/2305438328 shutdown_connections 2024-09-15T22:17:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.594+0000 7fbabf049740 1 -- 172.21.15.150:0/2305438328 wait complete. 2024-09-15T22:17:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.594+0000 7fbabf049740 1 -- start start 2024-09-15T22:17:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.595+0000 7fbabf049740 1 Processor -- start 2024-09-15T22:17:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.595+0000 7fbabf049740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb9abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.595+0000 7fbabf049740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.596+0000 7fbaba200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb9abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.596+0000 7fbaba200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb9abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:40482/0 (socket says 172.21.15.150:40482) 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.596+0000 7fbaba200640 1 -- 172.21.15.150:0/2925737586 learned_addr learned my addr 172.21.15.150:0/2925737586 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.596+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.597+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb91c30 0x5572bfb9c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.597+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b11a0 con 0x5572bfb91c30 2024-09-15T22:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.597+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b0a10 con 0x5572bfb8cba0 2024-09-15T22:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.597+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41adc50 con 0x5572bfb8c260 2024-09-15T22:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.597+0000 7fbabf049740 10 client.0 _ll_register_callbacks cb 0x7fbaac0144a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.598+0000 7fbab8e00640 1 -- 172.21.15.150:0/2925737586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 msgr2=0x5572bfb9abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.598+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb9abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.598+0000 7fbab8e00640 1 -- 172.21.15.150:0/2925737586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb91c30 msgr2=0x5572bfb9c120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.601+0000 7fbaba200640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb91c30 0x5572bfb9c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.601+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb91c30 0x5572bfb9c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.601+0000 7fbab8e00640 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572bfb9c730 con 0x5572bfb8cba0 2024-09-15T22:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.601+0000 7fbaba200640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb91c30 0x5572bfb9c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.602+0000 7fbab8e00640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9b110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5572bfb828f0 tx=0x7fbaa80041f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21141b06d9a50a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.602+0000 7fba9b400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.602+0000 7fba9b400640 1 -- 172.21.15.150:0/2925737586 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa805a040 con 0x5572bfb8cba0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.602+0000 7fba9b400640 1 -- 172.21.15.150:0/2925737586 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fbaa8019030 con 0x5572bfb8cba0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.602+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa8004990 con 0x5572bfb8cba0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.603+0000 7fba9b400640 1 -- 172.21.15.150:0/2925737586 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbaa801a530 con 0x5572bfb8cba0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.603+0000 7fbabf049740 10 client.25433 fetch_fsmap learned FSMap version 37 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.603+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5572bfb9da40 con 0x5572bfb8cba0 2024-09-15T22:17:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.604+0000 7fba9b400640 1 -- 172.21.15.150:0/2925737586 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa8004990 con 0x5572bfb8cba0 2024-09-15T22:17:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.605+0000 7fba9b400640 1 -- 172.21.15.150:0/2925737586 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 37) ==== 8410+0+0 (secure 0 0 0) 0x7fbaa80427c0 con 0x5572bfb8cba0 2024-09-15T22:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbabf049740 10 client.25433 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbabf049740 10 client.25433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbabf049740 20 client.25433 populate_metadata read hostname 'smithi150' 2024-09-15T22:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfc0cb70 0x5572bfc0ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbabf049740 4 client.25433 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572bfafe830 con 0x5572bfc0cb70 2024-09-15T22:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.607+0000 7fbaba200640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfc0cb70 0x5572bfc0ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.608+0000 7fbaba200640 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfc0cb70 0x5572bfc0ef90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cde36d54e4bdbf3 server_cookie=588e3068dbe11ac9 in_seq=0 out_seq=0 2024-09-15T22:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:17.608+0000 7fba9b400640 10 client.25433 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:17.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:17 smithi150 ceph-mon[30886]: pgmap v511: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 780 op/s 2024-09-15T22:17:17.715 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:17 smithi169 ceph-mon[35850]: pgmap v511: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 780 op/s 2024-09-15T22:17:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:17 smithi154 ceph-mon[34853]: pgmap v511: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 780 op/s 2024-09-15T22:17:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.299+0000 7fba9b400640 1 -- 172.21.15.150:0/2925737586 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572bfafe830 con 0x5572bfc0cb70 2024-09-15T22:17:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.299+0000 7fba9b400640 10 client.25433 handle_command_reply: tid=0 2024-09-15T22:17:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.314+0000 7fbabf049740 1 client.25433 shutdown 2024-09-15T22:17:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.431+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 msgr2=0x5572bfb9b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.431+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9b110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5572bfb828f0 tx=0x7fbaa80041f0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 shutdown_connections 2024-09-15T22:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5572bfc0cb70 0x5572bfc0ef90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5572bfb91c30 0x5572bfb9c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bfb8cba0 0x5572bfb9b110 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5572bfb828f0 tx=0x7fbaa80041f0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fbabf049740 1 --2- 172.21.15.150:0/2925737586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572bfb8c260 0x5572bfb9abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fba9b400640 0 client.25433 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.469+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 >> 172.21.15.150:0/2925737586 conn(0x5572bfb878d0 msgr2=0x5572bfb86a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.518+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 shutdown_connections 2024-09-15T22:17:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.518+0000 7fbabf049740 1 -- 172.21.15.150:0/2925737586 wait complete. 2024-09-15T22:17:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.531+0000 7fbabf049740 20 client.25433 trim_cache size 0 max 16384 2024-09-15T22:17:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:17:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:17:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:17:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:17:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.602+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba9c0a3490 msgr2=0x7fba9c0a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.602+0000 7fbabac00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba9c0a3490 0x7fba9c0a5950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00a3560 tx=0x7fbaa0006df0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.602+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 msgr2=0x7fbab419e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.602+0000 7fbabac00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 0x7fbab419e6f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000b6d0 tx=0x7fbaa000bb90 comp rx=0 tx=0).stop 2024-09-15T22:17:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.603+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 shutdown_connections 2024-09-15T22:17:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.603+0000 7fbabac00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbab41a3bd0 0x7fbab41a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.603+0000 7fbabac00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbab410dbb0 0x7fbab419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.603+0000 7fbabac00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fba9c0a3490 0x7fba9c0a5950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.603+0000 7fbabac00640 1 --2- 172.21.15.150:0/2469925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbab4072cb0 0x7fbab419e6f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.603+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 >> 172.21.15.150:0/2469925900 conn(0x7fbab406eb50 msgr2=0x7fbab4070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.617+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 shutdown_connections 2024-09-15T22:17:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:19.624+0000 7fbabac00640 1 -- 172.21.15.150:0/2469925900 wait complete. 2024-09-15T22:17:20.686 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:20 smithi150 ceph-mon[30886]: pgmap v512: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.1 MiB/s wr, 518 op/s 2024-09-15T22:17:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:20 smithi169 ceph-mon[35850]: pgmap v512: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.1 MiB/s wr, 518 op/s 2024-09-15T22:17:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:20 smithi154 ceph-mon[34853]: pgmap v512: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.1 MiB/s wr, 518 op/s 2024-09-15T22:17:21.737 INFO:tasks.workunit.client.0.smithi150.stdout: 545 689020 2080 470242 1827 185358 992 2024-09-15T22:17:22.435 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:22 smithi150 ceph-mon[30886]: pgmap v513: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.2 MiB/s wr, 583 op/s 2024-09-15T22:17:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:22 smithi169 ceph-mon[35850]: pgmap v513: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.2 MiB/s wr, 583 op/s 2024-09-15T22:17:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:22 smithi154 ceph-mon[34853]: pgmap v513: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.2 MiB/s wr, 583 op/s 2024-09-15T22:17:24.687 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:24 smithi150 ceph-mon[30886]: pgmap v514: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 598 op/s 2024-09-15T22:17:24.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:24 smithi169 ceph-mon[35850]: pgmap v514: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 598 op/s 2024-09-15T22:17:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:24 smithi154 ceph-mon[34853]: pgmap v514: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 598 op/s 2024-09-15T22:17:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:25 smithi150 ceph-mon[30886]: pgmap v515: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 607 op/s 2024-09-15T22:17:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:25 smithi169 ceph-mon[35850]: pgmap v515: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 607 op/s 2024-09-15T22:17:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:25 smithi154 ceph-mon[34853]: pgmap v515: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 607 op/s 2024-09-15T22:17:28.430 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:28 smithi150 ceph-mon[30886]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 695 op/s 2024-09-15T22:17:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:28 smithi169 ceph-mon[35850]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 695 op/s 2024-09-15T22:17:28.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:28 smithi154 ceph-mon[34853]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 695 op/s 2024-09-15T22:17:30.430 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:30 smithi150 ceph-mon[30886]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 736 op/s 2024-09-15T22:17:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:30 smithi169 ceph-mon[35850]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 736 op/s 2024-09-15T22:17:30.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:30 smithi154 ceph-mon[34853]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 736 op/s 2024-09-15T22:17:31.744 INFO:tasks.workunit.client.0.smithi150.stdout: 570 610795 1344 417020 1349 159498 1212 2024-09-15T22:17:32.558 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:32 smithi150 ceph-mon[30886]: pgmap v518: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 697 op/s 2024-09-15T22:17:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:32 smithi169 ceph-mon[35850]: pgmap v518: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 697 op/s 2024-09-15T22:17:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:32 smithi154 ceph-mon[34853]: pgmap v518: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 697 op/s 2024-09-15T22:17:34.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:34 smithi150 ceph-mon[30886]: pgmap v519: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.6 MiB/s wr, 691 op/s 2024-09-15T22:17:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:34 smithi169 ceph-mon[35850]: pgmap v519: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.6 MiB/s wr, 691 op/s 2024-09-15T22:17:34.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:34 smithi154 ceph-mon[34853]: pgmap v519: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.6 MiB/s wr, 691 op/s 2024-09-15T22:17:35.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:35 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:17:35.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:35 smithi150 ceph-mon[30886]: pgmap v520: 97 pgs: 97 active+clean; 1.9 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 906 op/s 2024-09-15T22:17:35.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:35 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:17:35.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:35 smithi169 ceph-mon[35850]: pgmap v520: 97 pgs: 97 active+clean; 1.9 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 906 op/s 2024-09-15T22:17:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:35 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:17:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:35 smithi154 ceph-mon[34853]: pgmap v520: 97 pgs: 97 active+clean; 1.9 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 906 op/s 2024-09-15T22:17:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.046+0000 7fec2e400640 1 -- 172.21.15.150:0/750663000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28072cb0 msgr2=0x7fec280730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.046+0000 7fec2e400640 1 --2- 172.21.15.150:0/750663000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28072cb0 0x7fec280730b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec1801a940 tx=0x7fec1803b490 comp rx=0 tx=0).stop 2024-09-15T22:17:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.052+0000 7fec2e400640 1 -- 172.21.15.150:0/750663000 shutdown_connections 2024-09-15T22:17:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.052+0000 7fec2e400640 1 --2- 172.21.15.150:0/750663000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2810dbb0 0x7fec28110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.052+0000 7fec2e400640 1 --2- 172.21.15.150:0/750663000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec28073680 0x7fec2810d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.052+0000 7fec2e400640 1 --2- 172.21.15.150:0/750663000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28072cb0 0x7fec280730b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.052+0000 7fec2e400640 1 -- 172.21.15.150:0/750663000 >> 172.21.15.150:0/750663000 conn(0x7fec2806eb50 msgr2=0x7fec28070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.062+0000 7fec2e400640 1 -- 172.21.15.150:0/750663000 shutdown_connections 2024-09-15T22:17:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.066+0000 7fec2e400640 1 -- 172.21.15.150:0/750663000 wait complete. 2024-09-15T22:17:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.067+0000 7fec2e400640 1 Processor -- start 2024-09-15T22:17:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.079+0000 7fec2e400640 1 -- start start 2024-09-15T22:17:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.079+0000 7fec2e400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 0x7fec2819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.079+0000 7fec2e400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28073680 0x7fec2819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.079+0000 7fec2e400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2810dbb0 0x7fec281a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.080+0000 7fec2d000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 0x7fec2819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.080+0000 7fec2d000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 0x7fec2819e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60750/0 (socket says 172.21.15.150:60750) 2024-09-15T22:17:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.081+0000 7fec2e400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec281135a0 con 0x7fec2810dbb0 2024-09-15T22:17:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.081+0000 7fec2e400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec28113420 con 0x7fec28073680 2024-09-15T22:17:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.081+0000 7fec2e400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec28113720 con 0x7fec28072cb0 2024-09-15T22:17:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.081+0000 7fec2d000640 1 -- 172.21.15.150:0/3046929270 learned_addr learned my addr 172.21.15.150:0/3046929270 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.082+0000 7fec2d000640 1 -- 172.21.15.150:0/3046929270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28073680 msgr2=0x7fec2819ec30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:17:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.082+0000 7fec2d000640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28073680 0x7fec2819ec30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.082+0000 7fec2d000640 1 -- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2810dbb0 msgr2=0x7fec281a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.082+0000 7fec2d000640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2810dbb0 0x7fec281a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.082+0000 7fec2d000640 1 -- 172.21.15.150:0/3046929270 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec281a5e70 con 0x7fec28072cb0 2024-09-15T22:17:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.083+0000 7fec2d000640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 0x7fec2819e6f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fec18000c00 tx=0x7fec1801a4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.096+0000 7fec25600640 1 -- 172.21.15.150:0/3046929270 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18051070 con 0x7fec28072cb0 2024-09-15T22:17:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.096+0000 7fec25600640 1 -- 172.21.15.150:0/3046929270 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec18040c00 con 0x7fec28072cb0 2024-09-15T22:17:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.096+0000 7fec25600640 1 -- 172.21.15.150:0/3046929270 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18042980 con 0x7fec28072cb0 2024-09-15T22:17:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.113+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec281a6100 con 0x7fec28072cb0 2024-09-15T22:17:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.113+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec281a65d0 con 0x7fec28072cb0 2024-09-15T22:17:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.129+0000 7fec25600640 1 -- 172.21.15.150:0/3046929270 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fec18054070 con 0x7fec28072cb0 2024-09-15T22:17:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.131+0000 7fec25600640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fec0c0a33d0 0x7fec0c0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.141+0000 7fec27e00640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fec0c0a33d0 0x7fec0c0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.143+0000 7fec27e00640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fec0c0a33d0 0x7fec0c0a5890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec2819f730 tx=0x7fec14005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.143+0000 7fec25600640 1 -- 172.21.15.150:0/3046929270 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fec18101300 con 0x7fec28072cb0 2024-09-15T22:17:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.147+0000 7fec328db740 1 Processor -- start 2024-09-15T22:17:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 -- start start 2024-09-15T22:17:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b49322a100 con 0x55b4932c5260 2024-09-15T22:17:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4931d21b0 con 0x55b4932c5ba0 2024-09-15T22:17:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.157+0000 7fec328db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b4932260c0 con 0x55b4932cac30 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.158+0000 7fec2da00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.158+0000 7fec2da00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60758/0 (socket says 172.21.15.150:60758) 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.158+0000 7fec2da00640 1 -- 172.21.15.150:0/2159345623 learned_addr learned my addr 172.21.15.150:0/2159345623 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.162+0000 7fec2da00640 1 -- 172.21.15.150:0/2159345623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 msgr2=0x55b4932ca660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.162+0000 7fec2da00640 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932ca660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.162+0000 7fec2da00640 1 -- 172.21.15.150:0/2159345623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 msgr2=0x55b4932c5660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.162+0000 7fec2da00640 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932c5660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.162+0000 7fec2da00640 1 -- 172.21.15.150:0/2159345623 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b492f3d210 con 0x55b4932cac30 2024-09-15T22:17:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.162+0000 7fec2da00640 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932cd0f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec20009d80 tx=0x7fec2000e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6791c8fe09ffc5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.168+0000 7fec1e000640 1 -- 172.21.15.150:0/2159345623 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20016070 con 0x55b4932cac30 2024-09-15T22:17:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.168+0000 7fec1e000640 1 -- 172.21.15.150:0/2159345623 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec20005020 con 0x55b4932cac30 2024-09-15T22:17:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.168+0000 7fec1e000640 1 -- 172.21.15.150:0/2159345623 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec200116d0 con 0x55b4932cac30 2024-09-15T22:17:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.173+0000 7fec328db740 1 -- 172.21.15.150:0/2159345623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 msgr2=0x55b4932cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.173+0000 7fec328db740 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932cd0f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec20009d80 tx=0x7fec2000e6c0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 -- 172.21.15.150:0/2159345623 shutdown_connections 2024-09-15T22:17:37.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932cd0f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 --2- 172.21.15.150:0/2159345623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 -- 172.21.15.150:0/2159345623 >> 172.21.15.150:0/2159345623 conn(0x55b4932c08d0 msgr2=0x55b4932c0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:37.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 -- 172.21.15.150:0/2159345623 shutdown_connections 2024-09-15T22:17:37.192 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.189+0000 7fec328db740 1 -- 172.21.15.150:0/2159345623 wait complete. 2024-09-15T22:17:37.192 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.190+0000 7fec328db740 1 -- start start 2024-09-15T22:17:37.192 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.190+0000 7fec328db740 1 Processor -- start 2024-09-15T22:17:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55b4932cdc00 con 0x55b4932c5260 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b4931b3090 con 0x55b4932c5ba0 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b4932cdd80 con 0x55b4932cac30 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.210+0000 7fec328db740 10 client.0 _ll_register_callbacks cb 0x55b493207f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.211+0000 7fec27e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.211+0000 7fec27e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:54006/0 (socket says 172.21.15.150:54006) 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.211+0000 7fec27e00640 1 -- 172.21.15.150:0/1425323168 learned_addr learned my addr 172.21.15.150:0/1425323168 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.211+0000 7fec2da00640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.212+0000 7fec2d000640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.212+0000 7fec27e00640 1 -- 172.21.15.150:0/1425323168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 msgr2=0x55b4932d6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.212+0000 7fec27e00640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932d6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.212+0000 7fec27e00640 1 -- 172.21.15.150:0/1425323168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 msgr2=0x55b4932cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.212+0000 7fec27e00640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.212+0000 7fec27e00640 1 -- 172.21.15.150:0/1425323168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b493009620 con 0x55b4932c5ba0 2024-09-15T22:17:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.223+0000 7fec27e00640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932cfa40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec1400a710 tx=0x7fec14004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f3e176e2e1696c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.224+0000 7fec12a00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:17:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.235+0000 7fec12a00640 1 -- 172.21.15.150:0/1425323168 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14020070 con 0x55b4932c5ba0 2024-09-15T22:17:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.235+0000 7fec12a00640 1 -- 172.21.15.150:0/1425323168 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fec14004220 con 0x55b4932c5ba0 2024-09-15T22:17:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.275+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec20005020 con 0x55b4932c5ba0 2024-09-15T22:17:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.294+0000 7fec12a00640 1 -- 172.21.15.150:0/1425323168 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fec14029050 con 0x55b4932c5ba0 2024-09-15T22:17:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.294+0000 7fec328db740 10 client.25439 fetch_fsmap learned FSMap version 38 2024-09-15T22:17:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.294+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b4932d9940 con 0x55b4932c5ba0 2024-09-15T22:17:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec12a00640 1 -- 172.21.15.150:0/1425323168 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec20005020 con 0x55b4932c5ba0 2024-09-15T22:17:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec12a00640 1 -- 172.21.15.150:0/1425323168 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 38) ==== 8414+0+0 (secure 0 0 0) 0x7fec1401b070 con 0x55b4932c5ba0 2024-09-15T22:17:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec328db740 10 client.25439 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T22:17:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec328db740 10 client.25439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec328db740 20 client.25439 populate_metadata read hostname 'smithi150' 2024-09-15T22:17:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec328db740 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b4932db080 0x55b4932dd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec328db740 4 client.25439 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.295+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b493237830 con 0x55b4932db080 2024-09-15T22:17:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.296+0000 7fec2d000640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b4932db080 0x55b4932dd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.301+0000 7fec2d000640 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b4932db080 0x55b4932dd4a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f65cc9f0b24e198 server_cookie=1875a5e145e4b26d in_seq=0 out_seq=0 2024-09-15T22:17:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.302+0000 7fec12a00640 10 client.25439 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.303+0000 7fec12a00640 1 -- 172.21.15.150:0/1425323168 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b493237830 con 0x55b4932db080 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.303+0000 7fec12a00640 10 client.25439 handle_command_reply: tid=0 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.304+0000 7fec328db740 1 client.25439 shutdown 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.304+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 msgr2=0x55b4932cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.304+0000 7fec328db740 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932cfa40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec1400a710 tx=0x7fec14004730 comp rx=0 tx=0).stop 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.305+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 shutdown_connections 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.305+0000 7fec328db740 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b4932db080 0x55b4932dd4a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.305+0000 7fec328db740 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932cac30 0x55b4932d6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.305+0000 7fec328db740 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5ba0 0x55b4932cfa40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.305+0000 7fec328db740 1 --2- 172.21.15.150:0/1425323168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5260 0x55b4932cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.305+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 >> 172.21.15.150:0/1425323168 conn(0x55b4932c08d0 msgr2=0x55b4932c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.306+0000 7fec12a00640 0 client.25439 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:37.323 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.314+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 shutdown_connections 2024-09-15T22:17:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.322+0000 7fec328db740 1 -- 172.21.15.150:0/1425323168 wait complete. 2024-09-15T22:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.331+0000 7fec328db740 20 client.25439 trim_cache size 0 max 16384 2024-09-15T22:17:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.852+0000 7fec328db740 1 Processor -- start 2024-09-15T22:17:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.874+0000 7fec328db740 1 -- start start 2024-09-15T22:17:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.880+0000 7fec328db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5260 0x55b4932ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.880+0000 7fec328db740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5ba0 0x55b4932d6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.883+0000 7fec2d000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5260 0x55b4932ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.884+0000 7fec2d000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5260 0x55b4932ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60770/0 (socket says 172.21.15.150:60770) 2024-09-15T22:17:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.884+0000 7fec2d000640 1 -- 172.21.15.150:0/2790543805 learned_addr learned my addr 172.21.15.150:0/2790543805 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.884+0000 7fec328db740 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932cac30 0x55b4932bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.885+0000 7fec2da00640 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932cac30 0x55b4932bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.887+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec2807d100 con 0x55b4932c5ba0 2024-09-15T22:17:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.888+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec2807edf0 con 0x55b4932cac30 2024-09-15T22:17:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.889+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec2807d7d0 con 0x55b4932c5260 2024-09-15T22:17:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.891+0000 7fec2da00640 1 -- 172.21.15.150:0/2790543805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5260 msgr2=0x55b4932ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.891+0000 7fec2da00640 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5260 0x55b4932ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.891+0000 7fec2da00640 1 -- 172.21.15.150:0/2790543805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5ba0 msgr2=0x55b4932d6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.884+0000 7fec27e00640 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5ba0 0x55b4932d6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.892+0000 7fec2da00640 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5ba0 0x55b4932d6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.892+0000 7fec2da00640 1 -- 172.21.15.150:0/2790543805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4932c06f0 con 0x55b4932cac30 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.892+0000 7fec27e00640 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5ba0 0x55b4932d6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.901+0000 7fec2da00640 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932cac30 0x55b4932bf1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec2000a010 tx=0x7fec20009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9be2eaaaadafc1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.905+0000 7fec1d600640 1 -- 172.21.15.150:0/2790543805 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20049020 con 0x55b4932cac30 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.905+0000 7fec1d600640 1 -- 172.21.15.150:0/2790543805 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec20003e50 con 0x55b4932cac30 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.905+0000 7fec1d600640 1 -- 172.21.15.150:0/2790543805 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20016050 con 0x55b4932cac30 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.906+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932cac30 msgr2=0x55b4932bf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.906+0000 7fec328db740 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932cac30 0x55b4932bf1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec2000a010 tx=0x7fec20009b00 comp rx=0 tx=0).stop 2024-09-15T22:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.922+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 shutdown_connections 2024-09-15T22:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.922+0000 7fec328db740 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932cac30 0x55b4932bf1f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.922+0000 7fec328db740 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932c5ba0 0x55b4932d6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.922+0000 7fec328db740 1 --2- 172.21.15.150:0/2790543805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5260 0x55b4932ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.922+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 >> 172.21.15.150:0/2790543805 conn(0x55b4932c08d0 msgr2=0x55b4932c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.930+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 shutdown_connections 2024-09-15T22:17:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.932+0000 7fec328db740 1 -- 172.21.15.150:0/2790543805 wait complete. 2024-09-15T22:17:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.932+0000 7fec328db740 1 -- start start 2024-09-15T22:17:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.933+0000 7fec328db740 1 Processor -- start 2024-09-15T22:17:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.933+0000 7fec328db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5260 0x55b4932d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.938+0000 7fec328db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5ba0 0x55b4932d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.938+0000 7fec328db740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 0x55b4932d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec2da00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 0x55b4932d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec2da00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 0x55b4932d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:33800/0 (socket says 172.21.15.150:33800) 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec328db740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec2807e660 con 0x55b4932cac30 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec328db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec2807ded0 con 0x55b4932c5260 2024-09-15T22:17:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec328db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec2807b0e0 con 0x55b4932c5ba0 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec328db740 10 client.0 _ll_register_callbacks cb 0x7fec1400a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.939+0000 7fec2da00640 1 -- 172.21.15.150:0/1260877250 learned_addr learned my addr 172.21.15.150:0/1260877250 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec27e00640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5ba0 0x55b4932d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec2da00640 1 -- 172.21.15.150:0/1260877250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5ba0 msgr2=0x55b4932d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec2da00640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5ba0 0x55b4932d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec2da00640 1 -- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5260 msgr2=0x55b4932d4220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec2da00640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5260 0x55b4932d4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec2da00640 1 -- 172.21.15.150:0/1260877250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4932d5d10 con 0x55b4932cac30 2024-09-15T22:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.940+0000 7fec27e00640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5ba0 0x55b4932d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.941+0000 7fec2da00640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 0x55b4932d5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec2000e700 tx=0x7fec20004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c50e17112bfa49a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.942+0000 7fec12a00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.942+0000 7fec12a00640 1 -- 172.21.15.150:0/1260877250 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20049030 con 0x55b4932cac30 2024-09-15T22:17:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.942+0000 7fec12a00640 1 -- 172.21.15.150:0/1260877250 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fec20003b70 con 0x55b4932cac30 2024-09-15T22:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.946+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec20003e50 con 0x55b4932cac30 2024-09-15T22:17:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.950+0000 7fec12a00640 1 -- 172.21.15.150:0/1260877250 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fec20016070 con 0x55b4932cac30 2024-09-15T22:17:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.958+0000 7fec328db740 10 client.15432 fetch_fsmap learned FSMap version 38 2024-09-15T22:17:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.958+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b493345d80 con 0x55b4932cac30 2024-09-15T22:17:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec12a00640 1 -- 172.21.15.150:0/1260877250 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec20003e50 con 0x55b4932cac30 2024-09-15T22:17:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec12a00640 1 -- 172.21.15.150:0/1260877250 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 38) ==== 8414+0+0 (secure 0 0 0) 0x7fec20044070 con 0x55b4932cac30 2024-09-15T22:17:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec328db740 10 client.15432 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T22:17:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec328db740 10 client.15432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec328db740 20 client.15432 populate_metadata read hostname 'smithi150' 2024-09-15T22:17:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec328db740 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b493346390 0x55b4933487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec328db740 4 client.15432 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:17:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.964+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b493231b80 con 0x55b493346390 2024-09-15T22:17:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.965+0000 7fec2d000640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b493346390 0x55b4933487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.966+0000 7fec2d000640 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b493346390 0x55b4933487d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20e83c89da1c814c server_cookie=5a9ccafbed330463 in_seq=0 out_seq=0 2024-09-15T22:17:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:37.966+0000 7fec12a00640 10 client.15432 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:38.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:38 smithi150 ceph-mon[30886]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 18 MiB/s wr, 958 op/s 2024-09-15T22:17:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:38 smithi169 ceph-mon[35850]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 18 MiB/s wr, 958 op/s 2024-09-15T22:17:38.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:38 smithi154 ceph-mon[34853]: pgmap v521: 97 pgs: 97 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 18 MiB/s wr, 958 op/s 2024-09-15T22:17:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.432+0000 7fec12a00640 1 -- 172.21.15.150:0/1260877250 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b493231b80 con 0x55b493346390 2024-09-15T22:17:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.432+0000 7fec12a00640 10 client.15432 handle_command_reply: tid=0 2024-09-15T22:17:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.437+0000 7fec328db740 1 client.15432 shutdown 2024-09-15T22:17:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.438+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 msgr2=0x55b4932d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.438+0000 7fec328db740 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 0x55b4932d5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec2000e700 tx=0x7fec20004d50 comp rx=0 tx=0).stop 2024-09-15T22:17:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.439+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 shutdown_connections 2024-09-15T22:17:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.439+0000 7fec328db740 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55b493346390 0x55b4933487d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.440+0000 7fec328db740 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b4932cac30 0x55b4932d5700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.440+0000 7fec328db740 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4932c5ba0 0x55b4932d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.440+0000 7fec328db740 1 --2- 172.21.15.150:0/1260877250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4932c5260 0x55b4932d4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.440+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 >> 172.21.15.150:0/1260877250 conn(0x55b4932c08d0 msgr2=0x55b4932c1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.440+0000 7fec12a00640 0 client.15432 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.444+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 shutdown_connections 2024-09-15T22:17:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.448+0000 7fec328db740 1 -- 172.21.15.150:0/1260877250 wait complete. 2024-09-15T22:17:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.451+0000 7fec328db740 20 client.15432 trim_cache size 0 max 16384 2024-09-15T22:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:17:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:17:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:17:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:17:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.555+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fec0c0a33d0 msgr2=0x7fec0c0a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.555+0000 7fec2e400640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fec0c0a33d0 0x7fec0c0a5890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec2819f730 tx=0x7fec14005c00 comp rx=0 tx=0).stop 2024-09-15T22:17:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.555+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 msgr2=0x7fec2819e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.555+0000 7fec2e400640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 0x7fec2819e6f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fec18000c00 tx=0x7fec1801a4e0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.556+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 shutdown_connections 2024-09-15T22:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.556+0000 7fec2e400640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fec0c0a33d0 0x7fec0c0a5890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.556+0000 7fec2e400640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec2810dbb0 0x7fec281a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.556+0000 7fec2e400640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec28073680 0x7fec2819ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.556+0000 7fec2e400640 1 --2- 172.21.15.150:0/3046929270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec28072cb0 0x7fec2819e6f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.556+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 >> 172.21.15.150:0/3046929270 conn(0x7fec2806eb50 msgr2=0x7fec28070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.560+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 shutdown_connections 2024-09-15T22:17:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:39.564+0000 7fec2e400640 1 -- 172.21.15.150:0/3046929270 wait complete. 2024-09-15T22:17:40.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:40 smithi150 ceph-mon[30886]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 1.08k op/s 2024-09-15T22:17:40.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:40 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:17:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:40 smithi169 ceph-mon[35850]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 1.08k op/s 2024-09-15T22:17:40.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:40 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:17:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:40 smithi154 ceph-mon[34853]: pgmap v522: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 1.08k op/s 2024-09-15T22:17:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:40 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:17:41.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:41 smithi169 ceph-mon[35850]: pgmap v523: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.19k op/s 2024-09-15T22:17:41.756 INFO:tasks.workunit.client.0.smithi150.stdout: 594 543471 1426 372464 1155 140500 573 2024-09-15T22:17:41.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:41 smithi154 ceph-mon[34853]: pgmap v523: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.19k op/s 2024-09-15T22:17:41.941 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:41 smithi150 ceph-mon[30886]: pgmap v523: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.19k op/s 2024-09-15T22:17:44.691 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:44 smithi150 ceph-mon[30886]: pgmap v524: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 18 MiB/s wr, 1.30k op/s 2024-09-15T22:17:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:44 smithi169 ceph-mon[35850]: pgmap v524: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 18 MiB/s wr, 1.30k op/s 2024-09-15T22:17:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:44 smithi154 ceph-mon[34853]: pgmap v524: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 18 MiB/s wr, 1.30k op/s 2024-09-15T22:17:46.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:46 smithi150 ceph-mon[30886]: pgmap v525: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-15T22:17:46.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:46 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:46 smithi169 ceph-mon[35850]: pgmap v525: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-15T22:17:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:46 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:46 smithi154 ceph-mon[34853]: pgmap v525: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-15T22:17:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:46 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:48.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:48 smithi150 ceph-mon[30886]: pgmap v526: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.2 MiB/s wr, 870 op/s 2024-09-15T22:17:48.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:48 smithi169 ceph-mon[35850]: pgmap v526: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.2 MiB/s wr, 870 op/s 2024-09-15T22:17:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:48 smithi154 ceph-mon[34853]: pgmap v526: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.2 MiB/s wr, 870 op/s 2024-09-15T22:17:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:50 smithi150 ceph-mon[30886]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 745 op/s 2024-09-15T22:17:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:50 smithi169 ceph-mon[35850]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 745 op/s 2024-09-15T22:17:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:50 smithi154 ceph-mon[34853]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 745 op/s 2024-09-15T22:17:51.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:51 smithi169 ceph-mon[35850]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 531 op/s 2024-09-15T22:17:51.758 INFO:tasks.workunit.client.0.smithi150.stdout: 627 718570 1785 488729 1979 182351 1018 2024-09-15T22:17:51.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:51 smithi154 ceph-mon[34853]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 531 op/s 2024-09-15T22:17:51.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:51 smithi150 ceph-mon[30886]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 531 op/s 2024-09-15T22:17:54.682 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:54 smithi150 ceph-mon[30886]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 403 op/s 2024-09-15T22:17:54.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:54 smithi169 ceph-mon[35850]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 403 op/s 2024-09-15T22:17:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:54 smithi154 ceph-mon[34853]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 403 op/s 2024-09-15T22:17:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.949+0000 7f305ce00640 1 -- 172.21.15.150:0/3724353170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f305810dbb0 msgr2=0x7f3058110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.949+0000 7f305ce00640 1 --2- 172.21.15.150:0/3724353170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f305810dbb0 0x7f3058110070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3050009c30 tx=0x7f305002a740 comp rx=0 tx=0).stop 2024-09-15T22:17:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.982+0000 7f305ce00640 1 -- 172.21.15.150:0/3724353170 shutdown_connections 2024-09-15T22:17:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.982+0000 7f305ce00640 1 --2- 172.21.15.150:0/3724353170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f305810dbb0 0x7f3058110070 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.982+0000 7f305ce00640 1 --2- 172.21.15.150:0/3724353170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058073680 0x7f305810d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.982+0000 7f305ce00640 1 --2- 172.21.15.150:0/3724353170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3058072cb0 0x7f30580730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.982+0000 7f305ce00640 1 -- 172.21.15.150:0/3724353170 >> 172.21.15.150:0/3724353170 conn(0x7f305806eb50 msgr2=0x7f3058070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.990+0000 7f305ce00640 1 -- 172.21.15.150:0/3724353170 shutdown_connections 2024-09-15T22:17:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.994+0000 7f305ce00640 1 -- 172.21.15.150:0/3724353170 wait complete. 2024-09-15T22:17:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.995+0000 7f305ce00640 1 Processor -- start 2024-09-15T22:17:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:55.995+0000 7f305ce00640 1 -- start start 2024-09-15T22:17:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.002+0000 7f305ce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058072cb0 0x7f3058115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.006+0000 7f305ce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058073680 0x7f3058115e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f305ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f305810dbb0 0x7f30581b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f3057400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058072cb0 0x7f3058115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f3057400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058072cb0 0x7f3058115950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:40322/0 (socket says 172.21.15.150:40322) 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f3057400640 1 -- 172.21.15.150:0/2020998546 learned_addr learned my addr 172.21.15.150:0/2020998546 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f305811c3d0 con 0x7f3058073680 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f305811c250 con 0x7f3058072cb0 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f305811c550 con 0x7f305810dbb0 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.010+0000 7f3056a00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058073680 0x7f3058115e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.012+0000 7f3057e00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f305810dbb0 0x7f30581b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.012+0000 7f3056a00640 1 -- 172.21.15.150:0/2020998546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f305810dbb0 msgr2=0x7f30581b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.012+0000 7f3056a00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f305810dbb0 0x7f30581b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.012+0000 7f3056a00640 1 -- 172.21.15.150:0/2020998546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058072cb0 msgr2=0x7f3058115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.012+0000 7f3056a00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058072cb0 0x7f3058115950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.012+0000 7f3056a00640 1 -- 172.21.15.150:0/2020998546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30581b7020 con 0x7f3058073680 2024-09-15T22:17:56.022 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.021+0000 7f3056a00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058073680 0x7f3058115e90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f304800d6a0 tx=0x7f304800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.025+0000 7f304fe00640 1 -- 172.21.15.150:0/2020998546 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048017070 con 0x7f3058073680 2024-09-15T22:17:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.025+0000 7f304fe00640 1 -- 172.21.15.150:0/2020998546 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3048009820 con 0x7f3058073680 2024-09-15T22:17:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.025+0000 7f304fe00640 1 -- 172.21.15.150:0/2020998546 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048004ca0 con 0x7f3058073680 2024-09-15T22:17:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.036+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30581b7250 con 0x7f3058073680 2024-09-15T22:17:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.036+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30581b7720 con 0x7f3058073680 2024-09-15T22:17:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.062+0000 7f30611e5740 1 Processor -- start 2024-09-15T22:17:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.063+0000 7f304fe00640 1 -- 172.21.15.150:0/2020998546 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f30480099d0 con 0x7f3058073680 2024-09-15T22:17:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.065+0000 7f304fe00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f303c0a3450 0x7f303c0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.065+0000 7f304fe00640 1 -- 172.21.15.150:0/2020998546 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f30480cf420 con 0x7f3058073680 2024-09-15T22:17:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.073+0000 7f3057e00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f303c0a3450 0x7f303c0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.074+0000 7f3057e00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f303c0a3450 0x7f303c0a5910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3050006010 tx=0x7f30500304a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 -- start start 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8260 0x556b2a0d8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8ba0 0x556b2a0dd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x556b2a03d100 con 0x556b2a0d8ba0 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556b29fe51b0 con 0x556b2a0ddc30 2024-09-15T22:17:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.079+0000 7f30611e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556b2a0390c0 con 0x556b2a0d8260 2024-09-15T22:17:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.080+0000 7f3057400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8260 0x556b2a0d8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.080+0000 7f3057400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8260 0x556b2a0d8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:46144/0 (socket says 172.21.15.150:46144) 2024-09-15T22:17:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.080+0000 7f3057400640 1 -- 172.21.15.150:0/701146966 learned_addr learned my addr 172.21.15.150:0/701146966 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.080+0000 7f3057e00640 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.080+0000 7f3056a00640 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8ba0 0x556b2a0dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.081+0000 7f3056a00640 1 -- 172.21.15.150:0/701146966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8260 msgr2=0x556b2a0d8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.081+0000 7f3056a00640 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8260 0x556b2a0d8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.081+0000 7f3056a00640 1 -- 172.21.15.150:0/701146966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 msgr2=0x556b2a0e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.081+0000 7f3056a00640 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.081+0000 7f3056a00640 1 -- 172.21.15.150:0/701146966 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b29d50210 con 0x556b2a0d8ba0 2024-09-15T22:17:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.082+0000 7f3056a00640 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8ba0 0x556b2a0dd660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3048009610 tx=0x7f304809c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57eb6e34e3b1637 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.088 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.087+0000 7f304cc00640 1 -- 172.21.15.150:0/701146966 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30480b3020 con 0x556b2a0d8ba0 2024-09-15T22:17:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.087+0000 7f304cc00640 1 -- 172.21.15.150:0/701146966 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30480a46a0 con 0x556b2a0d8ba0 2024-09-15T22:17:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.087+0000 7f304cc00640 1 -- 172.21.15.150:0/701146966 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304809b0e0 con 0x556b2a0d8ba0 2024-09-15T22:17:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.088+0000 7f30611e5740 1 -- 172.21.15.150:0/701146966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8ba0 msgr2=0x556b2a0dd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.088+0000 7f30611e5740 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8ba0 0x556b2a0dd660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3048009610 tx=0x7f304809c130 comp rx=0 tx=0).stop 2024-09-15T22:17:56.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.089+0000 7f30611e5740 1 -- 172.21.15.150:0/701146966 shutdown_connections 2024-09-15T22:17:56.094 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.089+0000 7f30611e5740 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.089+0000 7f30611e5740 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8ba0 0x556b2a0dd660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.089+0000 7f30611e5740 1 --2- 172.21.15.150:0/701146966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8260 0x556b2a0d8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.089+0000 7f30611e5740 1 -- 172.21.15.150:0/701146966 >> 172.21.15.150:0/701146966 conn(0x556b2a0d38d0 msgr2=0x556b2a0d3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:56.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.105+0000 7f30611e5740 1 -- 172.21.15.150:0/701146966 shutdown_connections 2024-09-15T22:17:56.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.105+0000 7f30611e5740 1 -- 172.21.15.150:0/701146966 wait complete. 2024-09-15T22:17:56.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.105+0000 7f30611e5740 1 -- start start 2024-09-15T22:17:56.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.106+0000 7f30611e5740 1 Processor -- start 2024-09-15T22:17:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.113+0000 7f30611e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 0x556b2a0e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.113+0000 7f30611e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.114+0000 7f3057400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 0x556b2a0e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.114+0000 7f3057400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 0x556b2a0e24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39958/0 (socket says 172.21.15.150:39958) 2024-09-15T22:17:56.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.114+0000 7f30611e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f3056a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f3056a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:46154/0 (socket says 172.21.15.150:46154) 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f3057400640 1 -- 172.21.15.150:0/4078373643 learned_addr learned my addr 172.21.15.150:0/4078373643 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f30611e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x556b2a0e0ba0 con 0x556b2a0d8260 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556b29fc6090 con 0x556b2a0ddc30 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556b2a0e0d20 con 0x556b2a0d8ba0 2024-09-15T22:17:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.115+0000 7f3057e00640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.117+0000 7f3057e00640 1 -- 172.21.15.150:0/4078373643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 msgr2=0x556b2a0e29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.117+0000 7f3057e00640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.117+0000 7f3057e00640 1 -- 172.21.15.150:0/4078373643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 msgr2=0x556b2a0e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.117+0000 7f3057e00640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 0x556b2a0e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.117+0000 7f3057e00640 1 -- 172.21.15.150:0/4078373643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b29e1c620 con 0x556b2a0ddc30 2024-09-15T22:17:56.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.117+0000 7f3057400640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 0x556b2a0e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:56.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.118+0000 7f3057e00640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e9a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3050009b80 tx=0x7f3050009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad47bbdccbe123d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.118+0000 7f30611e5740 10 client.0 _ll_register_callbacks cb 0x556b2a01af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:56.124 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.118+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30480a46a0 con 0x556b2a0ddc30 2024-09-15T22:17:56.125 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.122+0000 7f3041600640 10 client.25454 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:17:56.125 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.122+0000 7f3041600640 1 -- 172.21.15.150:0/4078373643 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305004e030 con 0x556b2a0ddc30 2024-09-15T22:17:56.125 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.123+0000 7f3041600640 1 -- 172.21.15.150:0/4078373643 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3050003970 con 0x556b2a0ddc30 2024-09-15T22:17:56.125 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.123+0000 7f3041600640 1 -- 172.21.15.150:0/4078373643 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f305005a050 con 0x556b2a0ddc30 2024-09-15T22:17:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.129+0000 7f30611e5740 10 client.25454 fetch_fsmap learned FSMap version 39 2024-09-15T22:17:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.129+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=39}) -- 0x556b2a0ec690 con 0x556b2a0ddc30 2024-09-15T22:17:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f3041600640 1 -- 172.21.15.150:0/4078373643 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 39) ==== 8426+0+0 (secure 0 0 0) 0x7f3050049040 con 0x556b2a0ddc30 2024-09-15T22:17:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f30611e5740 10 client.25454 fetch_fsmap finished waiting for FSMap version 39 2024-09-15T22:17:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f30611e5740 10 client.25454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f30611e5740 20 client.25454 populate_metadata read hostname 'smithi150' 2024-09-15T22:17:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f30611e5740 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a0edda0 0x556b2a0f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f30611e5740 4 client.25454 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.137+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b2a04a830 con 0x556b2a0edda0 2024-09-15T22:17:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.145+0000 7f3057400640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a0edda0 0x556b2a0f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.145+0000 7f3057400640 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a0edda0 0x556b2a0f0230 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97aff45d62eae2aa server_cookie=c754580d477377b5 in_seq=0 out_seq=0 2024-09-15T22:17:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.148+0000 7f3041600640 10 client.25454 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.149+0000 7f3041600640 1 -- 172.21.15.150:0/4078373643 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b2a04a830 con 0x556b2a0edda0 2024-09-15T22:17:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.149+0000 7f3041600640 10 client.25454 handle_command_reply: tid=0 2024-09-15T22:17:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.150+0000 7f30611e5740 1 client.25454 shutdown 2024-09-15T22:17:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.153+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 msgr2=0x556b2a0e9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.153+0000 7f30611e5740 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e9a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3050009b80 tx=0x7f3050009500 comp rx=0 tx=0).stop 2024-09-15T22:17:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 shutdown_connections 2024-09-15T22:17:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a0edda0 0x556b2a0f0230 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0ddc30 0x556b2a0e9a20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 --2- 172.21.15.150:0/4078373643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0d8260 0x556b2a0e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 >> 172.21.15.150:0/4078373643 conn(0x556b2a0d38d0 msgr2=0x556b2a0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f3041600640 0 client.25454 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.176+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 shutdown_connections 2024-09-15T22:17:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.180+0000 7f30611e5740 1 -- 172.21.15.150:0/4078373643 wait complete. 2024-09-15T22:17:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.187+0000 7f30611e5740 20 client.25454 trim_cache size 0 max 16384 2024-09-15T22:17:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.556+0000 7f30611e5740 1 Processor -- start 2024-09-15T22:17:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.565+0000 7f30611e5740 1 -- start start 2024-09-15T22:17:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.568+0000 7f30611e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.568+0000 7f30611e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.568+0000 7f30611e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a0d3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.568+0000 7f30611e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30581c0650 con 0x556b2a0ddc30 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.568+0000 7f30611e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30581c23d0 con 0x556b2a0d8260 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.568+0000 7f30611e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30581c0d20 con 0x556b2a0d8ba0 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.571+0000 7f3057e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a0d3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.573+0000 7f3057e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a0d3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39964/0 (socket says 172.21.15.150:39964) 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.573+0000 7f3057e00640 1 -- 172.21.15.150:0/1038270886 learned_addr learned my addr 172.21.15.150:0/1038270886 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.579+0000 7f3056a00640 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.582+0000 7f3057e00640 1 -- 172.21.15.150:0/1038270886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 msgr2=0x556b2a0e9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.582+0000 7f3057e00640 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.582+0000 7f3057e00640 1 -- 172.21.15.150:0/1038270886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 msgr2=0x556b2a0e2a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:17:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.582+0000 7f3057e00640 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e2a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.582+0000 7f3057e00640 1 -- 172.21.15.150:0/1038270886 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2a0f08b0 con 0x556b2a0ddc30 2024-09-15T22:17:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.586+0000 7f3057e00640 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a0d3200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f305003dae0 tx=0x7f3050044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3f5a6673950405 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.589+0000 7f3043e00640 1 -- 172.21.15.150:0/1038270886 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305004e040 con 0x556b2a0ddc30 2024-09-15T22:17:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.596+0000 7f3043e00640 1 -- 172.21.15.150:0/1038270886 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30480a46a0 con 0x556b2a0ddc30 2024-09-15T22:17:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.599+0000 7f3043e00640 1 -- 172.21.15.150:0/1038270886 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305004e040 con 0x556b2a0ddc30 2024-09-15T22:17:56.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:56 smithi150 ceph-mon[30886]: pgmap v530: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 297 op/s 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.606+0000 7f30611e5740 1 -- 172.21.15.150:0/1038270886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 msgr2=0x556b2a0d3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.606+0000 7f30611e5740 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a0d3200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f305003dae0 tx=0x7f3050044000 comp rx=0 tx=0).stop 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.659+0000 7f30611e5740 1 -- 172.21.15.150:0/1038270886 shutdown_connections 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.659+0000 7f30611e5740 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a0d3200 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.659+0000 7f30611e5740 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.659+0000 7f30611e5740 1 --2- 172.21.15.150:0/1038270886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.659+0000 7f30611e5740 1 -- 172.21.15.150:0/1038270886 >> 172.21.15.150:0/1038270886 conn(0x556b2a0d38d0 msgr2=0x556b2a0e1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:56 smithi169 ceph-mon[35850]: pgmap v530: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 297 op/s 2024-09-15T22:17:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:56 smithi154 ceph-mon[34853]: pgmap v530: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 297 op/s 2024-09-15T22:17:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.800+0000 7f30611e5740 1 -- 172.21.15.150:0/1038270886 shutdown_connections 2024-09-15T22:17:56.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.825+0000 7f30611e5740 1 -- 172.21.15.150:0/1038270886 wait complete. 2024-09-15T22:17:56.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.825+0000 7f30611e5740 1 -- start start 2024-09-15T22:17:56.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.825+0000 7f30611e5740 1 Processor -- start 2024-09-15T22:17:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.827+0000 7f30611e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.827+0000 7f30611e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.830+0000 7f3057400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.832 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.830+0000 7f3057400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:40344/0 (socket says 172.21.15.150:40344) 2024-09-15T22:17:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.830+0000 7f30611e5740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.831+0000 7f3056a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.831+0000 7f3056a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:46170/0 (socket says 172.21.15.150:46170) 2024-09-15T22:17:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.831+0000 7f30611e5740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30581c1c40 con 0x556b2a0ddc30 2024-09-15T22:17:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.831+0000 7f30611e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30581c14b0 con 0x556b2a0d8260 2024-09-15T22:17:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.831+0000 7f30611e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30581be630 con 0x556b2a0d8ba0 2024-09-15T22:17:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.832+0000 7f30611e5740 10 client.0 _ll_register_callbacks cb 0x7f3044005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:56.836 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.833+0000 7f3057400640 1 -- 172.21.15.150:0/1687276610 learned_addr learned my addr 172.21.15.150:0/1687276610 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057e00640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057400640 1 -- 172.21.15.150:0/1687276610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 msgr2=0x556b2a0e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057400640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057400640 1 -- 172.21.15.150:0/1687276610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 msgr2=0x556b2a156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057400640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057400640 1 -- 172.21.15.150:0/1687276610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b2a1570f0 con 0x556b2a0d8260 2024-09-15T22:17:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.852+0000 7f3057e00640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.858+0000 7f3057400640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e6980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30440058c0 tx=0x7f3044012d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0e22bb15df1fee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.876+0000 7f3041600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.876+0000 7f3041600640 1 -- 172.21.15.150:0/1687276610 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044005220 con 0x556b2a0d8260 2024-09-15T22:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.876+0000 7f3041600640 1 -- 172.21.15.150:0/1687276610 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f30440053c0 con 0x556b2a0d8260 2024-09-15T22:17:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.933+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30480a46a0 con 0x556b2a0d8260 2024-09-15T22:17:56.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.973+0000 7f3041600640 1 -- 172.21.15.150:0/1687276610 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f30440055c0 con 0x556b2a0d8260 2024-09-15T22:17:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.973+0000 7f30611e5740 10 client.25457 fetch_fsmap learned FSMap version 39 2024-09-15T22:17:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.973+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556b2a158470 con 0x556b2a0d8260 2024-09-15T22:17:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f3041600640 1 -- 172.21.15.150:0/1687276610 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30480a46a0 con 0x556b2a0d8260 2024-09-15T22:17:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f3041600640 1 -- 172.21.15.150:0/1687276610 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 8426+0+0 (secure 0 0 0) 0x7f3044004c80 con 0x556b2a0d8260 2024-09-15T22:17:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f30611e5740 10 client.25457 fetch_fsmap finished waiting for FSMap version 39 2024-09-15T22:17:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f30611e5740 10 client.25457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f30611e5740 20 client.25457 populate_metadata read hostname 'smithi150' 2024-09-15T22:17:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f30611e5740 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a158ea0 0x556b2a15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f30611e5740 4 client.25457 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:17:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.977+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556b2a044b80 con 0x556b2a158ea0 2024-09-15T22:17:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.979+0000 7f3056a00640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a158ea0 0x556b2a15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.990+0000 7f3056a00640 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a158ea0 0x556b2a15b2c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e050f41ec455e48b server_cookie=ad26090c83a2c1e9 in_seq=0 out_seq=0 2024-09-15T22:17:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:17:56.991+0000 7f3041600640 10 client.25457 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:17:58.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:58 smithi150 ceph-mon[30886]: pgmap v531: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2024-09-15T22:17:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:58 smithi169 ceph-mon[35850]: pgmap v531: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2024-09-15T22:17:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:58 smithi154 ceph-mon[34853]: pgmap v531: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2024-09-15T22:17:59.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:17:59 smithi169 ceph-mon[35850]: pgmap v532: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.2 MiB/s wr, 489 op/s 2024-09-15T22:17:59.710 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:17:59 smithi150 ceph-mon[30886]: pgmap v532: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.2 MiB/s wr, 489 op/s 2024-09-15T22:17:59.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:17:59 smithi154 ceph-mon[34853]: pgmap v532: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.2 MiB/s wr, 489 op/s 2024-09-15T22:18:01.759 INFO:tasks.workunit.client.0.smithi150.stdout: 649 544338 1346 372056 1292 137053 91 2024-09-15T22:18:02.381 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:02 smithi150 ceph-mon[30886]: pgmap v533: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 675 op/s 2024-09-15T22:18:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:02 smithi169 ceph-mon[35850]: pgmap v533: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 675 op/s 2024-09-15T22:18:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:02 smithi154 ceph-mon[34853]: pgmap v533: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 675 op/s 2024-09-15T22:18:03.400 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:03.400 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:03 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:03 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:03 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.625+0000 7f3041600640 1 -- 172.21.15.150:0/1687276610 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556b2a044b80 con 0x556b2a158ea0 2024-09-15T22:18:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.626+0000 7f3041600640 10 client.25457 handle_command_reply: tid=0 2024-09-15T22:18:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.626+0000 7f30611e5740 1 client.25457 shutdown 2024-09-15T22:18:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.626+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 msgr2=0x556b2a0e6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.626+0000 7f30611e5740 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e6980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30440058c0 tx=0x7f3044012d80 comp rx=0 tx=0).stop 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.637+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 shutdown_connections 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.637+0000 7f30611e5740 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556b2a158ea0 0x556b2a15b2c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.637+0000 7f30611e5740 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556b2a0ddc30 0x556b2a156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.637+0000 7f30611e5740 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b2a0d8ba0 0x556b2a0e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.637+0000 7f30611e5740 1 --2- 172.21.15.150:0/1687276610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b2a0d8260 0x556b2a0e6980 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.637+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 >> 172.21.15.150:0/1687276610 conn(0x556b2a0d38d0 msgr2=0x556b2a0d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.638+0000 7f3041600640 0 client.25457 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:04.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.639+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 shutdown_connections 2024-09-15T22:18:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.670+0000 7f30611e5740 1 -- 172.21.15.150:0/1687276610 wait complete. 2024-09-15T22:18:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.670+0000 7f30611e5740 20 client.25457 trim_cache size 0 max 16384 2024-09-15T22:18:04.681 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:04 smithi150 ceph-mon[30886]: pgmap v534: 97 pgs: 97 active+clean; 2.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 18 MiB/s wr, 865 op/s 2024-09-15T22:18:04.681 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:04 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:18:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:18:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:18:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:18:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:18:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:04 smithi169 ceph-mon[35850]: pgmap v534: 97 pgs: 97 active+clean; 2.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 18 MiB/s wr, 865 op/s 2024-09-15T22:18:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:04 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.739+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f303c0a3450 msgr2=0x7f303c0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.739+0000 7f305ce00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f303c0a3450 0x7f303c0a5910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3050006010 tx=0x7f30500304a0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.739+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058073680 msgr2=0x7f3058115e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.739+0000 7f305ce00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058073680 0x7f3058115e90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f304800d6a0 tx=0x7f304800db60 comp rx=0 tx=0).stop 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 shutdown_connections 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f305810dbb0 0x7f30581b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f303c0a3450 0x7f303c0a5910 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3058073680 0x7f3058115e90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 --2- 172.21.15.150:0/2020998546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3058072cb0 0x7f3058115950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 >> 172.21.15.150:0/2020998546 conn(0x7f305806eb50 msgr2=0x7f305806f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.740+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 shutdown_connections 2024-09-15T22:18:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:04.746+0000 7f305ce00640 1 -- 172.21.15.150:0/2020998546 wait complete. 2024-09-15T22:18:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:04 smithi154 ceph-mon[34853]: pgmap v534: 97 pgs: 97 active+clean; 2.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 18 MiB/s wr, 865 op/s 2024-09-15T22:18:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:04 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:18:05.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:05 smithi150 ceph-mon[30886]: pgmap v535: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.15k op/s 2024-09-15T22:18:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:05 smithi169 ceph-mon[35850]: pgmap v535: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.15k op/s 2024-09-15T22:18:05.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:05 smithi154 ceph-mon[34853]: pgmap v535: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.15k op/s 2024-09-15T22:18:08.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:08 smithi150 ceph-mon[30886]: pgmap v536: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 20 MiB/s wr, 1.22k op/s 2024-09-15T22:18:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:08 smithi169 ceph-mon[35850]: pgmap v536: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 20 MiB/s wr, 1.22k op/s 2024-09-15T22:18:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:08 smithi154 ceph-mon[34853]: pgmap v536: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 20 MiB/s wr, 1.22k op/s 2024-09-15T22:18:10.679 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:10 smithi150 ceph-mon[30886]: pgmap v537: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 20 MiB/s wr, 1.27k op/s 2024-09-15T22:18:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:10 smithi169 ceph-mon[35850]: pgmap v537: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 20 MiB/s wr, 1.27k op/s 2024-09-15T22:18:10.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:10 smithi154 ceph-mon[34853]: pgmap v537: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 20 MiB/s wr, 1.27k op/s 2024-09-15T22:18:11.760 INFO:tasks.workunit.client.0.smithi150.stdout: 679 640693 1863 442295 1503 156346 710 2024-09-15T22:18:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:12 smithi150 ceph-mon[30886]: pgmap v538: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.07k op/s 2024-09-15T22:18:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:12 smithi169 ceph-mon[35850]: pgmap v538: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.07k op/s 2024-09-15T22:18:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:12 smithi154 ceph-mon[34853]: pgmap v538: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.07k op/s 2024-09-15T22:18:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:14 smithi150 ceph-mon[30886]: pgmap v539: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 869 op/s 2024-09-15T22:18:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:14 smithi169 ceph-mon[35850]: pgmap v539: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 869 op/s 2024-09-15T22:18:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:14 smithi154 ceph-mon[34853]: pgmap v539: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 869 op/s 2024-09-15T22:18:15.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:15 smithi169 ceph-mon[35850]: pgmap v540: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.8 MiB/s wr, 696 op/s 2024-09-15T22:18:15.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:15 smithi154 ceph-mon[34853]: pgmap v540: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.8 MiB/s wr, 696 op/s 2024-09-15T22:18:15.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:15 smithi150 ceph-mon[30886]: pgmap v540: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.8 MiB/s wr, 696 op/s 2024-09-15T22:18:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:18 smithi150 ceph-mon[30886]: pgmap v541: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 379 op/s 2024-09-15T22:18:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:18 smithi169 ceph-mon[35850]: pgmap v541: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 379 op/s 2024-09-15T22:18:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:18 smithi154 ceph-mon[34853]: pgmap v541: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 379 op/s 2024-09-15T22:18:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.499+0000 7f3422c00640 1 -- 172.21.15.150:0/2502387395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c072cb0 msgr2=0x7f341c0730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.499+0000 7f3422c00640 1 --2- 172.21.15.150:0/2502387395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c072cb0 0x7f341c0730b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34100098b0 tx=0x7f341002a390 comp rx=0 tx=0).stop 2024-09-15T22:18:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 -- 172.21.15.150:0/2502387395 shutdown_connections 2024-09-15T22:18:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 --2- 172.21.15.150:0/2502387395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 0x7f341c110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 --2- 172.21.15.150:0/2502387395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c073680 0x7f341c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 --2- 172.21.15.150:0/2502387395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c072cb0 0x7f341c0730b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 -- 172.21.15.150:0/2502387395 >> 172.21.15.150:0/2502387395 conn(0x7f341c06eb50 msgr2=0x7f341c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 -- 172.21.15.150:0/2502387395 shutdown_connections 2024-09-15T22:18:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.502+0000 7f3422c00640 1 -- 172.21.15.150:0/2502387395 wait complete. 2024-09-15T22:18:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.505+0000 7f3422c00640 1 Processor -- start 2024-09-15T22:18:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.507+0000 7f3422c00640 1 -- start start 2024-09-15T22:18:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.507+0000 7f3422c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c072cb0 0x7f341c1a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.512+0000 7f3422c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c073680 0x7f341c1a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3422c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 0x7f341c1ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3422c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f341c11c420 con 0x7f341c073680 2024-09-15T22:18:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3422c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f341c11c2a0 con 0x7f341c072cb0 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3422c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f341c11c5a0 con 0x7f341c10dbb0 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3421800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c072cb0 0x7f341c1a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3421800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c072cb0 0x7f341c1a6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53484/0 (socket says 172.21.15.150:53484) 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3421800640 1 -- 172.21.15.150:0/1373990145 learned_addr learned my addr 172.21.15.150:0/1373990145 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.514+0000 7f3422200640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 0x7f341c1ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.515+0000 7f3420e00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c073680 0x7f341c1a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.516+0000 7f3422200640 1 -- 172.21.15.150:0/1373990145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c072cb0 msgr2=0x7f341c1a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.516+0000 7f3422200640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c072cb0 0x7f341c1a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.516+0000 7f3422200640 1 -- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c073680 msgr2=0x7f341c1a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.516+0000 7f3422200640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c073680 0x7f341c1a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.516+0000 7f3422200640 1 -- 172.21.15.150:0/1373990145 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c1ae750 con 0x7f341c10dbb0 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.517+0000 7f3420e00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c073680 0x7f341c1a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.517+0000 7f3422200640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 0x7f341c1ae0e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f341400ca30 tx=0x7f341400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.518+0000 7f341a000640 1 -- 172.21.15.150:0/1373990145 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414004d20 con 0x7f341c10dbb0 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.518+0000 7f341a000640 1 -- 172.21.15.150:0/1373990145 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3414005020 con 0x7f341c10dbb0 2024-09-15T22:18:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.518+0000 7f341a000640 1 -- 172.21.15.150:0/1373990145 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341400f690 con 0x7f341c10dbb0 2024-09-15T22:18:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.519+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c1aea40 con 0x7f341c10dbb0 2024-09-15T22:18:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.520+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1aef10 con 0x7f341c10dbb0 2024-09-15T22:18:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.536+0000 7f3426fc4740 1 Processor -- start 2024-09-15T22:18:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.537+0000 7f341a000640 1 -- 172.21.15.150:0/1373990145 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f34140051d0 con 0x7f341c10dbb0 2024-09-15T22:18:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.541+0000 7f3426fc4740 1 -- start start 2024-09-15T22:18:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.541+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331a4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.542+0000 7f3420e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.542+0000 7f3420e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:51686/0 (socket says 172.21.15.150:51686) 2024-09-15T22:18:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.542+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331a9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.542+0000 7f3420e00640 1 -- 172.21.15.150:0/3185675811 learned_addr learned my addr 172.21.15.150:0/3185675811 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.543+0000 7f3421800640 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.543+0000 7f3426fc4740 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.543+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561833109100 con 0x5618331a9c30 2024-09-15T22:18:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.543+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5618330b11b0 con 0x5618331a4ba0 2024-09-15T22:18:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.543+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618331050c0 con 0x5618331a4260 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3421800640 1 -- 172.21.15.150:0/3185675811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 msgr2=0x5618331a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3421800640 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3421800640 1 -- 172.21.15.150:0/3185675811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 msgr2=0x5618331ac0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3420e00640 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3421800640 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3421800640 1 -- 172.21.15.150:0/3185675811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561832e1c210 con 0x5618331a4ba0 2024-09-15T22:18:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3420e00640 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:18:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.544+0000 7f3421800640 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331a9660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3410009880 tx=0x7f34100303d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e53266290ae84d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.563+0000 7f341a000640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34040a33d0 0x7f34040a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.563+0000 7f341a000640 1 -- 172.21.15.150:0/1373990145 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f34140cfdc0 con 0x7f341c10dbb0 2024-09-15T22:18:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.576+0000 7f340ea00640 1 -- 172.21.15.150:0/3185675811 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410037040 con 0x5618331a4ba0 2024-09-15T22:18:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.576+0000 7f340ea00640 1 -- 172.21.15.150:0/3185675811 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3410062020 con 0x5618331a4ba0 2024-09-15T22:18:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.576+0000 7f340ea00640 1 -- 172.21.15.150:0/3185675811 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34100053a0 con 0x5618331a4ba0 2024-09-15T22:18:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.577+0000 7f3420e00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34040a33d0 0x7f34040a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.578+0000 7f3420e00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34040a33d0 0x7f34040a5890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34080058c0 tx=0x7f3408004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.598+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 msgr2=0x5618331a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.598+0000 7f3426fc4740 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331a9660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3410009880 tx=0x7f34100303d0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.632+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 shutdown_connections 2024-09-15T22:18:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.632+0000 7f3426fc4740 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.632+0000 7f3426fc4740 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331a9660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.632+0000 7f3426fc4740 1 --2- 172.21.15.150:0/3185675811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.632+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 >> 172.21.15.150:0/3185675811 conn(0x56183319f8d0 msgr2=0x56183319fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.647+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 shutdown_connections 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.655+0000 7f3426fc4740 1 -- 172.21.15.150:0/3185675811 wait complete. 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.655+0000 7f3426fc4740 1 -- start start 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 Processor -- start 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 0x5618331b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5618331ac9e0 con 0x5618331a4260 2024-09-15T22:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561833092090 con 0x5618331a9c30 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618331acb60 con 0x5618331a4ba0 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.656+0000 7f3426fc4740 10 client.0 _ll_register_callbacks cb 0x5618330e6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.658+0000 7f3422200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 0x5618331b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.658+0000 7f3422200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 0x5618331b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53504/0 (socket says 172.21.15.150:53504) 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.658+0000 7f3422200640 1 -- 172.21.15.150:0/2417493558 learned_addr learned my addr 172.21.15.150:0/2417493558 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.660+0000 7f3420e00640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.660+0000 7f3421800640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.661+0000 7f3422200640 1 -- 172.21.15.150:0/2417493558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 msgr2=0x5618331ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.661+0000 7f3422200640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.661+0000 7f3422200640 1 -- 172.21.15.150:0/2417493558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 msgr2=0x5618331ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.661+0000 7f3422200640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.661+0000 7f3422200640 1 -- 172.21.15.150:0/2417493558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561832ee8620 con 0x5618331a9c30 2024-09-15T22:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.661+0000 7f3421800640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.670+0000 7f3422200640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 0x5618331b5800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34140a4b70 tx=0x7f34140173a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f7a26ee5b47dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.672+0000 7f3403400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:18:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.672+0000 7f3403400640 1 -- 172.21.15.150:0/2417493558 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34140b4070 con 0x5618331a9c30 2024-09-15T22:18:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.672+0000 7f3403400640 1 -- 172.21.15.150:0/2417493558 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f34140b5260 con 0x5618331a9c30 2024-09-15T22:18:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.676+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3410062020 con 0x5618331a9c30 2024-09-15T22:18:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.677+0000 7f3403400640 1 -- 172.21.15.150:0/2417493558 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f341409c430 con 0x5618331a9c30 2024-09-15T22:18:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.677+0000 7f3426fc4740 10 client.25469 fetch_fsmap learned FSMap version 40 2024-09-15T22:18:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.677+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5618331b8620 con 0x5618331a9c30 2024-09-15T22:18:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.677+0000 7f3403400640 1 -- 172.21.15.150:0/2417493558 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3410062020 con 0x5618331a9c30 2024-09-15T22:18:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3403400640 1 -- 172.21.15.150:0/2417493558 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 8422+0+0 (secure 0 0 0) 0x7f34140a6030 con 0x5618331a9c30 2024-09-15T22:18:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3426fc4740 10 client.25469 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:18:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3426fc4740 10 client.25469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3426fc4740 20 client.25469 populate_metadata read hostname 'smithi150' 2024-09-15T22:18:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5618331b9cf0 0x5618331bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3426fc4740 4 client.25469 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.678+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561833116830 con 0x5618331b9cf0 2024-09-15T22:18:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.679+0000 7f3421800640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5618331b9cf0 0x5618331bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.679+0000 7f3421800640 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5618331b9cf0 0x5618331bc160 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3a4aced921a3a33 server_cookie=40f541f947a8c634 in_seq=0 out_seq=0 2024-09-15T22:18:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.679+0000 7f3403400640 10 client.25469 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.680+0000 7f3403400640 1 -- 172.21.15.150:0/2417493558 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561833116830 con 0x5618331b9cf0 2024-09-15T22:18:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.680+0000 7f3403400640 10 client.25469 handle_command_reply: tid=0 2024-09-15T22:18:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.680+0000 7f3426fc4740 1 client.25469 shutdown 2024-09-15T22:18:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.694+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 msgr2=0x5618331b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.694+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 0x5618331b5800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34140a4b70 tx=0x7f34140173a0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.695+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 shutdown_connections 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.695+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5618331b9cf0 0x5618331bc160 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.695+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a9c30 0x5618331b5800 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.695+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.695+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2417493558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.695+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 >> 172.21.15.150:0/2417493558 conn(0x56183319f8d0 msgr2=0x5618331a10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.715+0000 7f3403400640 0 client.25469 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.726+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 shutdown_connections 2024-09-15T22:18:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.731+0000 7f3426fc4740 1 -- 172.21.15.150:0/2417493558 wait complete. 2024-09-15T22:18:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:19.731+0000 7f3426fc4740 20 client.25469 trim_cache size 0 max 16384 2024-09-15T22:18:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.232+0000 7f3426fc4740 1 Processor -- start 2024-09-15T22:18:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.248+0000 7f3426fc4740 1 -- start start 2024-09-15T22:18:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.249+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.249+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.249+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.249+0000 7f3420e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.249+0000 7f3420e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:44656/0 (socket says 172.21.15.150:44656) 2024-09-15T22:18:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.254+0000 7f3421800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.254+0000 7f3421800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:58314/0 (socket says 172.21.15.150:58314) 2024-09-15T22:18:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.287+0000 7f3426fc4740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1af500 con 0x5618331a9c30 2024-09-15T22:18:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.287+0000 7f3426fc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1b1250 con 0x5618331a4ba0 2024-09-15T22:18:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.287+0000 7f3426fc4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1afbd0 con 0x5618331a4260 2024-09-15T22:18:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.287+0000 7f3420e00640 1 -- 172.21.15.150:0/2761227186 learned_addr learned my addr 172.21.15.150:0/2761227186 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.289+0000 7f3422200640 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.289+0000 7f3422200640 1 -- 172.21.15.150:0/2761227186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 msgr2=0x5618331ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.289+0000 7f3422200640 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.289+0000 7f3422200640 1 -- 172.21.15.150:0/2761227186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 msgr2=0x5618331b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.289+0000 7f3422200640 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.289+0000 7f3422200640 1 -- 172.21.15.150:0/2761227186 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618331a5080 con 0x5618331a9c30 2024-09-15T22:18:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.290+0000 7f3422200640 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ae7c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f341409a6e0 tx=0x7f341409a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ab7247f50ca753 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.300+0000 7f340e000640 1 -- 172.21.15.150:0/2761227186 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34140ab070 con 0x5618331a9c30 2024-09-15T22:18:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.300+0000 7f340e000640 1 -- 172.21.15.150:0/2761227186 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34140a07e0 con 0x5618331a9c30 2024-09-15T22:18:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.301+0000 7f3426fc4740 1 -- 172.21.15.150:0/2761227186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 msgr2=0x5618331ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.301+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ae7c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f341409a6e0 tx=0x7f341409a940 comp rx=0 tx=0).stop 2024-09-15T22:18:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.302+0000 7f3426fc4740 1 -- 172.21.15.150:0/2761227186 shutdown_connections 2024-09-15T22:18:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.302+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a9c30 0x5618331ae7c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.302+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331a4ba0 0x5618331b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.302+0000 7f3426fc4740 1 --2- 172.21.15.150:0/2761227186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4260 0x5618331ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.302+0000 7f3426fc4740 1 -- 172.21.15.150:0/2761227186 >> 172.21.15.150:0/2761227186 conn(0x56183319f8d0 msgr2=0x5618331a5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.303+0000 7f3426fc4740 1 -- 172.21.15.150:0/2761227186 shutdown_connections 2024-09-15T22:18:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.303+0000 7f3426fc4740 1 -- 172.21.15.150:0/2761227186 wait complete. 2024-09-15T22:18:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.306+0000 7f3426fc4740 1 -- start start 2024-09-15T22:18:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.306+0000 7f3426fc4740 1 Processor -- start 2024-09-15T22:18:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.307+0000 7f3426fc4740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.307+0000 7f3421800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.308+0000 7f3421800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:51734/0 (socket says 172.21.15.150:51734) 2024-09-15T22:18:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.308+0000 7f3421800640 1 -- 172.21.15.150:0/4241627495 learned_addr learned my addr 172.21.15.150:0/4241627495 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.308+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.308+0000 7f3420e00640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.308+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331b4c00 0x5618331b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.309+0000 7f3422200640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331b4c00 0x5618331b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.309+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1b0af0 con 0x5618331a4260 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.309+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1b0360 con 0x5618331b4c00 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.309+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f341c117400 con 0x5618331a4ba0 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.310+0000 7f3421800640 1 -- 172.21.15.150:0/4241627495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 msgr2=0x5618331b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.310+0000 7f3421800640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.310+0000 7f3421800640 1 -- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331b4c00 msgr2=0x5618331b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.310+0000 7f3421800640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331b4c00 0x5618331b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.310+0000 7f3421800640 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618331b55f0 con 0x5618331a4260 2024-09-15T22:18:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.310+0000 7f3421800640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331b3770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f341002a3d0 tx=0x7f34100044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6a8ce63aea3433 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.311+0000 7f3422200640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331b4c00 0x5618331b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:18:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.311+0000 7f3426fc4740 10 client.0 _ll_register_callbacks cb 0x7f3414004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.311+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561833110b80 con 0x5618331a4260 2024-09-15T22:18:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.313+0000 7f3403400640 10 client.15462 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:18:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.313+0000 7f3403400640 1 -- 172.21.15.150:0/4241627495 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410037040 con 0x5618331a4260 2024-09-15T22:18:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.313+0000 7f3403400640 1 -- 172.21.15.150:0/4241627495 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3410030920 con 0x5618331a4260 2024-09-15T22:18:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3403400640 1 -- 172.21.15.150:0/4241627495 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3410005040 con 0x5618331a4260 2024-09-15T22:18:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3426fc4740 10 client.15462 fetch_fsmap learned FSMap version 40 2024-09-15T22:18:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({fsmap=40}) -- 0x561833224450 con 0x5618331a4260 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3403400640 1 -- 172.21.15.150:0/4241627495 <== mon.0 v2:172.21.15.150:3300/0 4 ==== fsmap(e 40) ==== 8422+0+0 (secure 0 0 0) 0x7f341002bce0 con 0x5618331a4260 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3426fc4740 10 client.15462 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3426fc4740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3426fc4740 20 client.15462 populate_metadata read hostname 'smithi150' 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.314+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561833224ed0 0x561833227390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.315+0000 7f3426fc4740 4 client.15462 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.315+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56183308d7c0 con 0x561833224ed0 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.315+0000 7f3420e00640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561833224ed0 0x561833227390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.316+0000 7f3420e00640 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561833224ed0 0x561833227390 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be10ac0b78de6df9 server_cookie=53bbb998c43e4db7 in_seq=0 out_seq=0 2024-09-15T22:18:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:20.316+0000 7f3403400640 10 client.15462 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:20.691 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:20 smithi150 ceph-mon[30886]: pgmap v542: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 257 op/s 2024-09-15T22:18:20.691 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:20 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:20 smithi169 ceph-mon[35850]: pgmap v542: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 257 op/s 2024-09-15T22:18:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:20 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:20 smithi154 ceph-mon[34853]: pgmap v542: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 257 op/s 2024-09-15T22:18:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:20 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:21.771 INFO:tasks.workunit.client.0.smithi150.stdout: 707 750311 1624 512977 1422 180454 907 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.421+0000 7f3403400640 1 -- 172.21.15.150:0/4241627495 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56183308d7c0 con 0x561833224ed0 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.421+0000 7f3403400640 10 client.15462 handle_command_reply: tid=0 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.421+0000 7f3426fc4740 1 client.15462 shutdown 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 msgr2=0x5618331b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331b3770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f341002a3d0 tx=0x7f34100044b0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 shutdown_connections 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561833224ed0 0x561833227390 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618331b4c00 0x5618331b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618331a4ba0 0x5618331b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 --2- 172.21.15.150:0/4241627495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618331a4260 0x5618331b3770 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 >> 172.21.15.150:0/4241627495 conn(0x56183319f8d0 msgr2=0x5618331a5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3403400640 0 client.15462 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 shutdown_connections 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 1 -- 172.21.15.150:0/4241627495 wait complete. 2024-09-15T22:18:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.422+0000 7f3426fc4740 20 client.15462 trim_cache size 0 max 16384 2024-09-15T22:18:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:18:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:18:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:18:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.423+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34040a33d0 msgr2=0x7f34040a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.423+0000 7f3422c00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34040a33d0 0x7f34040a5890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34080058c0 tx=0x7f3408004730 comp rx=0 tx=0).stop 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.423+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 msgr2=0x7f341c1ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.423+0000 7f3422c00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 0x7f341c1ae0e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f341400ca30 tx=0x7f341400ce30 comp rx=0 tx=0).stop 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 shutdown_connections 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c10dbb0 0x7f341c1ae0e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34040a33d0 0x7f34040a5890 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c073680 0x7f341c1a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 --2- 172.21.15.150:0/1373990145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c072cb0 0x7f341c1a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 >> 172.21.15.150:0/1373990145 conn(0x7f341c06eb50 msgr2=0x7f341c0708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 shutdown_connections 2024-09-15T22:18:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:22.424+0000 7f3422c00640 1 -- 172.21.15.150:0/1373990145 wait complete. 2024-09-15T22:18:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:22 smithi150 ceph-mon[30886]: pgmap v543: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-15T22:18:22.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:22 smithi169 ceph-mon[35850]: pgmap v543: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-15T22:18:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:22 smithi154 ceph-mon[34853]: pgmap v543: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-15T22:18:23.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:23 smithi169 ceph-mon[35850]: pgmap v544: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-09-15T22:18:23.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:23 smithi154 ceph-mon[34853]: pgmap v544: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-09-15T22:18:23.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:23 smithi150 ceph-mon[30886]: pgmap v544: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-09-15T22:18:26.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:26 smithi150 ceph-mon[30886]: pgmap v545: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 517 op/s 2024-09-15T22:18:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:26 smithi169 ceph-mon[35850]: pgmap v545: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 517 op/s 2024-09-15T22:18:26.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:26 smithi154 ceph-mon[34853]: pgmap v545: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 517 op/s 2024-09-15T22:18:28.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:28 smithi150 ceph-mon[30886]: pgmap v546: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 590 op/s 2024-09-15T22:18:28.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:28 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:28 smithi169 ceph-mon[35850]: pgmap v546: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 590 op/s 2024-09-15T22:18:28.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:28 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:28.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:28 smithi154 ceph-mon[34853]: pgmap v546: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 590 op/s 2024-09-15T22:18:28.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:28 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:30.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:30 smithi150 ceph-mon[30886]: pgmap v547: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 607 op/s 2024-09-15T22:18:30.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:30 smithi169 ceph-mon[35850]: pgmap v547: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 607 op/s 2024-09-15T22:18:30.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:30 smithi154 ceph-mon[34853]: pgmap v547: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 607 op/s 2024-09-15T22:18:32.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:32 smithi150 ceph-mon[30886]: pgmap v548: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 625 op/s 2024-09-15T22:18:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:32 smithi169 ceph-mon[35850]: pgmap v548: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 625 op/s 2024-09-15T22:18:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:32 smithi154 ceph-mon[34853]: pgmap v548: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 625 op/s 2024-09-15T22:18:33.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:33 smithi169 ceph-mon[35850]: pgmap v549: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.7 MiB/s wr, 654 op/s 2024-09-15T22:18:33.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:33 smithi154 ceph-mon[34853]: pgmap v549: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.7 MiB/s wr, 654 op/s 2024-09-15T22:18:33.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:33 smithi150 ceph-mon[30886]: pgmap v549: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.7 MiB/s wr, 654 op/s 2024-09-15T22:18:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 -- 172.21.15.150:0/781605549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 msgr2=0x7fa1141051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 --2- 172.21.15.150:0/781605549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa1141051e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa100009900 tx=0x7fa10002a410 comp rx=0 tx=0).stop 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 -- 172.21.15.150:0/781605549 shutdown_connections 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 --2- 172.21.15.150:0/781605549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 0x7fa11410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 --2- 172.21.15.150:0/781605549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa1141051e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 --2- 172.21.15.150:0/781605549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114103b70 0x7fa114103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 -- 172.21.15.150:0/781605549 >> 172.21.15.150:0/781605549 conn(0x7fa1140ff310 msgr2=0x7fa114101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 -- 172.21.15.150:0/781605549 shutdown_connections 2024-09-15T22:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.537+0000 7fa11aa00640 1 -- 172.21.15.150:0/781605549 wait complete. 2024-09-15T22:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 Processor -- start 2024-09-15T22:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 -- start start 2024-09-15T22:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114103b70 0x7fa114199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa11419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 0x7fa1141a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa11410f840 con 0x7fa114105720 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa11410f6c0 con 0x7fa114104d60 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.538+0000 7fa11aa00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa11410f9c0 con 0x7fa114103b70 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa11419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa11a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 0x7fa1141a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa11419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:48212/0 (socket says 172.21.15.150:48212) 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 -- 172.21.15.150:0/4039680747 learned_addr learned my addr 172.21.15.150:0/4039680747 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa119600640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114103b70 0x7fa114199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 -- 172.21.15.150:0/4039680747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114103b70 msgr2=0x7fa114199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114103b70 0x7fa114199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 -- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 msgr2=0x7fa1141a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 0x7fa1141a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 -- 172.21.15.150:0/4039680747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141a1ac0 con 0x7fa114104d60 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa11a000640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 0x7fa1141a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.539+0000 7fa118c00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa11419a3e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa100031440 tx=0x7fa100032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.540+0000 7fa112000640 1 -- 172.21.15.150:0/4039680747 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10003f030 con 0x7fa114104d60 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.540+0000 7fa112000640 1 -- 172.21.15.150:0/4039680747 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa100003ce0 con 0x7fa114104d60 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.540+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1141a1d50 con 0x7fa114104d60 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.540+0000 7fa112000640 1 -- 172.21.15.150:0/4039680747 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100035070 con 0x7fa114104d60 2024-09-15T22:18:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.540+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141a2230 con 0x7fa114104d60 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa112000640 1 -- 172.21.15.150:0/4039680747 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa100042030 con 0x7fa114104d60 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 Processor -- start 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 -- start start 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f02660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02ba0 0x5610f6f07660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6f0a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5610f6e67100 con 0x5610f6f02260 2024-09-15T22:18:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610f6e0f1b0 con 0x5610f6f07c30 2024-09-15T22:18:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.543+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5610f6e630c0 con 0x5610f6f02ba0 2024-09-15T22:18:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f02660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa118c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6f0a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f02660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35160/0 (socket says 172.21.15.150:35160) 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 -- 172.21.15.150:0/398818001 learned_addr learned my addr 172.21.15.150:0/398818001 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa119600640 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02ba0 0x5610f6f07660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 -- 172.21.15.150:0/398818001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02ba0 msgr2=0x5610f6f07660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02ba0 0x5610f6f07660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 -- 172.21.15.150:0/398818001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 msgr2=0x5610f6f0a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6f0a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 -- 172.21.15.150:0/398818001 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f6b7a210 con 0x5610f6f02260 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa112000640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0fc0a32c0 0x7fa0fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa112000640 1 -- 172.21.15.150:0/4039680747 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa1000efd90 con 0x7fa114104d60 2024-09-15T22:18:35.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa119600640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0fc0a32c0 0x7fa0fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.544+0000 7fa11a000640 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f02660 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0117e0 tx=0x7fa10c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e20281289ce6395 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa106600640 1 -- 172.21.15.150:0/398818001 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c011310 con 0x5610f6f02260 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa106600640 1 -- 172.21.15.150:0/398818001 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10c003e50 con 0x5610f6f02260 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa106600640 1 -- 172.21.15.150:0/398818001 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c004590 con 0x5610f6f02260 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 -- 172.21.15.150:0/398818001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 msgr2=0x5610f6f02660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa119600640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0fc0a32c0 0x7fa0fc0a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5610f6f035d0 tx=0x7fa108005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f02660 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0117e0 tx=0x7fa10c011ca0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 -- 172.21.15.150:0/398818001 shutdown_connections 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6f0a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02ba0 0x5610f6f07660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/398818001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f02660 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 -- 172.21.15.150:0/398818001 >> 172.21.15.150:0/398818001 conn(0x5610f6efd8d0 msgr2=0x5610f6efdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.545+0000 7fa11ee2d740 1 -- 172.21.15.150:0/398818001 shutdown_connections 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 -- 172.21.15.150:0/398818001 wait complete. 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 -- start start 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 Processor -- start 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f0c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f0c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.546+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5610f6f0ac00 con 0x5610f6f02260 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610f6df0090 con 0x5610f6f02ba0 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5610f6f0ad80 con 0x5610f6f07c30 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa11ee2d740 10 client.0 _ll_register_callbacks cb 0x5610f6e44f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa119600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f0c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f0c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f0c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:48218/0 (socket says 172.21.15.150:48218) 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 -- 172.21.15.150:0/2834495655 learned_addr learned my addr 172.21.15.150:0/2834495655 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa119600640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f0c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35176/0 (socket says 172.21.15.150:35176) 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa11a000640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 -- 172.21.15.150:0/2834495655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 msgr2=0x5610f6f139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 -- 172.21.15.150:0/2834495655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 msgr2=0x5610f6f0c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f0c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 -- 172.21.15.150:0/2834495655 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f6c46620 con 0x5610f6f02ba0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa118c00640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f0c9b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1000b8830 tx=0x7fa100032ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b9b1a70d999d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.547+0000 7fa0faa00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa0faa00640 1 -- 172.21.15.150:0/2834495655 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100049070 con 0x5610f6f02ba0 2024-09-15T22:18:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa0faa00640 1 -- 172.21.15.150:0/2834495655 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa100003800 con 0x5610f6f02ba0 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa10c003e50 con 0x5610f6f02ba0 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa0faa00640 1 -- 172.21.15.150:0/2834495655 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa1000bc1a0 con 0x5610f6f02ba0 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 10 client.25484 fetch_fsmap learned FSMap version 41 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5610f6f167e0 con 0x5610f6f02ba0 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa0faa00640 1 -- 172.21.15.150:0/2834495655 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10c003e50 con 0x5610f6f02ba0 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa0faa00640 1 -- 172.21.15.150:0/2834495655 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 41) ==== 8418+0+0 (secure 0 0 0) 0x7fa1000b8a40 con 0x5610f6f02ba0 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 10 client.25484 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 10 client.25484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 20 client.25484 populate_metadata read hostname 'smithi150' 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f17fa0 0x5610f6f1a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 4 client.25484 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.548+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610f6e74830 con 0x5610f6f17fa0 2024-09-15T22:18:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.549+0000 7fa119600640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f17fa0 0x5610f6f1a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.549+0000 7fa119600640 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f17fa0 0x5610f6f1a3e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4330ee427612323e server_cookie=16494e387437de58 in_seq=0 out_seq=0 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.549+0000 7fa0faa00640 10 client.25484 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa0faa00640 1 -- 172.21.15.150:0/2834495655 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610f6e74830 con 0x5610f6f17fa0 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa0faa00640 10 client.25484 handle_command_reply: tid=0 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 client.25484 shutdown 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 msgr2=0x5610f6f0c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f0c9b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1000b8830 tx=0x7fa100032ed0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 shutdown_connections 2024-09-15T22:18:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f17fa0 0x5610f6f1a3e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa0faa00640 0 client.25484 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f0c9b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2834495655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 >> 172.21.15.150:0/2834495655 conn(0x5610f6efd8d0 msgr2=0x5610f6eff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 shutdown_connections 2024-09-15T22:18:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2834495655 wait complete. 2024-09-15T22:18:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.550+0000 7fa11ee2d740 20 client.25484 trim_cache size 0 max 16384 2024-09-15T22:18:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 Processor -- start 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 -- start start 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 0x5610f6efe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 0x5610f6f139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6efecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141ab110 con 0x5610f6f02ba0 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141ace30 con 0x5610f6f07c30 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141ab7e0 con 0x5610f6f02260 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa118c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 0x5610f6f139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.565+0000 7fa119600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 0x5610f6efe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 0x5610f6f139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35188/0 (socket says 172.21.15.150:35188) 2024-09-15T22:18:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa119600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 0x5610f6efe780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:46918/0 (socket says 172.21.15.150:46918) 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 -- 172.21.15.150:0/3233278494 learned_addr learned my addr 172.21.15.150:0/3233278494 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa11a000640 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6efecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 -- 172.21.15.150:0/3233278494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 msgr2=0x5610f6efe780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 0x5610f6efe780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 -- 172.21.15.150:0/3233278494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 msgr2=0x5610f6efecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6efecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 -- 172.21.15.150:0/3233278494 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f6f0aae0 con 0x5610f6f02ba0 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa119600640 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 0x5610f6efe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa11a000640 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6efecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa118c00640 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 0x5610f6f139b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa100000c00 tx=0x7fa1000d5450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98387b51e7710363 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa105c00640 1 -- 172.21.15.150:0/3233278494 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100049070 con 0x5610f6f02ba0 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa105c00640 1 -- 172.21.15.150:0/3233278494 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1000d9020 con 0x5610f6f02ba0 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.566+0000 7fa105c00640 1 -- 172.21.15.150:0/3233278494 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100005d50 con 0x5610f6f02ba0 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 -- 172.21.15.150:0/3233278494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 msgr2=0x5610f6f139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 0x5610f6f139b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa100000c00 tx=0x7fa1000d5450 comp rx=0 tx=0).stop 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 -- 172.21.15.150:0/3233278494 shutdown_connections 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f07c30 0x5610f6efecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02ba0 0x5610f6f139b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/3233278494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f02260 0x5610f6efe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 -- 172.21.15.150:0/3233278494 >> 172.21.15.150:0/3233278494 conn(0x5610f6efd8d0 msgr2=0x5610f6f03de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 -- 172.21.15.150:0/3233278494 shutdown_connections 2024-09-15T22:18:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 -- 172.21.15.150:0/3233278494 wait complete. 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.567+0000 7fa11ee2d740 1 -- start start 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 Processor -- start 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f11a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141ac6d0 con 0x5610f6f02260 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141abf70 con 0x5610f6f02ba0 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141a90f0 con 0x5610f6f07c30 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11ee2d740 10 client.0 _ll_register_callbacks cb 0x7fa1000057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa119600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa119600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f11510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:35204/0 (socket says 172.21.15.150:35204) 2024-09-15T22:18:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa119600640 1 -- 172.21.15.150:0/2015039400 learned_addr learned my addr 172.21.15.150:0/2015039400 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa118c00640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f11a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.568+0000 7fa11a000640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa119600640 1 -- 172.21.15.150:0/2015039400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 msgr2=0x5610f6f129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa119600640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa119600640 1 -- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 msgr2=0x5610f6f11a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa119600640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f11a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa119600640 1 -- 172.21.15.150:0/2015039400 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f6f13000 con 0x5610f6f02260 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa118c00640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f11a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa119600640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f11510 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa108009b80 tx=0x7fa1080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa66ae61ccf9997 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa0faa00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa0faa00640 1 -- 172.21.15.150:0/2015039400 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108003a80 con 0x5610f6f02260 2024-09-15T22:18:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa0faa00640 1 -- 172.21.15.150:0/2015039400 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa108003c20 con 0x5610f6f02260 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1000d9020 con 0x5610f6f02260 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa0faa00640 1 -- 172.21.15.150:0/2015039400 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa108003e20 con 0x5610f6f02260 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa11ee2d740 10 client.15480 fetch_fsmap learned FSMap version 41 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.569+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5610f6f8b8f0 con 0x5610f6f02260 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa0faa00640 1 -- 172.21.15.150:0/2015039400 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1000d9020 con 0x5610f6f02260 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa0faa00640 1 -- 172.21.15.150:0/2015039400 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 41) ==== 8418+0+0 (secure 0 0 0) 0x7fa10802b380 con 0x5610f6f02260 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa11ee2d740 10 client.15480 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa11ee2d740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa11ee2d740 20 client.15480 populate_metadata read hostname 'smithi150' 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f8c310 0x5610f6f8e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa11ee2d740 4 client.15480 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5610f6e6eb80 con 0x5610f6f8c310 2024-09-15T22:18:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.570+0000 7fa118c00640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f8c310 0x5610f6f8e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.571+0000 7fa118c00640 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f8c310 0x5610f6f8e730 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=647cab97d7d9cf9c server_cookie=40478fdfb3503da3 in_seq=0 out_seq=0 2024-09-15T22:18:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.571+0000 7fa0faa00640 10 client.15480 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa0faa00640 1 -- 172.21.15.150:0/2015039400 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5610f6e6eb80 con 0x5610f6f8c310 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa0faa00640 10 client.15480 handle_command_reply: tid=0 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 client.15480 shutdown 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 msgr2=0x5610f6f11510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f11510 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa108009b80 tx=0x7fa1080046c0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 shutdown_connections 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5610f6f8c310 0x5610f6f8e730 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610f6f07c30 0x5610f6f129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610f6f02ba0 0x5610f6f11a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 --2- 172.21.15.150:0/2015039400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5610f6f02260 0x5610f6f11510 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa0faa00640 0 client.15480 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.812+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 >> 172.21.15.150:0/2015039400 conn(0x5610f6efd8d0 msgr2=0x5610f6efc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 shutdown_connections 2024-09-15T22:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11ee2d740 1 -- 172.21.15.150:0/2015039400 wait complete. 2024-09-15T22:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11ee2d740 20 client.15480 trim_cache size 0 max 16384 2024-09-15T22:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:18:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0fc0a32c0 msgr2=0x7fa0fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0fc0a32c0 0x7fa0fc0a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5610f6f035d0 tx=0x7fa108005f90 comp rx=0 tx=0).stop 2024-09-15T22:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 msgr2=0x7fa11419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa11419a3e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa100031440 tx=0x7fa100032ce0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 shutdown_connections 2024-09-15T22:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa0fc0a32c0 0x7fa0fc0a5780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa114105720 0x7fa1141a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa114104d60 0x7fa11419a3e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 --2- 172.21.15.150:0/4039680747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114103b70 0x7fa114199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.813+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 >> 172.21.15.150:0/4039680747 conn(0x7fa1140ff310 msgr2=0x7fa114108130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.814+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 shutdown_connections 2024-09-15T22:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:35.814+0000 7fa11aa00640 1 -- 172.21.15.150:0/4039680747 wait complete. 2024-09-15T22:18:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:36 smithi150 ceph-mon[30886]: pgmap v550: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.0 MiB/s wr, 624 op/s 2024-09-15T22:18:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:36 smithi169 ceph-mon[35850]: pgmap v550: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.0 MiB/s wr, 624 op/s 2024-09-15T22:18:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:36 smithi154 ceph-mon[34853]: pgmap v550: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.0 MiB/s wr, 624 op/s 2024-09-15T22:18:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:38 smithi150 ceph-mon[30886]: pgmap v551: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 6.5 MiB/s wr, 397 op/s 2024-09-15T22:18:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:38 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:38 smithi169 ceph-mon[35850]: pgmap v551: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 6.5 MiB/s wr, 397 op/s 2024-09-15T22:18:38.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:38 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:38.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:38 smithi154 ceph-mon[34853]: pgmap v551: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 6.5 MiB/s wr, 397 op/s 2024-09-15T22:18:38.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:38 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:18:40.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:40 smithi150 ceph-mon[30886]: pgmap v552: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 7.1 MiB/s wr, 374 op/s 2024-09-15T22:18:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:40 smithi169 ceph-mon[35850]: pgmap v552: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 7.1 MiB/s wr, 374 op/s 2024-09-15T22:18:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:40 smithi154 ceph-mon[34853]: pgmap v552: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 7.1 MiB/s wr, 374 op/s 2024-09-15T22:18:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:42 smithi150 ceph-mon[30886]: pgmap v553: 97 pgs: 97 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 6.9 MiB/s wr, 409 op/s 2024-09-15T22:18:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:42 smithi169 ceph-mon[35850]: pgmap v553: 97 pgs: 97 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 6.9 MiB/s wr, 409 op/s 2024-09-15T22:18:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:42 smithi154 ceph-mon[34853]: pgmap v553: 97 pgs: 97 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 6.9 MiB/s wr, 409 op/s 2024-09-15T22:18:44.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:44 smithi150 ceph-mon[30886]: pgmap v554: 97 pgs: 97 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 7.6 MiB/s wr, 442 op/s 2024-09-15T22:18:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:44 smithi169 ceph-mon[35850]: pgmap v554: 97 pgs: 97 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 7.6 MiB/s wr, 442 op/s 2024-09-15T22:18:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:44 smithi154 ceph-mon[34853]: pgmap v554: 97 pgs: 97 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 7.6 MiB/s wr, 442 op/s 2024-09-15T22:18:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:46 smithi150 ceph-mon[30886]: pgmap v555: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 8.9 MiB/s wr, 517 op/s 2024-09-15T22:18:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:46 smithi169 ceph-mon[35850]: pgmap v555: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 8.9 MiB/s wr, 517 op/s 2024-09-15T22:18:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:46 smithi154 ceph-mon[34853]: pgmap v555: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 8.9 MiB/s wr, 517 op/s 2024-09-15T22:18:47.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:47 smithi169 ceph-mon[35850]: pgmap v556: 97 pgs: 97 active+clean; 2.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 9.0 MiB/s wr, 518 op/s 2024-09-15T22:18:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:47 smithi154 ceph-mon[34853]: pgmap v556: 97 pgs: 97 active+clean; 2.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 9.0 MiB/s wr, 518 op/s 2024-09-15T22:18:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:47 smithi150 ceph-mon[30886]: pgmap v556: 97 pgs: 97 active+clean; 2.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 9.0 MiB/s wr, 518 op/s 2024-09-15T22:18:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 -- 172.21.15.150:0/1464366721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20103710 msgr2=0x7f4b20109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 --2- 172.21.15.150:0/1464366721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20103710 0x7f4b20109fa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009ca0 tx=0x7f4b1c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 -- 172.21.15.150:0/1464366721 shutdown_connections 2024-09-15T22:18:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 --2- 172.21.15.150:0/1464366721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20103710 0x7f4b20109fa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 --2- 172.21.15.150:0/1464366721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20102d50 0x7f4b201031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 --2- 172.21.15.150:0/1464366721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b20101b60 0x7f4b20101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 -- 172.21.15.150:0/1464366721 >> 172.21.15.150:0/1464366721 conn(0x7f4b200fd2e0 msgr2=0x7f4b200ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 -- 172.21.15.150:0/1464366721 shutdown_connections 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.939+0000 7f4b28800640 1 -- 172.21.15.150:0/1464366721 wait complete. 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 Processor -- start 2024-09-15T22:18:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 -- start start 2024-09-15T22:18:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 0x7f4b20197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b20102d50 0x7f4b201982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20103710 0x7f4b2019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2010d830 con 0x7f4b20101b60 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2010d6b0 con 0x7f4b20102d50 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b28800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2010d9b0 con 0x7f4b20103710 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 0x7f4b20197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 0x7f4b20197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36014/0 (socket says 172.21.15.150:36014) 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b25e00640 1 -- 172.21.15.150:0/1072147107 learned_addr learned my addr 172.21.15.150:0/1072147107 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.941+0000 7f4b26800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20103710 0x7f4b2019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25400640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b20102d50 0x7f4b201982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25e00640 1 -- 172.21.15.150:0/1072147107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20103710 msgr2=0x7f4b2019f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20103710 0x7f4b2019f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25e00640 1 -- 172.21.15.150:0/1072147107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b20102d50 msgr2=0x7f4b201982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b20102d50 0x7f4b201982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25e00640 1 -- 172.21.15.150:0/1072147107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2019f980 con 0x7f4b20101b60 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b26800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20103710 0x7f4b2019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 0x7f4b20197d60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400e9c0 tx=0x7f4b1400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b1aa00640 1 -- 172.21.15.150:0/1072147107 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400cd80 con 0x7f4b20101b60 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b1aa00640 1 -- 172.21.15.150:0/1072147107 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b140035f0 con 0x7f4b20101b60 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b1aa00640 1 -- 172.21.15.150:0/1072147107 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14010690 con 0x7f4b20101b60 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.942+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2019fc70 con 0x7f4b20101b60 2024-09-15T22:18:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.943+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b201a01c0 con 0x7f4b20101b60 2024-09-15T22:18:48.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.947+0000 7f4b2b853740 1 Processor -- start 2024-09-15T22:18:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.947+0000 7f4b2b853740 1 -- start start 2024-09-15T22:18:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.947+0000 7f4b1aa00640 1 -- 172.21.15.150:0/1072147107 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f4b140037a0 con 0x7f4b20101b60 2024-09-15T22:18:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.947+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e4154b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.947+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.947+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e41550e70 0x560e41553330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b2b853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560e414ac100 con 0x560e4154b4a0 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b2b853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e414541b0 con 0x560e41550e70 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b2b853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e414a80c0 con 0x560e4154bde0 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b26800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e4154b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b26800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e4154b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36030/0 (socket says 172.21.15.150:36030) 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b26800640 1 -- 172.21.15.150:0/3531278388 learned_addr learned my addr 172.21.15.150:0/3531278388 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25400640 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e41550e70 0x560e41553330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25e00640 1 -- 172.21.15.150:0/3531278388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e41550e70 msgr2=0x560e41553330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25e00640 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e41550e70 0x560e41553330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25e00640 1 -- 172.21.15.150:0/3531278388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 msgr2=0x560e4154b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25e00640 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e4154b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b25e00640 1 -- 172.21.15.150:0/3531278388 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e411bf210 con 0x560e4154bde0 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.948+0000 7f4b26800640 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e4154b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b25e00640 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415508a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b140cd710 tx=0x7f4b140d8750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a8c52397abd32e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b1aa00640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b080a3370 0x7f4b080a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b0f000640 1 -- 172.21.15.150:0/3531278388 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140e2670 con 0x560e4154bde0 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b0f000640 1 -- 172.21.15.150:0/3531278388 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b140dd070 con 0x560e4154bde0 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b0f000640 1 -- 172.21.15.150:0/3531278388 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14077c30 con 0x560e4154bde0 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b1aa00640 1 -- 172.21.15.150:0/1072147107 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4b140cfd00 con 0x7f4b20101b60 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.949+0000 7f4b26800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b080a3370 0x7f4b080a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 -- 172.21.15.150:0/3531278388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 msgr2=0x560e415508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415508a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b140cd710 tx=0x7f4b140d8750 comp rx=0 tx=0).stop 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b26800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b080a3370 0x7f4b080a5830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c02f540 tx=0x7f4b1c031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 -- 172.21.15.150:0/3531278388 shutdown_connections 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e41550e70 0x560e41553330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415508a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3531278388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e4154b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 -- 172.21.15.150:0/3531278388 >> 172.21.15.150:0/3531278388 conn(0x560e41542700 msgr2=0x560e41542b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 -- 172.21.15.150:0/3531278388 shutdown_connections 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.950+0000 7f4b2b853740 1 -- 172.21.15.150:0/3531278388 wait complete. 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 -- start start 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 Processor -- start 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e41555610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 0x560e41555b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41550e70 0x560e4155cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560e41553e40 con 0x560e4154b4a0 2024-09-15T22:18:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560e41435090 con 0x560e4154bde0 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e41553fc0 con 0x560e41550e70 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.951+0000 7f4b2b853740 10 client.0 _ll_register_callbacks cb 0x560e41489f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e41555610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 0x560e41555b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e41555610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36042/0 (socket says 172.21.15.150:36042) 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 -- 172.21.15.150:0/3894330635 learned_addr learned my addr 172.21.15.150:0/3894330635 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 0x560e41555b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:58084/0 (socket says 172.21.15.150:58084) 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b26800640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41550e70 0x560e4155cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 -- 172.21.15.150:0/3894330635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41550e70 msgr2=0x560e4155cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41550e70 0x560e4155cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 -- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 msgr2=0x560e41555b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 0x560e41555b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 -- 172.21.15.150:0/3894330635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4128b620 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b26800640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41550e70 0x560e4155cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25400640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 0x560e41555b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b25e00640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e41555610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b140058c0 tx=0x7f4b140097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200287a48c25072f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b03400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.952+0000 7f4b03400640 1 -- 172.21.15.150:0/3894330635 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14075620 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b03400640 1 -- 172.21.15.150:0/3894330635 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4b14073e00 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b140dd070 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b03400640 1 -- 172.21.15.150:0/3894330635 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4b14075820 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 10 client.15492 fetch_fsmap learned FSMap version 42 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560e4155f980 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b03400640 1 -- 172.21.15.150:0/3894330635 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b140dd070 con 0x560e4154b4a0 2024-09-15T22:18:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b03400640 1 -- 172.21.15.150:0/3894330635 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7f4b14098900 con 0x560e4154b4a0 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 10 client.15492 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 10 client.15492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 20 client.15492 populate_metadata read hostname 'smithi150' 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41560cd0 0x560e415630c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 4 client.15492 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.953+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e414b9830 con 0x560e41560cd0 2024-09-15T22:18:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.954+0000 7f4b25400640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41560cd0 0x560e415630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.954+0000 7f4b25400640 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41560cd0 0x560e415630c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cecdafd30887c1b server_cookie=ac18e1267a6a8659 in_seq=0 out_seq=0 2024-09-15T22:18:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.954+0000 7f4b03400640 10 client.15492 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b03400640 1 -- 172.21.15.150:0/3894330635 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e414b9830 con 0x560e41560cd0 2024-09-15T22:18:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b03400640 10 client.15492 handle_command_reply: tid=0 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 client.15492 shutdown 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 msgr2=0x560e41555610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e41555610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b140058c0 tx=0x7f4b140097b0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 shutdown_connections 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41560cd0 0x560e415630c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41550e70 0x560e4155cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154bde0 0x560e41555b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 --2- 172.21.15.150:0/3894330635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154b4a0 0x560e41555610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 >> 172.21.15.150:0/3894330635 conn(0x560e41542700 msgr2=0x560e41543f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b03400640 0 client.15492 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 shutdown_connections 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.955+0000 7f4b2b853740 1 -- 172.21.15.150:0/3894330635 wait complete. 2024-09-15T22:18:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.956+0000 7f4b2b853740 20 client.15492 trim_cache size 0 max 16384 2024-09-15T22:18:48.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.970+0000 7f4b2b853740 1 Processor -- start 2024-09-15T22:18:48.973 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 -- start start 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 0x560e415551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e41555730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415435b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201a6e20 con 0x560e41542700 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201a8b70 con 0x560e4154b4a0 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b2b853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201a74f0 con 0x560e4154bde0 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 0x560e415551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 0x560e415551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:36052/0 (socket says 172.21.15.150:36052) 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 -- 172.21.15.150:0/1226976931 learned_addr learned my addr 172.21.15.150:0/1226976931 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b26800640 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25400640 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e41555730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.974 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 -- 172.21.15.150:0/1226976931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 msgr2=0x560e415435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 -- 172.21.15.150:0/1226976931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 msgr2=0x560e41555730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e41555730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.971+0000 7f4b25e00640 1 -- 172.21.15.150:0/1226976931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e41542520 con 0x560e41542700 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 0x560e415551f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b140986f0 tx=0x7f4b140d8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0de1d7949845ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b0e600640 1 -- 172.21.15.150:0/1226976931 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14075a20 con 0x560e41542700 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b0e600640 1 -- 172.21.15.150:0/1226976931 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b14074070 con 0x560e41542700 2024-09-15T22:18:48.975 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b0e600640 1 -- 172.21.15.150:0/1226976931 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14075c20 con 0x560e41542700 2024-09-15T22:18:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 -- 172.21.15.150:0/1226976931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 msgr2=0x560e415551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 0x560e415551f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b140986f0 tx=0x7f4b140d8d50 comp rx=0 tx=0).stop 2024-09-15T22:18:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 -- 172.21.15.150:0/1226976931 shutdown_connections 2024-09-15T22:18:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e4154bde0 0x560e415435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e41555730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1226976931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e41542700 0x560e415551f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.972+0000 7f4b2b853740 1 -- 172.21.15.150:0/1226976931 >> 172.21.15.150:0/1226976931 conn(0x560e415509c0 msgr2=0x560e41562ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 -- 172.21.15.150:0/1226976931 shutdown_connections 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 -- 172.21.15.150:0/1226976931 wait complete. 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 -- start start 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 Processor -- start 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41542700 0x560e41549cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e4154a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154bde0 0x560e4155cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201a8410 con 0x560e4154bde0 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201a7c80 con 0x560e4154b4a0 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.973+0000 7f4b2b853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201a4e00 con 0x560e41542700 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b2b853740 10 client.0 _ll_register_callbacks cb 0x7f4b10005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e4154a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b26800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154bde0 0x560e4155cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e4154a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:58098/0 (socket says 172.21.15.150:58098) 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 -- 172.21.15.150:0/1638352660 learned_addr learned my addr 172.21.15.150:0/1638352660 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41542700 0x560e41549cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 -- 172.21.15.150:0/1638352660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41542700 msgr2=0x560e41549cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41542700 0x560e41549cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 -- 172.21.15.150:0/1638352660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154bde0 msgr2=0x560e4155cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154bde0 0x560e4155cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 -- 172.21.15.150:0/1638352660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e415ce0e0 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b25400640 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e4154a230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x560e41543580 tx=0x7f4b10012ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b75f4fc647626c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.974+0000 7f4b03400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b03400640 1 -- 172.21.15.150:0/1638352660 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10004230 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b03400640 1 -- 172.21.15.150:0/1638352660 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f4b100043d0 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b14074070 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b03400640 1 -- 172.21.15.150:0/1638352660 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4b100035f0 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 10 client.25508 fetch_fsmap learned FSMap version 42 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560e415cf4c0 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b03400640 1 -- 172.21.15.150:0/1638352660 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b14074070 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b03400640 1 -- 172.21.15.150:0/1638352660 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7f4b10025070 con 0x560e4154b4a0 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 10 client.25508 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:18:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 20 client.25508 populate_metadata read hostname 'smithi150' 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41550e70 0x560e415d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 4 client.25508 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.975+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e414b3b80 con 0x560e41550e70 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.976+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41550e70 0x560e415d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.976+0000 7f4b25e00640 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41550e70 0x560e415d1f20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d33a1f39cce7534 server_cookie=bfca87d8941221a6 in_seq=0 out_seq=0 2024-09-15T22:18:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:48.976+0000 7f4b03400640 10 client.25508 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.167+0000 7f4b03400640 1 -- 172.21.15.150:0/1638352660 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e414b3b80 con 0x560e41550e70 2024-09-15T22:18:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b03400640 10 client.25508 handle_command_reply: tid=0 2024-09-15T22:18:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 client.25508 shutdown 2024-09-15T22:18:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 msgr2=0x560e4154a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e4154a230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x560e41543580 tx=0x7f4b10012ae0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 shutdown_connections 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560e41550e70 0x560e415d1f20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560e4154bde0 0x560e4155cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560e4154b4a0 0x560e4154a230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b03400640 0 client.25508 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 --2- 172.21.15.150:0/1638352660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e41542700 0x560e41549cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 >> 172.21.15.150:0/1638352660 conn(0x560e415509c0 msgr2=0x560e415551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 shutdown_connections 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 1 -- 172.21.15.150:0/1638352660 wait complete. 2024-09-15T22:18:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.168+0000 7f4b2b853740 20 client.25508 trim_cache size 0 max 16384 2024-09-15T22:18:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:18:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:18:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:18:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b080a3370 msgr2=0x7f4b080a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b080a3370 0x7f4b080a5830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c02f540 tx=0x7f4b1c031bb0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 msgr2=0x7f4b20197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 0x7f4b20197d60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400e9c0 tx=0x7f4b1400ee80 comp rx=0 tx=0).stop 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 shutdown_connections 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b20103710 0x7f4b2019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b20102d50 0x7f4b201982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f4b080a3370 0x7f4b080a5830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 --2- 172.21.15.150:0/1072147107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b20101b60 0x7f4b20197d60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 >> 172.21.15.150:0/1072147107 conn(0x7f4b200fd2e0 msgr2=0x7f4b20106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.169+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 shutdown_connections 2024-09-15T22:18:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:18:49.170+0000 7f4b28800640 1 -- 172.21.15.150:0/1072147107 wait complete. 2024-09-15T22:18:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:50 smithi150 ceph-mon[30886]: pgmap v557: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 10 MiB/s wr, 554 op/s 2024-09-15T22:18:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:50 smithi169 ceph-mon[35850]: pgmap v557: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 10 MiB/s wr, 554 op/s 2024-09-15T22:18:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:50 smithi154 ceph-mon[34853]: pgmap v557: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 10 MiB/s wr, 554 op/s 2024-09-15T22:18:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:51 smithi150 ceph-mon[30886]: pgmap v558: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 506 op/s 2024-09-15T22:18:51.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:51 smithi169 ceph-mon[35850]: pgmap v558: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 506 op/s 2024-09-15T22:18:52.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:51 smithi154 ceph-mon[34853]: pgmap v558: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 506 op/s 2024-09-15T22:18:54.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:54 smithi150 ceph-mon[30886]: pgmap v559: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 10 MiB/s wr, 483 op/s 2024-09-15T22:18:54.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:54 smithi169 ceph-mon[35850]: pgmap v559: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 10 MiB/s wr, 483 op/s 2024-09-15T22:18:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:54 smithi154 ceph-mon[34853]: pgmap v559: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 10 MiB/s wr, 483 op/s 2024-09-15T22:18:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:56 smithi150 ceph-mon[30886]: pgmap v560: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 528 op/s 2024-09-15T22:18:56.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:56 smithi169 ceph-mon[35850]: pgmap v560: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 528 op/s 2024-09-15T22:18:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:56 smithi154 ceph-mon[34853]: pgmap v560: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 528 op/s 2024-09-15T22:18:58.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:18:58 smithi150 ceph-mon[30886]: pgmap v561: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 446 op/s 2024-09-15T22:18:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:18:58 smithi169 ceph-mon[35850]: pgmap v561: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 446 op/s 2024-09-15T22:18:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:18:58 smithi154 ceph-mon[34853]: pgmap v561: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 446 op/s 2024-09-15T22:19:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:00 smithi150 ceph-mon[30886]: pgmap v562: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.2 MiB/s wr, 396 op/s 2024-09-15T22:19:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:00 smithi169 ceph-mon[35850]: pgmap v562: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.2 MiB/s wr, 396 op/s 2024-09-15T22:19:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:00 smithi154 ceph-mon[34853]: pgmap v562: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.2 MiB/s wr, 396 op/s 2024-09-15T22:19:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 -- 172.21.15.150:0/3638030744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17401036f0 msgr2=0x7f1740109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 --2- 172.21.15.150:0/3638030744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17401036f0 0x7f1740109f80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1738009ca0 tx=0x7f173802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 -- 172.21.15.150:0/3638030744 shutdown_connections 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 --2- 172.21.15.150:0/3638030744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17401036f0 0x7f1740109f80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 --2- 172.21.15.150:0/3638030744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740102d30 0x7f17401031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 --2- 172.21.15.150:0/3638030744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740101b40 0x7f1740101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 -- 172.21.15.150:0/3638030744 >> 172.21.15.150:0/3638030744 conn(0x7f17400fd2e0 msgr2=0x7f17400ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 -- 172.21.15.150:0/3638030744 shutdown_connections 2024-09-15T22:19:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.292+0000 7f1746600640 1 -- 172.21.15.150:0/3638030744 wait complete. 2024-09-15T22:19:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.293+0000 7f1746600640 1 Processor -- start 2024-09-15T22:19:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.293+0000 7f1746600640 1 -- start start 2024-09-15T22:19:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f1746600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740101b40 0x7f1740075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f1746600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 0x7f17400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f1746600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17401036f0 0x7f1740074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f1746600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f174010d7c0 con 0x7f1740102d30 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f1746600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f174010d640 con 0x7f1740101b40 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f1746600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f174010d940 con 0x7f17401036f0 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 0x7f17400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 0x7f17400745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48810/0 (socket says 172.21.15.150:48810) 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 -- 172.21.15.150:0/3386888430 learned_addr learned my addr 172.21.15.150:0/3386888430 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173f400640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740101b40 0x7f1740075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173fe00640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17401036f0 0x7f1740074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 -- 172.21.15.150:0/3386888430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17401036f0 msgr2=0x7f1740074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17401036f0 0x7f1740074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 -- 172.21.15.150:0/3386888430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740101b40 msgr2=0x7f1740075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.294+0000 7f173ea00640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740101b40 0x7f1740075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f173ea00640 1 -- 172.21.15.150:0/3386888430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17400753b0 con 0x7f1740102d30 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f173f400640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740101b40 0x7f1740075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f173ea00640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 0x7f17400745e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f172c00ea60 tx=0x7f172c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f1737e00640 1 -- 172.21.15.150:0/3386888430 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c00cde0 con 0x7f1740102d30 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f1737e00640 1 -- 172.21.15.150:0/3386888430 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f172c0035f0 con 0x7f1740102d30 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f1737e00640 1 -- 172.21.15.150:0/3386888430 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c010670 con 0x7f1740102d30 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17401a1eb0 con 0x7f1740102d30 2024-09-15T22:19:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.295+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17401a2320 con 0x7f1740102d30 2024-09-15T22:19:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.299+0000 7f1749619740 1 Processor -- start 2024-09-15T22:19:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.299+0000 7f1749619740 1 -- start start 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1749619740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b611490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1749619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b6119d0 0x557e4b616490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1749619740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b616a60 0x557e4b618f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1749619740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557e4b576100 con 0x557e4b611090 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1749619740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557e4b51e1b0 con 0x557e4b616a60 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1749619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557e4b5720c0 con 0x557e4b6119d0 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f173fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b611490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f173fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b611490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48822/0 (socket says 172.21.15.150:48822) 2024-09-15T22:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f173fe00640 1 -- 172.21.15.150:0/4286770624 learned_addr learned my addr 172.21.15.150:0/4286770624 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f1737e00640 1 -- 172.21.15.150:0/3386888430 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f172c0037a0 con 0x7f1740102d30 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.300+0000 7f173f400640 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b6119d0 0x557e4b616490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f173fe00640 1 -- 172.21.15.150:0/4286770624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b6119d0 msgr2=0x557e4b616490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f173fe00640 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b6119d0 0x557e4b616490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f173fe00640 1 -- 172.21.15.150:0/4286770624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b616a60 msgr2=0x557e4b618f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f173fe00640 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b616a60 0x557e4b618f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f173fe00640 1 -- 172.21.15.150:0/4286770624 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4b289210 con 0x557e4b611090 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f173fe00640 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b611490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1738009ca0 tx=0x7f1738004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9605c67454a8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f1734c00640 1 -- 172.21.15.150:0/4286770624 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380098c0 con 0x557e4b611090 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f1734c00640 1 -- 172.21.15.150:0/4286770624 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1738036040 con 0x557e4b611090 2024-09-15T22:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.301+0000 7f1734c00640 1 -- 172.21.15.150:0/4286770624 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738004290 con 0x557e4b611090 2024-09-15T22:19:02.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1737e00640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f17240a3370 0x7f17240a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 -- 172.21.15.150:0/4286770624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 msgr2=0x557e4b611490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1737e00640 1 -- 172.21.15.150:0/3386888430 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f172c0cfc00 con 0x7f1740102d30 2024-09-15T22:19:02.308 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b611490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1738009ca0 tx=0x7f1738004a40 comp rx=0 tx=0).stop 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f173f400640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f17240a3370 0x7f17240a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 -- 172.21.15.150:0/4286770624 shutdown_connections 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b616a60 0x557e4b618f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b6119d0 0x557e4b616490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 --2- 172.21.15.150:0/4286770624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b611490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 -- 172.21.15.150:0/4286770624 >> 172.21.15.150:0/4286770624 conn(0x557e4b60c700 msgr2=0x557e4b60cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 -- 172.21.15.150:0/4286770624 shutdown_connections 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.302+0000 7f1749619740 1 -- 172.21.15.150:0/4286770624 wait complete. 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f173f400640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f17240a3370 0x7f17240a5830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x557e4b60d580 tx=0x7f1730005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 -- start start 2024-09-15T22:19:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 Processor -- start 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b611090 0x557e4b61b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b61b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b616a60 0x557e4b622610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557e4b6197f0 con 0x557e4b6119d0 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557e4b4ff090 con 0x557e4b611090 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.303+0000 7f1749619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557e4b619970 con 0x557e4b616a60 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f1749619740 10 client.0 _ll_register_callbacks cb 0x557e4b553f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b61b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b61b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48834/0 (socket says 172.21.15.150:48834) 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 -- 172.21.15.150:0/1028389258 learned_addr learned my addr 172.21.15.150:0/1028389258 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173fe00640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b616a60 0x557e4b622610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173f400640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b611090 0x557e4b61b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 -- 172.21.15.150:0/1028389258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b616a60 msgr2=0x557e4b622610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b616a60 0x557e4b622610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 -- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b611090 msgr2=0x557e4b61b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b611090 0x557e4b61b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 -- 172.21.15.150:0/1028389258 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4b355620 con 0x557e4b6119d0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f173ea00640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b61b5d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f172c0a48d0 tx=0x7f172c09bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0339313534a33c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.304+0000 7f1729600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1729600640 1 -- 172.21.15.150:0/1028389258 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c0a0540 con 0x557e4b6119d0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1729600640 1 -- 172.21.15.150:0/1028389258 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f172c098800 con 0x557e4b6119d0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1738036040 con 0x557e4b6119d0 2024-09-15T22:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1729600640 1 -- 172.21.15.150:0/1028389258 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f172c0a4e00 con 0x557e4b6119d0 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 10 client.15510 fetch_fsmap learned FSMap version 42 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557e4b6254c0 con 0x557e4b6119d0 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1729600640 1 -- 172.21.15.150:0/1028389258 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1738036040 con 0x557e4b6119d0 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1729600640 1 -- 172.21.15.150:0/1028389258 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7f172c0cdb30 con 0x557e4b6119d0 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 10 client.15510 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 10 client.15510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 20 client.15510 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b626c00 0x557e4b628ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 4 client.15510 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.305+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e4b583830 con 0x557e4b626c00 2024-09-15T22:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.306+0000 7f173f400640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b626c00 0x557e4b628ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.313 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.306+0000 7f173f400640 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b626c00 0x557e4b628ff0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c45f490e85f0e39c server_cookie=f5dbc2c0063259d3 in_seq=0 out_seq=0 2024-09-15T22:19:02.313 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.306+0000 7f1729600640 10 client.15510 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.307+0000 7f1729600640 1 -- 172.21.15.150:0/1028389258 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e4b583830 con 0x557e4b626c00 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.307+0000 7f1729600640 10 client.15510 handle_command_reply: tid=0 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.307+0000 7f1749619740 1 client.15510 shutdown 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.307+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 msgr2=0x557e4b61b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.307+0000 7f1749619740 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b61b5d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f172c0a48d0 tx=0x7f172c09bdc0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 shutdown_connections 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b626c00 0x557e4b628ff0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b616a60 0x557e4b622610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b61b5d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 --2- 172.21.15.150:0/1028389258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b611090 0x557e4b61b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 >> 172.21.15.150:0/1028389258 conn(0x557e4b60c700 msgr2=0x557e4b60df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1729600640 0 client.15510 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 shutdown_connections 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 1 -- 172.21.15.150:0/1028389258 wait complete. 2024-09-15T22:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.308+0000 7f1749619740 20 client.15510 trim_cache size 0 max 16384 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 Processor -- start 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 -- start start 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b60c700 0x557e4b61a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b6225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b6119d0 0x557e4b61a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17401ab170 con 0x557e4b611090 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17401acec0 con 0x557e4b6119d0 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f1749619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17401ab840 con 0x557e4b60c700 2024-09-15T22:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f173ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b6225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f173ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b6225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48840/0 (socket says 172.21.15.150:48840) 2024-09-15T22:19:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f173ea00640 1 -- 172.21.15.150:0/117095072 learned_addr learned my addr 172.21.15.150:0/117095072 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.323+0000 7f173f400640 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b60c700 0x557e4b61a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173fe00640 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b6119d0 0x557e4b61a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173ea00640 1 -- 172.21.15.150:0/117095072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b60c700 msgr2=0x557e4b61a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173ea00640 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b60c700 0x557e4b61a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173ea00640 1 -- 172.21.15.150:0/117095072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b6119d0 msgr2=0x557e4b61a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173ea00640 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b6119d0 0x557e4b61a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173ea00640 1 -- 172.21.15.150:0/117095072 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4b60c520 con 0x557e4b611090 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173fe00640 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b6119d0 0x557e4b61a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f173ea00640 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b6225d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f172c098b60 tx=0x7f172c098540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b62438a72f825bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f172be00640 1 -- 172.21.15.150:0/117095072 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c09bf60 con 0x557e4b611090 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f172be00640 1 -- 172.21.15.150:0/117095072 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f172c0a0540 con 0x557e4b611090 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.324+0000 7f172be00640 1 -- 172.21.15.150:0/117095072 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c0bc0b0 con 0x557e4b611090 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 -- 172.21.15.150:0/117095072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 msgr2=0x557e4b6225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b6225d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f172c098b60 tx=0x7f172c098540 comp rx=0 tx=0).stop 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 -- 172.21.15.150:0/117095072 shutdown_connections 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b6119d0 0x557e4b61a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b611090 0x557e4b6225d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 --2- 172.21.15.150:0/117095072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b60c700 0x557e4b61a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 -- 172.21.15.150:0/117095072 >> 172.21.15.150:0/117095072 conn(0x557e4b6165f0 msgr2=0x557e4b612c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 -- 172.21.15.150:0/117095072 shutdown_connections 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 -- 172.21.15.150:0/117095072 wait complete. 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 -- start start 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.325+0000 7f1749619740 1 Processor -- start 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b60c700 0x557e4b61f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b611090 0x557e4b61fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b620eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17401ac760 con 0x557e4b6119d0 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17401abfd0 con 0x557e4b60c700 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17401a9150 con 0x557e4b611090 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f1749619740 10 client.0 _ll_register_callbacks cb 0x7f172c003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b620eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b620eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48852/0 (socket says 172.21.15.150:48852) 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173ea00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b611090 0x557e4b61fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173fe00640 1 -- 172.21.15.150:0/203581389 learned_addr learned my addr 172.21.15.150:0/203581389 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173f400640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b60c700 0x557e4b61f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173ea00640 1 -- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b60c700 msgr2=0x557e4b61f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173ea00640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b60c700 0x557e4b61f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173ea00640 1 -- 172.21.15.150:0/203581389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 msgr2=0x557e4b620eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173ea00640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b620eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173ea00640 1 -- 172.21.15.150:0/203581389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4b6214c0 con 0x557e4b611090 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.326+0000 7f173f400640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b60c700 0x557e4b61f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f173ea00640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b611090 0x557e4b61fea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x557e4b6165a0 tx=0x7f172c003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368f3cdc918d2880 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1729600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1729600640 1 -- 172.21.15.150:0/203581389 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c09bcd0 con 0x557e4b611090 2024-09-15T22:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1729600640 1 -- 172.21.15.150:0/203581389 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f172c09b5e0 con 0x557e4b611090 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f172c0a0540 con 0x557e4b611090 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1729600640 1 -- 172.21.15.150:0/203581389 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f172c0bc240 con 0x557e4b611090 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1749619740 10 client.25528 fetch_fsmap learned FSMap version 42 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557e4b6227d0 con 0x557e4b611090 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1729600640 1 -- 172.21.15.150:0/203581389 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f172c0a0540 con 0x557e4b611090 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1729600640 1 -- 172.21.15.150:0/203581389 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7f172c084020 con 0x557e4b611090 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.327+0000 7f1749619740 10 client.25528 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f1749619740 10 client.25528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f1749619740 20 client.25528 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f1749619740 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b616a60 0x557e4b693fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f1749619740 4 client.25528 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e4b607d80 con 0x557e4b616a60 2024-09-15T22:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f173f400640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b616a60 0x557e4b693fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f173f400640 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b616a60 0x557e4b693fb0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2200e4ea499b637 server_cookie=1318e9aec4c86ed4 in_seq=0 out_seq=0 2024-09-15T22:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.328+0000 7f1729600640 10 client.25528 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1729600640 1 -- 172.21.15.150:0/203581389 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e4b607d80 con 0x557e4b616a60 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1729600640 10 client.25528 handle_command_reply: tid=0 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 client.25528 shutdown 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b611090 msgr2=0x557e4b61fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b611090 0x557e4b61fea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x557e4b6165a0 tx=0x7f172c003d60 comp rx=0 tx=0).stop 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 shutdown_connections 2024-09-15T22:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x557e4b616a60 0x557e4b693fb0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557e4b6119d0 0x557e4b620eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557e4b611090 0x557e4b61fea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 --2- 172.21.15.150:0/203581389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e4b60c700 0x557e4b61f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1729600640 0 client.25528 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 >> 172.21.15.150:0/203581389 conn(0x557e4b6165f0 msgr2=0x557e4b60ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 shutdown_connections 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 1 -- 172.21.15.150:0/203581389 wait complete. 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.436+0000 7f1749619740 20 client.25528 trim_cache size 0 max 16384 2024-09-15T22:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f17240a3370 msgr2=0x7f17240a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f17240a3370 0x7f17240a5830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x557e4b60d580 tx=0x7f1730005f90 comp rx=0 tx=0).stop 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 msgr2=0x7f17400745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 0x7f17400745e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f172c00ea60 tx=0x7f172c00ef20 comp rx=0 tx=0).stop 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 shutdown_connections 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17401036f0 0x7f1740074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f17240a3370 0x7f17240a5830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1740102d30 0x7f17400745e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 --2- 172.21.15.150:0/3386888430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1740101b40 0x7f1740075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 >> 172.21.15.150:0/3386888430 conn(0x7f17400fd2e0 msgr2=0x7f1740106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 shutdown_connections 2024-09-15T22:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:02.437+0000 7f1746600640 1 -- 172.21.15.150:0/3386888430 wait complete. 2024-09-15T22:19:02.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:02 smithi150 ceph-mon[30886]: pgmap v563: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.6 MiB/s wr, 306 op/s 2024-09-15T22:19:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:02 smithi169 ceph-mon[35850]: pgmap v563: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.6 MiB/s wr, 306 op/s 2024-09-15T22:19:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:02 smithi154 ceph-mon[34853]: pgmap v563: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.6 MiB/s wr, 306 op/s 2024-09-15T22:19:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:04 smithi150 ceph-mon[30886]: pgmap v564: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 248 op/s 2024-09-15T22:19:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:04 smithi169 ceph-mon[35850]: pgmap v564: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 248 op/s 2024-09-15T22:19:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:04 smithi154 ceph-mon[34853]: pgmap v564: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 248 op/s 2024-09-15T22:19:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: pgmap v565: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 236 op/s 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:06.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:06.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:06 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: pgmap v565: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 236 op/s 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:06.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:06 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:19:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: pgmap v565: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 236 op/s 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:19:06.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:06.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:06.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:06 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:19:07.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-15T22:19:07.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: Unable to set osd_memory_target on smithi169 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:19:07.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-15T22:19:07.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: Unable to set osd_memory_target on smithi154 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:19:07.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: Adjusting osd_memory_target on smithi150 to 176.4M 2024-09-15T22:19:07.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: Unable to set osd_memory_target on smithi150 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-15T22:19:07.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:07 smithi150 ceph-mon[30886]: pgmap v566: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: Unable to set osd_memory_target on smithi169 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: Unable to set osd_memory_target on smithi154 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: Adjusting osd_memory_target on smithi150 to 176.4M 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: Unable to set osd_memory_target on smithi150 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-15T22:19:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:07 smithi169 ceph-mon[35850]: pgmap v566: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-09-15T22:19:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-15T22:19:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: Unable to set osd_memory_target on smithi169 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:19:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-15T22:19:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: Unable to set osd_memory_target on smithi154 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:19:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: Adjusting osd_memory_target on smithi150 to 176.4M 2024-09-15T22:19:07.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: Unable to set osd_memory_target on smithi150 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-15T22:19:07.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:07 smithi154 ceph-mon[34853]: pgmap v566: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 138 op/s 2024-09-15T22:19:10.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:10 smithi150 ceph-mon[30886]: pgmap v567: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-09-15T22:19:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:10 smithi169 ceph-mon[35850]: pgmap v567: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-09-15T22:19:10.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:10 smithi154 ceph-mon[34853]: pgmap v567: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-09-15T22:19:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:12 smithi150 ceph-mon[30886]: pgmap v568: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-15T22:19:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:12 smithi169 ceph-mon[35850]: pgmap v568: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-15T22:19:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:12 smithi154 ceph-mon[34853]: pgmap v568: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-15T22:19:14.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:14 smithi150 ceph-mon[30886]: pgmap v569: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 276 KiB/s wr, 74 op/s 2024-09-15T22:19:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:14 smithi169 ceph-mon[35850]: pgmap v569: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 276 KiB/s wr, 74 op/s 2024-09-15T22:19:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:14 smithi154 ceph-mon[34853]: pgmap v569: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 276 KiB/s wr, 74 op/s 2024-09-15T22:19:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 -- 172.21.15.150:0/2470814424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c104f50 msgr2=0x7f292c1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 --2- 172.21.15.150:0/2470814424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c104f50 0x7f292c1053d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2918009900 tx=0x7f291802a410 comp rx=0 tx=0).stop 2024-09-15T22:19:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 -- 172.21.15.150:0/2470814424 shutdown_connections 2024-09-15T22:19:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 --2- 172.21.15.150:0/2470814424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c105910 0x7f292c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 --2- 172.21.15.150:0/2470814424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c104f50 0x7f292c1053d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 --2- 172.21.15.150:0/2470814424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c103d60 0x7f292c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 -- 172.21.15.150:0/2470814424 >> 172.21.15.150:0/2470814424 conn(0x7f292c0ff4e0 msgr2=0x7f292c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 -- 172.21.15.150:0/2470814424 shutdown_connections 2024-09-15T22:19:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.562+0000 7f2934600640 1 -- 172.21.15.150:0/2470814424 wait complete. 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.563+0000 7f2934600640 1 Processor -- start 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.563+0000 7f2934600640 1 -- start start 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.563+0000 7f2934600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 0x7f292c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.563+0000 7f2934600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c104f50 0x7f292c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.563+0000 7f2934600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c105910 0x7f292c1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.563+0000 7f2934600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f292c10fa10 con 0x7f292c103d60 2024-09-15T22:19:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2934600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f292c10f890 con 0x7f292c105910 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2934600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f292c10fb90 con 0x7f292c104f50 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 0x7f292c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 0x7f292c199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59768/0 (socket says 172.21.15.150:59768) 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 -- 172.21.15.150:0/3476769368 learned_addr learned my addr 172.21.15.150:0/3476769368 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931200640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c104f50 0x7f292c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2932600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c105910 0x7f292c1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 -- 172.21.15.150:0/3476769368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c104f50 msgr2=0x7f292c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c104f50 0x7f292c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 -- 172.21.15.150:0/3476769368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c105910 msgr2=0x7f292c1a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c105910 0x7f292c1a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 -- 172.21.15.150:0/3476769368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c1a1c00 con 0x7f292c103d60 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.564+0000 7f2931c00640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 0x7f292c199fe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f292000ebc0 tx=0x7f292000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.565+0000 7f292a000640 1 -- 172.21.15.150:0/3476769368 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920003970 con 0x7f292c103d60 2024-09-15T22:19:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.565+0000 7f292a000640 1 -- 172.21.15.150:0/3476769368 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2920004030 con 0x7f292c103d60 2024-09-15T22:19:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.565+0000 7f292a000640 1 -- 172.21.15.150:0/3476769368 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29200197b0 con 0x7f292c103d60 2024-09-15T22:19:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.565+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c1a1ef0 con 0x7f292c103d60 2024-09-15T22:19:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.565+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1a2360 con 0x7f292c103d60 2024-09-15T22:19:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.568+0000 7f2937483740 1 Processor -- start 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.568+0000 7f2937483740 1 -- start start 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.568+0000 7f292a000640 1 -- 172.21.15.150:0/3476769368 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f29200041e0 con 0x7f292c103d60 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2937483740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d471090 0x55d03d471490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2937483740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 0x55d03d476490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2937483740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d478f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2937483740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d03d3d6100 con 0x55d03d4719d0 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2937483740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d03d37e1b0 con 0x55d03d471090 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2937483740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d03d3d20c0 con 0x55d03d476a60 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 0x55d03d476490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 0x55d03d476490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59784/0 (socket says 172.21.15.150:59784) 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931c00640 1 -- 172.21.15.150:0/992563953 learned_addr learned my addr 172.21.15.150:0/992563953 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931200640 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d478f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2932600640 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d471090 0x55d03d471490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931200640 1 -- 172.21.15.150:0/992563953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d471090 msgr2=0x55d03d471490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931200640 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d471090 0x55d03d471490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931200640 1 -- 172.21.15.150:0/992563953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 msgr2=0x55d03d476490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931200640 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 0x55d03d476490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931200640 1 -- 172.21.15.150:0/992563953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d03d0e9210 con 0x55d03d476a60 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.569+0000 7f2931c00640 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 0x55d03d476490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f2931200640 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d478f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f291802a930 tx=0x7f2918005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c952931cf329bc61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f292a000640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29140a3370 0x7f29140a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f291ea00640 1 -- 172.21.15.150:0/992563953 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918035040 con 0x55d03d476a60 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f291ea00640 1 -- 172.21.15.150:0/992563953 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2918005520 con 0x55d03d476a60 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f291ea00640 1 -- 172.21.15.150:0/992563953 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180316b0 con 0x55d03d476a60 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f292a000640 1 -- 172.21.15.150:0/3476769368 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f29200d0170 con 0x7f292c103d60 2024-09-15T22:19:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.570+0000 7f2932600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29140a3370 0x7f29140a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 -- 172.21.15.150:0/992563953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 msgr2=0x55d03d478f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d478f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f291802a930 tx=0x7f2918005c00 comp rx=0 tx=0).stop 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2932600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29140a3370 0x7f29140a5830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2924009db0 tx=0x7f2924005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 -- 172.21.15.150:0/992563953 shutdown_connections 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d478f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d4719d0 0x55d03d476490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 --2- 172.21.15.150:0/992563953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d471090 0x55d03d471490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 -- 172.21.15.150:0/992563953 >> 172.21.15.150:0/992563953 conn(0x55d03d46c700 msgr2=0x55d03d46cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 -- 172.21.15.150:0/992563953 shutdown_connections 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.571+0000 7f2937483740 1 -- 172.21.15.150:0/992563953 wait complete. 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 -- start start 2024-09-15T22:19:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 Processor -- start 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d47b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d47b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d4827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d03d4799d0 con 0x55d03d471090 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d03d35f090 con 0x55d03d4719d0 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d03d479b50 con 0x55d03d476a60 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.572+0000 7f2937483740 10 client.0 _ll_register_callbacks cb 0x55d03d3b3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d47b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d47b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d47b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:46656/0 (socket says 172.21.15.150:46656) 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 -- 172.21.15.150:0/2564272157 learned_addr learned my addr 172.21.15.150:0/2564272157 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2932600640 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d4827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 -- 172.21.15.150:0/2564272157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 msgr2=0x55d03d4827c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d4827c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 -- 172.21.15.150:0/2564272157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 msgr2=0x55d03d47b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d47b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 -- 172.21.15.150:0/2564272157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d03d1b5620 con 0x55d03d4719d0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2931200640 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d47b780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29180314e0 tx=0x7f2918004530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f0cd0a1c880b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.573+0000 7f2913400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2913400640 1 -- 172.21.15.150:0/2564272157 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918052060 con 0x55d03d4719d0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2913400640 1 -- 172.21.15.150:0/2564272157 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f2918004f60 con 0x55d03d4719d0 2024-09-15T22:19:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2918005520 con 0x55d03d4719d0 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2913400640 1 -- 172.21.15.150:0/2564272157 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2918035050 con 0x55d03d4719d0 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 10 client.25535 fetch_fsmap learned FSMap version 42 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55d03d4855b0 con 0x55d03d4719d0 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2913400640 1 -- 172.21.15.150:0/2564272157 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2918005520 con 0x55d03d4719d0 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2913400640 1 -- 172.21.15.150:0/2564272157 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7f2918031c20 con 0x55d03d4719d0 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 10 client.25535 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 10 client.25535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 20 client.25535 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.574+0000 7f2937483740 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d486900 0x55d03d488cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.575+0000 7f2937483740 4 client.25535 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.575+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d03d3e3830 con 0x55d03d486900 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.575+0000 7f2931c00640 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d486900 0x55d03d488cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.575+0000 7f2931c00640 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d486900 0x55d03d488cf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b05b5f03bc10664 server_cookie=d802966843ba61c5 in_seq=0 out_seq=0 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.575+0000 7f2913400640 10 client.25535 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.576+0000 7f2913400640 1 -- 172.21.15.150:0/2564272157 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d03d3e3830 con 0x55d03d486900 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.576+0000 7f2913400640 10 client.25535 handle_command_reply: tid=0 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.576+0000 7f2937483740 1 client.25535 shutdown 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 msgr2=0x55d03d47b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d47b780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29180314e0 tx=0x7f2918004530 comp rx=0 tx=0).stop 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 shutdown_connections 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d486900 0x55d03d488cf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d4827c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d47b780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2913400640 0 client.25535 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 --2- 172.21.15.150:0/2564272157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d47b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 >> 172.21.15.150:0/2564272157 conn(0x55d03d46c700 msgr2=0x55d03d46df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 shutdown_connections 2024-09-15T22:19:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 1 -- 172.21.15.150:0/2564272157 wait complete. 2024-09-15T22:19:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.577+0000 7f2937483740 20 client.25535 trim_cache size 0 max 16384 2024-09-15T22:19:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 Processor -- start 2024-09-15T22:19:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 -- start start 2024-09-15T22:19:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d46daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 0x55d03d482780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d476a60 0x55d03d46e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1ab230 con 0x55d03d471090 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1acf80 con 0x55d03d476a60 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.592+0000 7f2937483740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1ab900 con 0x55d03d4719d0 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d46daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 0x55d03d482780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 0x55d03d482780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:59208/0 (socket says 172.21.15.150:59208) 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d46daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59796/0 (socket says 172.21.15.150:59796) 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 -- 172.21.15.150:0/2402866410 learned_addr learned my addr 172.21.15.150:0/2402866410 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2932600640 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d476a60 0x55d03d46e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 -- 172.21.15.150:0/2402866410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d476a60 msgr2=0x55d03d46e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d476a60 0x55d03d46e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 -- 172.21.15.150:0/2402866410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 msgr2=0x55d03d46daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d46daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 -- 172.21.15.150:0/2402866410 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d03d467d60 con 0x55d03d4719d0 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931c00640 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d46daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f2931200640 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 0x55d03d482780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f291802a930 tx=0x7f2918005e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acdc282520314832 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f291e000640 1 -- 172.21.15.150:0/2402866410 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918052070 con 0x55d03d4719d0 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f291e000640 1 -- 172.21.15.150:0/2402866410 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2918004770 con 0x55d03d4719d0 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.593+0000 7f291e000640 1 -- 172.21.15.150:0/2402866410 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918003d00 con 0x55d03d4719d0 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 -- 172.21.15.150:0/2402866410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 msgr2=0x55d03d482780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 0x55d03d482780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f291802a930 tx=0x7f2918005e30 comp rx=0 tx=0).stop 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 -- 172.21.15.150:0/2402866410 shutdown_connections 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d476a60 0x55d03d46e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d4719d0 0x55d03d482780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 --2- 172.21.15.150:0/2402866410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d46daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 -- 172.21.15.150:0/2402866410 >> 172.21.15.150:0/2402866410 conn(0x55d03d46c700 msgr2=0x55d03d46b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 -- 172.21.15.150:0/2402866410 shutdown_connections 2024-09-15T22:19:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 -- 172.21.15.150:0/2402866410 wait complete. 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.594+0000 7f2937483740 1 -- start start 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 Processor -- start 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d480440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d480980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d481940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1ac820 con 0x55d03d471090 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1ac090 con 0x55d03d4719d0 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1a9210 con 0x55d03d476a60 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2937483740 10 client.0 _ll_register_callbacks cb 0x7f29200d3b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d480440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2931c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d480440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59812/0 (socket says 172.21.15.150:59812) 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2931c00640 1 -- 172.21.15.150:0/2928350773 learned_addr learned my addr 172.21.15.150:0/2928350773 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2932600640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d481940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.595+0000 7f2931200640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d480980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2931c00640 1 -- 172.21.15.150:0/2928350773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 msgr2=0x55d03d481940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2931c00640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d481940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2931c00640 1 -- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 msgr2=0x55d03d480980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2931c00640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d480980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2931c00640 1 -- 172.21.15.150:0/2928350773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d03d46bf90 con 0x55d03d471090 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2931c00640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d480440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f292000eb90 tx=0x7f29200d3c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7e13eacaa5d27e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2913400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2913400640 1 -- 172.21.15.150:0/2928350773 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29200b4020 con 0x55d03d471090 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2913400640 1 -- 172.21.15.150:0/2928350773 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f2920004530 con 0x55d03d471090 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2918004770 con 0x55d03d471090 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2913400640 1 -- 172.21.15.150:0/2928350773 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f29200bb170 con 0x55d03d471090 2024-09-15T22:19:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2937483740 10 client.15534 fetch_fsmap learned FSMap version 42 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.596+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55d03d4f1970 con 0x55d03d471090 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2913400640 1 -- 172.21.15.150:0/2928350773 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2918004770 con 0x55d03d471090 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2913400640 1 -- 172.21.15.150:0/2928350773 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7f2920098dd0 con 0x55d03d471090 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2937483740 10 client.15534 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2937483740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2937483740 20 client.15534 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2937483740 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d4f2310 0x55d03d4f4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2937483740 4 client.15534 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d03d3ddb80 con 0x55d03d4f2310 2024-09-15T22:19:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.597+0000 7f2931200640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d4f2310 0x55d03d4f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.598+0000 7f2931200640 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d4f2310 0x55d03d4f4730 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5901b49599e8159c server_cookie=92c17d04eeea1486 in_seq=0 out_seq=0 2024-09-15T22:19:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.598+0000 7f2913400640 10 client.15534 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.630+0000 7f2913400640 1 -- 172.21.15.150:0/2928350773 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d03d3ddb80 con 0x55d03d4f2310 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.630+0000 7f2913400640 10 client.15534 handle_command_reply: tid=0 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.630+0000 7f2937483740 1 client.15534 shutdown 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 msgr2=0x55d03d480440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d480440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f292000eb90 tx=0x7f29200d3c50 comp rx=0 tx=0).stop 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 shutdown_connections 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d03d4f2310 0x55d03d4f4730 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d03d476a60 0x55d03d481940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d03d4719d0 0x55d03d480980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 --2- 172.21.15.150:0/2928350773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d03d471090 0x55d03d480440 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2913400640 0 client.15534 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 >> 172.21.15.150:0/2928350773 conn(0x55d03d46c700 msgr2=0x55d03d46b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 shutdown_connections 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 1 -- 172.21.15.150:0/2928350773 wait complete. 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.631+0000 7f2937483740 20 client.15534 trim_cache size 0 max 16384 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:19:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29140a3370 msgr2=0x7f29140a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29140a3370 0x7f29140a5830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2924009db0 tx=0x7f2924005f90 comp rx=0 tx=0).stop 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 msgr2=0x7f292c199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 0x7f292c199fe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f292000ebc0 tx=0x7f292000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 shutdown_connections 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c105910 0x7f292c1a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f292c104f50 0x7f292c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29140a3370 0x7f29140a5830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 --2- 172.21.15.150:0/3476769368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f292c103d60 0x7f292c199fe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 >> 172.21.15.150:0/3476769368 conn(0x7f292c0ff4e0 msgr2=0x7f292c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 shutdown_connections 2024-09-15T22:19:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:15.632+0000 7f2934600640 1 -- 172.21.15.150:0/3476769368 wait complete. 2024-09-15T22:19:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:16 smithi150 ceph-mon[30886]: pgmap v570: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 281 KiB/s wr, 77 op/s 2024-09-15T22:19:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:16 smithi169 ceph-mon[35850]: pgmap v570: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 281 KiB/s wr, 77 op/s 2024-09-15T22:19:16.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:16 smithi154 ceph-mon[34853]: pgmap v570: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 281 KiB/s wr, 77 op/s 2024-09-15T22:19:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:18 smithi150 ceph-mon[30886]: pgmap v571: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 155 KiB/s wr, 45 op/s 2024-09-15T22:19:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:18 smithi169 ceph-mon[35850]: pgmap v571: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 155 KiB/s wr, 45 op/s 2024-09-15T22:19:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:18 smithi154 ceph-mon[34853]: pgmap v571: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 155 KiB/s wr, 45 op/s 2024-09-15T22:19:20.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:20 smithi150 ceph-mon[30886]: pgmap v572: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 156 KiB/s wr, 34 op/s 2024-09-15T22:19:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:20 smithi169 ceph-mon[35850]: pgmap v572: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 156 KiB/s wr, 34 op/s 2024-09-15T22:19:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:20 smithi154 ceph-mon[34853]: pgmap v572: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 156 KiB/s wr, 34 op/s 2024-09-15T22:19:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:21 smithi154 ceph-mon[34853]: pgmap v573: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 175 KiB/s wr, 44 op/s 2024-09-15T22:19:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:21 smithi150 ceph-mon[30886]: pgmap v573: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 175 KiB/s wr, 44 op/s 2024-09-15T22:19:21.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:21 smithi169 ceph-mon[35850]: pgmap v573: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 175 KiB/s wr, 44 op/s 2024-09-15T22:19:24.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:24 smithi150 ceph-mon[30886]: pgmap v574: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 130 KiB/s wr, 36 op/s 2024-09-15T22:19:24.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:24 smithi169 ceph-mon[35850]: pgmap v574: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 130 KiB/s wr, 36 op/s 2024-09-15T22:19:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:24 smithi154 ceph-mon[34853]: pgmap v574: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 130 KiB/s wr, 36 op/s 2024-09-15T22:19:24.933 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-15T22:19:24.933 INFO:tasks.workunit.client.0.smithi150.stdout:Final score for writes: 707 2024-09-15T22:19:24.933 INFO:tasks.workunit.client.0.smithi150.stdout:Final score for reads : 336094 2024-09-15T22:19:24.933 INFO:tasks.workunit.client.0.smithi150.stdout: 2024-09-15T22:19:24.934 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T22:19:24.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T22:19:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:25 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:25 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:25 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:26.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:26 smithi150 ceph-mon[30886]: pgmap v575: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 192 KiB/s wr, 44 op/s 2024-09-15T22:19:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:26 smithi169 ceph-mon[35850]: pgmap v575: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 192 KiB/s wr, 44 op/s 2024-09-15T22:19:26.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:26 smithi154 ceph-mon[34853]: pgmap v575: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 192 KiB/s wr, 44 op/s 2024-09-15T22:19:27.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:27 smithi154 ceph-mon[34853]: pgmap v576: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 472 KiB/s wr, 55 op/s 2024-09-15T22:19:27.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:27 smithi150 ceph-mon[30886]: pgmap v576: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 472 KiB/s wr, 55 op/s 2024-09-15T22:19:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:27 smithi169 ceph-mon[35850]: pgmap v576: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 472 KiB/s wr, 55 op/s 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 -- 172.21.15.150:0/3365629826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554103050 msgr2=0x7f5554103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 --2- 172.21.15.150:0/3365629826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554103050 0x7f5554103450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5544009900 tx=0x7f554402a410 comp rx=0 tx=0).stop 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 -- 172.21.15.150:0/3365629826 shutdown_connections 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 --2- 172.21.15.150:0/3365629826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554101f40 0x7f5554109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 --2- 172.21.15.150:0/3365629826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554101580 0x7f5554101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 --2- 172.21.15.150:0/3365629826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554103050 0x7f5554103450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 -- 172.21.15.150:0/3365629826 >> 172.21.15.150:0/3365629826 conn(0x7f55540fd0d0 msgr2=0x7f55540ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 -- 172.21.15.150:0/3365629826 shutdown_connections 2024-09-15T22:19:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.746+0000 7f5558a00640 1 -- 172.21.15.150:0/3365629826 wait complete. 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 Processor -- start 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 -- start start 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554101580 0x7f5554197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 0x7f5554198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554103050 0x7f555419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f555410d720 con 0x7f5554101580 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f555410d5a0 con 0x7f5554103050 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5558a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f555410d8a0 con 0x7f5554101f40 2024-09-15T22:19:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f5553400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554101580 0x7f5554197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f554be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 0x7f5554198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f554be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 0x7f5554198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41494/0 (socket says 172.21.15.150:41494) 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.747+0000 7f554be00640 1 -- 172.21.15.150:0/3346877379 learned_addr learned my addr 172.21.15.150:0/3346877379 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f5553e00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554103050 0x7f555419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f554be00640 1 -- 172.21.15.150:0/3346877379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554103050 msgr2=0x7f555419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f554be00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554103050 0x7f555419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f554be00640 1 -- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554101580 msgr2=0x7f5554197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f554be00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554101580 0x7f5554197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f554be00640 1 -- 172.21.15.150:0/3346877379 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555419f9f0 con 0x7f5554101f40 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f554be00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 0x7f5554198310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f553c00e9f0 tx=0x7f553c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f5550c00640 1 -- 172.21.15.150:0/3346877379 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c00cd80 con 0x7f5554101f40 2024-09-15T22:19:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555419fce0 con 0x7f5554101f40 2024-09-15T22:19:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f5550c00640 1 -- 172.21.15.150:0/3346877379 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f553c010910 con 0x7f5554101f40 2024-09-15T22:19:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f5550c00640 1 -- 172.21.15.150:0/3346877379 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c0188f0 con 0x7f5554101f40 2024-09-15T22:19:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.748+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55541a0220 con 0x7f5554101f40 2024-09-15T22:19:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.752+0000 7f555ce37740 1 Processor -- start 2024-09-15T22:19:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.752+0000 7f555ce37740 1 -- start start 2024-09-15T22:19:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f555ce37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65a260 0x55557c65a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f555ce37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 0x55557c65f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f555ce37740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c6620f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f555ce37740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55557c5bf100 con 0x55557c65fc30 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f555ce37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55557c5671b0 con 0x55557c65a260 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f555ce37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55557c5bb0c0 con 0x55557c65aba0 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5550c00640 1 -- 172.21.15.150:0/3346877379 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f553c010ac0 con 0x7f5554101f40 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 0x55557c65f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65a260 0x55557c65a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 0x55557c65f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41498/0 (socket says 172.21.15.150:41498) 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 -- 172.21.15.150:0/3535486914 learned_addr learned my addr 172.21.15.150:0/3535486914 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f554be00640 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c6620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 -- 172.21.15.150:0/3535486914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65a260 msgr2=0x55557c65a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65a260 0x55557c65a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 -- 172.21.15.150:0/3535486914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 msgr2=0x55557c6620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c6620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553400640 1 -- 172.21.15.150:0/3535486914 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557c2d2210 con 0x55557c65aba0 2024-09-15T22:19:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.753+0000 7f5553e00640 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65a260 0x55557c65a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.754+0000 7f5553400640 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 0x55557c65f660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5544006010 tx=0x7f5544004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e0541453df227e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.754+0000 7f5543e00640 1 -- 172.21.15.150:0/3535486914 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035040 con 0x55557c65aba0 2024-09-15T22:19:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.754+0000 7f5543e00640 1 -- 172.21.15.150:0/3535486914 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5544004430 con 0x55557c65aba0 2024-09-15T22:19:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.754+0000 7f5543e00640 1 -- 172.21.15.150:0/3535486914 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440316b0 con 0x55557c65aba0 2024-09-15T22:19:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.754+0000 7f5550c00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55380a32c0 0x7f55380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f5550c00640 1 -- 172.21.15.150:0/3346877379 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f553c0cfd10 con 0x7f5554101f40 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 -- 172.21.15.150:0/3535486914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 msgr2=0x55557c65f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 0x55557c65f660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5544006010 tx=0x7f5544004040 comp rx=0 tx=0).stop 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f5553e00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55380a32c0 0x7f55380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 -- 172.21.15.150:0/3535486914 shutdown_connections 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c6620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65aba0 0x55557c65f660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 --2- 172.21.15.150:0/3535486914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65a260 0x55557c65a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 -- 172.21.15.150:0/3535486914 >> 172.21.15.150:0/3535486914 conn(0x55557c6558d0 msgr2=0x55557c655cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 -- 172.21.15.150:0/3535486914 shutdown_connections 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 -- 172.21.15.150:0/3535486914 wait complete. 2024-09-15T22:19:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f555ce37740 1 -- start start 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.755+0000 7f5553e00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55380a32c0 0x7f55380a5780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f554c005fd0 tx=0x7f554c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 Processor -- start 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c664920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c66b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55557c662ba0 con 0x55557c65fc30 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55557c548090 con 0x55557c65aba0 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55557c662d20 con 0x55557c65a260 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f555ce37740 10 client.0 _ll_register_callbacks cb 0x55557c59cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f5553400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f5553e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c66b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f5553400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41502/0 (socket says 172.21.15.150:41502) 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f5553400640 1 -- 172.21.15.150:0/1079062795 learned_addr learned my addr 172.21.15.150:0/1079062795 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.756+0000 7f554be00640 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c664920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5553400640 1 -- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 msgr2=0x55557c664920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5553400640 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c664920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5553400640 1 -- 172.21.15.150:0/1079062795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 msgr2=0x55557c66b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5553400640 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c66b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5553400640 1 -- 172.21.15.150:0/1079062795 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557c39e620 con 0x55557c65a260 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5553400640 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6643e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f554402a930 tx=0x7f55440318e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfebc2f85eeefb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5540c00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5540c00640 1 -- 172.21.15.150:0/1079062795 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035070 con 0x55557c65a260 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5540c00640 1 -- 172.21.15.150:0/1079062795 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f5544004230 con 0x55557c65a260 2024-09-15T22:19:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5544004430 con 0x55557c65a260 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f5540c00640 1 -- 172.21.15.150:0/1079062795 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5544009520 con 0x55557c65a260 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f555ce37740 10 client.25558 fetch_fsmap learned FSMap version 43 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.757+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55557c662bf0 con 0x55557c65a260 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f5540c00640 1 -- 172.21.15.150:0/1079062795 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5544004430 con 0x55557c65a260 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f5540c00640 1 -- 172.21.15.150:0/1079062795 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 43) ==== 8422+0+0 (secure 0 0 0) 0x7f5544004d70 con 0x55557c65a260 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f555ce37740 10 client.25558 fetch_fsmap finished waiting for FSMap version 43 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f555ce37740 10 client.25558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f555ce37740 20 client.25558 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f555ce37740 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c66fa60 0x55557c671e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f555ce37740 4 client.25558 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55557c5cc830 con 0x55557c66fa60 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.758+0000 7f554be00640 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c66fa60 0x55557c671e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.759+0000 7f554be00640 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c66fa60 0x55557c671e50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=204aa46107b1cb76 server_cookie=a5fbe6c461e9b81a in_seq=0 out_seq=0 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.759+0000 7f5540c00640 10 client.25558 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.759+0000 7f5540c00640 1 -- 172.21.15.150:0/1079062795 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55557c5cc830 con 0x55557c66fa60 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.759+0000 7f5540c00640 10 client.25558 handle_command_reply: tid=0 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.759+0000 7f555ce37740 1 client.25558 shutdown 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 msgr2=0x55557c6643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6643e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f554402a930 tx=0x7f55440318e0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 shutdown_connections 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c66fa60 0x55557c671e50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65fc30 0x55557c66b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f5540c00640 0 client.25558 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c664920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 --2- 172.21.15.150:0/1079062795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6643e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 >> 172.21.15.150:0/1079062795 conn(0x55557c6558d0 msgr2=0x55557c6570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 shutdown_connections 2024-09-15T22:19:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 1 -- 172.21.15.150:0/1079062795 wait complete. 2024-09-15T22:19:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.760+0000 7f555ce37740 20 client.25558 trim_cache size 0 max 16384 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 Processor -- start 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 -- start start 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65a260 0x55557c6508d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c66b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 0x55557c656cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a8f20 con 0x55557c65a260 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55541aac70 con 0x55557c65aba0 2024-09-15T22:19:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.775+0000 7f555ce37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a9620 con 0x55557c65fc30 2024-09-15T22:19:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 0x55557c656cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 0x55557c656cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41518/0 (socket says 172.21.15.150:41518) 2024-09-15T22:19:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 -- 172.21.15.150:0/2804986411 learned_addr learned my addr 172.21.15.150:0/2804986411 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553400640 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65a260 0x55557c6508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f554be00640 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c66b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 -- 172.21.15.150:0/2804986411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 msgr2=0x55557c66b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c66b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 -- 172.21.15.150:0/2804986411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65a260 msgr2=0x55557c6508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65a260 0x55557c6508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 -- 172.21.15.150:0/2804986411 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557c6556f0 con 0x55557c65fc30 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5553e00640 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 0x55557c656cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f554c010930 tx=0x7f554c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ba0eb911511539e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5543400640 1 -- 172.21.15.150:0/2804986411 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c01e9a0 con 0x55557c65fc30 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5543400640 1 -- 172.21.15.150:0/2804986411 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f554c01eb40 con 0x55557c65fc30 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.776+0000 7f5543400640 1 -- 172.21.15.150:0/2804986411 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c01c650 con 0x55557c65fc30 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 -- 172.21.15.150:0/2804986411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 msgr2=0x55557c656cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 0x55557c656cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f554c010930 tx=0x7f554c019000 comp rx=0 tx=0).stop 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 -- 172.21.15.150:0/2804986411 shutdown_connections 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65fc30 0x55557c656cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65aba0 0x55557c66b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 --2- 172.21.15.150:0/2804986411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65a260 0x55557c6508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 -- 172.21.15.150:0/2804986411 >> 172.21.15.150:0/2804986411 conn(0x55557c6558d0 msgr2=0x55557c654a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 -- 172.21.15.150:0/2804986411 shutdown_connections 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 -- 172.21.15.150:0/2804986411 wait complete. 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.777+0000 7f555ce37740 1 -- start start 2024-09-15T22:19:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 Processor -- start 2024-09-15T22:19:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65aba0 0x55557c669600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65fc30 0x55557c66a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55541aa540 con 0x55557c65aba0 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a9db0 con 0x55557c65fc30 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a6f00 con 0x55557c65a260 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f555ce37740 10 client.0 _ll_register_callbacks cb 0x7f554c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f5553400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f5553400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41524/0 (socket says 172.21.15.150:41524) 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f554be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65aba0 0x55557c669600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f5553400640 1 -- 172.21.15.150:0/3274239017 learned_addr learned my addr 172.21.15.150:0/3274239017 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.778+0000 7f5553e00640 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65fc30 0x55557c66a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5553400640 1 -- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65fc30 msgr2=0x55557c66a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5553400640 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65fc30 0x55557c66a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5553400640 1 -- 172.21.15.150:0/3274239017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65aba0 msgr2=0x55557c669600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5553400640 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65aba0 0x55557c669600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5553400640 1 -- 172.21.15.150:0/3274239017 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557c66abd0 con 0x55557c65a260 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5553400640 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6690c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f55440052e0 tx=0x7f5544004110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb3ce618495bd9d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5540c00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5540c00640 1 -- 172.21.15.150:0/3274239017 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035040 con 0x55557c65a260 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5540c00640 1 -- 172.21.15.150:0/3274239017 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f5544004980 con 0x55557c65a260 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f554c01eb40 con 0x55557c65a260 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f5540c00640 1 -- 172.21.15.150:0/3274239017 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5544004b80 con 0x55557c65a260 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f555ce37740 10 client.25564 fetch_fsmap learned FSMap version 43 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.779+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55557c6da750 con 0x55557c65a260 2024-09-15T22:19:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f5540c00640 1 -- 172.21.15.150:0/3274239017 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f554c01eb40 con 0x55557c65a260 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f5540c00640 1 -- 172.21.15.150:0/3274239017 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 43) ==== 8422+0+0 (secure 0 0 0) 0x7f554403c440 con 0x55557c65a260 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f555ce37740 10 client.25564 fetch_fsmap finished waiting for FSMap version 43 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f555ce37740 10 client.25564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f555ce37740 20 client.25564 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f555ce37740 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c6db070 0x55557c6dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f555ce37740 4 client.25564 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55557c5c6b80 con 0x55557c6db070 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f554be00640 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c6db070 0x55557c6dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f554be00640 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c6db070 0x55557c6dd490 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acba106ba4327ff0 server_cookie=67f81ae3837be327 in_seq=0 out_seq=0 2024-09-15T22:19:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.780+0000 7f5540c00640 10 client.25564 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f5540c00640 1 -- 172.21.15.150:0/3274239017 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55557c5c6b80 con 0x55557c6db070 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f5540c00640 10 client.25564 handle_command_reply: tid=0 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 client.25564 shutdown 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 msgr2=0x55557c6690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6690c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f55440052e0 tx=0x7f5544004110 comp rx=0 tx=0).stop 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 shutdown_connections 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55557c6db070 0x55557c6dd490 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55557c65fc30 0x55557c66a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55557c65aba0 0x55557c669600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 --2- 172.21.15.150:0/3274239017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55557c65a260 0x55557c6690c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 >> 172.21.15.150:0/3274239017 conn(0x55557c6558d0 msgr2=0x55557c655cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.797+0000 7f5540c00640 0 client.25564 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 shutdown_connections 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f555ce37740 1 -- 172.21.15.150:0/3274239017 wait complete. 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f555ce37740 20 client.25564 trim_cache size 0 max 16384 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:19:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:19:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55380a32c0 msgr2=0x7f55380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55380a32c0 0x7f55380a5780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f554c005fd0 tx=0x7f554c009500 comp rx=0 tx=0).stop 2024-09-15T22:19:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 msgr2=0x7f5554198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 0x7f5554198310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f553c00e9f0 tx=0x7f553c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 shutdown_connections 2024-09-15T22:19:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554103050 0x7f555419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5554101f40 0x7f5554198310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55380a32c0 0x7f55380a5780 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 --2- 172.21.15.150:0/3346877379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554101580 0x7f5554197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.798+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 >> 172.21.15.150:0/3346877379 conn(0x7f55540fd0d0 msgr2=0x7f5554105fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.799+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 shutdown_connections 2024-09-15T22:19:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:28.799+0000 7f5558a00640 1 -- 172.21.15.150:0/3346877379 wait complete. 2024-09-15T22:19:30.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:30 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:30.429 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:30 smithi150 ceph-mon[30886]: pgmap v577: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 883 KiB/s wr, 100 op/s 2024-09-15T22:19:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:30 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:30 smithi169 ceph-mon[35850]: pgmap v577: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 883 KiB/s wr, 100 op/s 2024-09-15T22:19:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:30 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:30 smithi154 ceph-mon[34853]: pgmap v577: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 883 KiB/s wr, 100 op/s 2024-09-15T22:19:32.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:32 smithi150 ceph-mon[30886]: pgmap v578: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-15T22:19:32.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:32 smithi169 ceph-mon[35850]: pgmap v578: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-15T22:19:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:32 smithi154 ceph-mon[34853]: pgmap v578: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-15T22:19:34.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:34 smithi150 ceph-mon[30886]: pgmap v579: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-15T22:19:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:34 smithi169 ceph-mon[35850]: pgmap v579: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-15T22:19:34.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:34 smithi154 ceph-mon[34853]: pgmap v579: 97 pgs: 97 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-15T22:19:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:36 smithi150 ceph-mon[30886]: pgmap v580: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 303 op/s 2024-09-15T22:19:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:36 smithi169 ceph-mon[35850]: pgmap v580: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 303 op/s 2024-09-15T22:19:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:36 smithi154 ceph-mon[34853]: pgmap v580: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 303 op/s 2024-09-15T22:19:38.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:38 smithi150 ceph-mon[30886]: pgmap v581: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 363 op/s 2024-09-15T22:19:38.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:38 smithi169 ceph-mon[35850]: pgmap v581: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 363 op/s 2024-09-15T22:19:38.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:38 smithi154 ceph-mon[34853]: pgmap v581: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 363 op/s 2024-09-15T22:19:40.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:40 smithi150 ceph-mon[30886]: pgmap v582: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 420 op/s 2024-09-15T22:19:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:40 smithi169 ceph-mon[35850]: pgmap v582: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 420 op/s 2024-09-15T22:19:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:40 smithi154 ceph-mon[34853]: pgmap v582: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 420 op/s 2024-09-15T22:19:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 -- 172.21.15.150:0/3688207710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc076bb0 msgr2=0x7f26cc076fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 --2- 172.21.15.150:0/3688207710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc076bb0 0x7f26cc076fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009900 tx=0x7f26c002a400 comp rx=0 tx=0).stop 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 -- 172.21.15.150:0/3688207710 shutdown_connections 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 --2- 172.21.15.150:0/3688207710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc078790 0x7f26cc079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 --2- 172.21.15.150:0/3688207710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26cc077df0 0x7f26cc078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 --2- 172.21.15.150:0/3688207710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc076bb0 0x7f26cc076fb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 -- 172.21.15.150:0/3688207710 >> 172.21.15.150:0/3688207710 conn(0x7f26cc0ff4e0 msgr2=0x7f26cc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 -- 172.21.15.150:0/3688207710 shutdown_connections 2024-09-15T22:19:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.914+0000 7f26d4200640 1 -- 172.21.15.150:0/3688207710 wait complete. 2024-09-15T22:19:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.915+0000 7f26d4200640 1 Processor -- start 2024-09-15T22:19:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.915+0000 7f26d4200640 1 -- start start 2024-09-15T22:19:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d4200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26cc076bb0 0x7f26cc19e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.919 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d4200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc077df0 0x7f26cc19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d4200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 0x7f26cc1a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d4200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc113e40 con 0x7f26cc076bb0 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d4200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc113cc0 con 0x7f26cc077df0 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d4200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc113fc0 con 0x7f26cc078790 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26cc076bb0 0x7f26cc19e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 0x7f26cc1a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 0x7f26cc1a5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43314/0 (socket says 172.21.15.150:43314) 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 -- 172.21.15.150:0/2130117160 learned_addr learned my addr 172.21.15.150:0/2130117160 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d0e00640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc077df0 0x7f26cc19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 -- 172.21.15.150:0/2130117160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc077df0 msgr2=0x7f26cc19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.920 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc077df0 0x7f26cc19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 -- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26cc076bb0 msgr2=0x7f26cc19e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26cc076bb0 0x7f26cc19e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.916+0000 7f26d2200640 1 -- 172.21.15.150:0/2130117160 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc1a5f90 con 0x7f26cc078790 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.917+0000 7f26d2200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 0x7f26cc1a5920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26c400eb10 tx=0x7f26c400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.917+0000 7f26ca000640 1 -- 172.21.15.150:0/2130117160 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4004b20 con 0x7f26cc078790 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.917+0000 7f26ca000640 1 -- 172.21.15.150:0/2130117160 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26c4004cc0 con 0x7f26cc078790 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.917+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc1a6280 con 0x7f26cc078790 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.917+0000 7f26ca000640 1 -- 172.21.15.150:0/2130117160 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4010760 con 0x7f26cc078790 2024-09-15T22:19:41.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.917+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc1a6820 con 0x7f26cc078790 2024-09-15T22:19:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.920+0000 7f26d70c8740 1 Processor -- start 2024-09-15T22:19:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.920+0000 7f26ca000640 1 -- 172.21.15.150:0/2130117160 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f26c4005020 con 0x7f26cc078790 2024-09-15T22:19:41.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.920+0000 7f26d70c8740 1 -- start start 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd44421490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd444219d0 0x55cd44426490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd44426a60 0x55cd44428f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d70c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55cd44386100 con 0x55cd44421090 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d70c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd4432e1b0 con 0x55cd444219d0 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d70c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cd443820c0 con 0x55cd44426a60 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd44421490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d1800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd444219d0 0x55cd44426490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd44421490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42330/0 (socket says 172.21.15.150:42330) 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d0e00640 1 -- 172.21.15.150:0/1016697037 learned_addr learned my addr 172.21.15.150:0/1016697037 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d0e00640 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd44426a60 0x55cd44428f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d1800640 1 -- 172.21.15.150:0/1016697037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd44426a60 msgr2=0x55cd44428f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d1800640 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd44426a60 0x55cd44428f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d1800640 1 -- 172.21.15.150:0/1016697037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 msgr2=0x55cd44421490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d1800640 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd44421490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.921+0000 7f26d1800640 1 -- 172.21.15.150:0/1016697037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd44099210 con 0x55cd444219d0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26d1800640 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd444219d0 0x55cd44426490 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26c002a920 tx=0x7f26c0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ddefa72bcd7d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26ca000640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f26b40a3370 0x7f26b40a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26bea00640 1 -- 172.21.15.150:0/1016697037 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0035040 con 0x55cd444219d0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26bea00640 1 -- 172.21.15.150:0/1016697037 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26c0005520 con 0x55cd444219d0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26bea00640 1 -- 172.21.15.150:0/1016697037 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00316b0 con 0x55cd444219d0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26ca000640 1 -- 172.21.15.150:0/2130117160 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f26c40cffc0 con 0x7f26cc078790 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.922+0000 7f26d0e00640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f26b40a3370 0x7f26b40a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 -- 172.21.15.150:0/1016697037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd444219d0 msgr2=0x55cd44426490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd444219d0 0x55cd44426490 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26c002a920 tx=0x7f26c0005c00 comp rx=0 tx=0).stop 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d0e00640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f26b40a3370 0x7f26b40a5830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26b80095f0 tx=0x7f26b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 -- 172.21.15.150:0/1016697037 shutdown_connections 2024-09-15T22:19:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd44426a60 0x55cd44428f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd444219d0 0x55cd44426490 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 --2- 172.21.15.150:0/1016697037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd44421490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 -- 172.21.15.150:0/1016697037 >> 172.21.15.150:0/1016697037 conn(0x55cd4441c700 msgr2=0x55cd4441cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 -- 172.21.15.150:0/1016697037 shutdown_connections 2024-09-15T22:19:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 -- 172.21.15.150:0/1016697037 wait complete. 2024-09-15T22:19:41.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.923+0000 7f26d70c8740 1 -- start start 2024-09-15T22:19:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 Processor -- start 2024-09-15T22:19:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55cd444299d0 con 0x55cd44421090 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd4430f090 con 0x55cd44426a60 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cd44429b50 con 0x55cd444219d0 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d70c8740 10 client.0 _ll_register_callbacks cb 0x55cd44363f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42338/0 (socket says 172.21.15.150:42338) 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d1800640 1 -- 172.21.15.150:0/3663413780 learned_addr learned my addr 172.21.15.150:0/3663413780 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d2200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.924+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43322/0 (socket says 172.21.15.150:43322) 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d1800640 1 -- 172.21.15.150:0/3663413780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 msgr2=0x55cd4442b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d1800640 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d1800640 1 -- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 msgr2=0x55cd44432850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d1800640 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d1800640 1 -- 172.21.15.150:0/3663413780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd44165620 con 0x55cd44421090 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d2200640 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d1800640 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b2d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004c20 tx=0x7f26c0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bc3651da351594 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26b3400640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26b3400640 1 -- 172.21.15.150:0/3663413780 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0052060 con 0x55cd44421090 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26b3400640 1 -- 172.21.15.150:0/3663413780 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f26c0004f60 con 0x55cd44421090 2024-09-15T22:19:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.925+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c0005520 con 0x55cd44421090 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26b3400640 1 -- 172.21.15.150:0/3663413780 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f26c0035050 con 0x55cd44421090 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 10 client.15564 fetch_fsmap learned FSMap version 44 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cd44435640 con 0x55cd44421090 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26b3400640 1 -- 172.21.15.150:0/3663413780 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26c0005520 con 0x55cd44421090 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26b3400640 1 -- 172.21.15.150:0/3663413780 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 44) ==== 8434+0+0 (secure 0 0 0) 0x7f26c00035f0 con 0x55cd44421090 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 10 client.15564 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 20 client.15564 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd44436990 0x55cd44438d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 4 client.15564 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd44393830 con 0x55cd44436990 2024-09-15T22:19:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.926+0000 7f26d0e00640 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd44436990 0x55cd44438d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.927+0000 7f26d0e00640 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd44436990 0x55cd44438d80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6f7b40c24fab87 server_cookie=1c5a9a3e0f1ef04e in_seq=0 out_seq=0 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.927+0000 7f26b3400640 10 client.15564 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26b3400640 1 -- 172.21.15.150:0/3663413780 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd44393830 con 0x55cd44436990 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26b3400640 10 client.15564 handle_command_reply: tid=0 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 client.15564 shutdown 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 msgr2=0x55cd4442b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b2d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26c0004c20 tx=0x7f26c0004530 comp rx=0 tx=0).stop 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 shutdown_connections 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd44436990 0x55cd44438d80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3663413780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b2d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26b3400640 0 client.15564 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 >> 172.21.15.150:0/3663413780 conn(0x55cd4441c700 msgr2=0x55cd4441df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 shutdown_connections 2024-09-15T22:19:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 1 -- 172.21.15.150:0/3663413780 wait complete. 2024-09-15T22:19:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.928+0000 7f26d70c8740 20 client.15564 trim_cache size 0 max 16384 2024-09-15T22:19:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 Processor -- start 2024-09-15T22:19:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 -- start start 2024-09-15T22:19:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd44421470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1af580 con 0x55cd44421090 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1b1360 con 0x55cd44426a60 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.943+0000 7f26d70c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1afd10 con 0x55cd444219d0 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd44421470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd44421470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43338/0 (socket says 172.21.15.150:43338) 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 -- 172.21.15.150:0/3878644024 learned_addr learned my addr 172.21.15.150:0/3878644024 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:42350/0 (socket says 172.21.15.150:42350) 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d2200640 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 -- 172.21.15.150:0/3878644024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 msgr2=0x55cd44432770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 -- 172.21.15.150:0/3878644024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 msgr2=0x55cd4442b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 -- 172.21.15.150:0/3878644024 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd44439400 con 0x55cd444219d0 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d1800640 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d2200640 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26d0e00640 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd44421470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55cd44439630 tx=0x7f26b8012070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406c54d20eb94362 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26be000640 1 -- 172.21.15.150:0/3878644024 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8005020 con 0x55cd444219d0 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.944+0000 7f26be000640 1 -- 172.21.15.150:0/3878644024 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b800f830 con 0x55cd444219d0 2024-09-15T22:19:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26be000640 1 -- 172.21.15.150:0/3878644024 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8004870 con 0x55cd444219d0 2024-09-15T22:19:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 -- 172.21.15.150:0/3878644024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 msgr2=0x55cd44421470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd44421470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55cd44439630 tx=0x7f26b8012070 comp rx=0 tx=0).stop 2024-09-15T22:19:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 -- 172.21.15.150:0/3878644024 shutdown_connections 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44432770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd44421470 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 --2- 172.21.15.150:0/3878644024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 -- 172.21.15.150:0/3878644024 >> 172.21.15.150:0/3878644024 conn(0x55cd4441c700 msgr2=0x55cd4441b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 -- 172.21.15.150:0/3878644024 shutdown_connections 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.945+0000 7f26d70c8740 1 -- 172.21.15.150:0/3878644024 wait complete. 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 -- start start 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 Processor -- start 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44430f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1b0c30 con 0x55cd44421090 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1b04a0 con 0x55cd44426a60 2024-09-15T22:19:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1ad560 con 0x55cd444219d0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d70c8740 10 client.0 _ll_register_callbacks cb 0x7f26b8009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43352/0 (socket says 172.21.15.150:43352) 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d0e00640 1 -- 172.21.15.150:0/2362834079 learned_addr learned my addr 172.21.15.150:0/2362834079 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.946+0000 7f26d2200640 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44430f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d0e00640 1 -- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 msgr2=0x55cd44430f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d0e00640 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44430f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d0e00640 1 -- 172.21.15.150:0/2362834079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 msgr2=0x55cd4442fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d0e00640 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d0e00640 1 -- 172.21.15.150:0/2362834079 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd44426790 con 0x55cd444219d0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d0e00640 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442ff60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f26b8010010 tx=0x7f26b8009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ff1f35ceb7a487c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:41.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26b3400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26b3400640 1 -- 172.21.15.150:0/2362834079 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b803a020 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b800f830 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26b3400640 1 -- 172.21.15.150:0/2362834079 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f26b800faa0 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26b3400640 1 -- 172.21.15.150:0/2362834079 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f26b8045050 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d70c8740 10 client.25582 fetch_fsmap learned FSMap version 44 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.947+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cd444326c0 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26b3400640 1 -- 172.21.15.150:0/2362834079 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b800f830 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26b3400640 1 -- 172.21.15.150:0/2362834079 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 44) ==== 8434+0+0 (secure 0 0 0) 0x7f26b8035030 con 0x55cd444219d0 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d70c8740 10 client.25582 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d70c8740 10 client.25582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d70c8740 20 client.25582 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d70c8740 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd444a1900 0x55cd444a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d70c8740 4 client.25582 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:19:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd4438db80 con 0x55cd444a1900 2024-09-15T22:19:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.948+0000 7f26d1800640 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd444a1900 0x55cd444a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.949+0000 7f26d1800640 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd444a1900 0x55cd444a3d20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f209ae396af79387 server_cookie=a0e4b6e38bb5fa7d in_seq=0 out_seq=0 2024-09-15T22:19:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.949+0000 7f26b3400640 10 client.25582 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:41.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26b3400640 1 -- 172.21.15.150:0/2362834079 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd4438db80 con 0x55cd444a1900 2024-09-15T22:19:41.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26b3400640 10 client.25582 handle_command_reply: tid=0 2024-09-15T22:19:41.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 client.25582 shutdown 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 msgr2=0x55cd4442ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442ff60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f26b8010010 tx=0x7f26b8009bc0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 shutdown_connections 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cd444a1900 0x55cd444a3d20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd44426a60 0x55cd44430f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd444219d0 0x55cd4442ff60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 --2- 172.21.15.150:0/2362834079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cd44421090 0x55cd4442fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26b3400640 0 client.25582 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.962+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 >> 172.21.15.150:0/2362834079 conn(0x55cd4441c700 msgr2=0x55cd4441b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 shutdown_connections 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d70c8740 1 -- 172.21.15.150:0/2362834079 wait complete. 2024-09-15T22:19:41.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d70c8740 20 client.25582 trim_cache size 0 max 16384 2024-09-15T22:19:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:19:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:19:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:19:41.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f26b40a3370 msgr2=0x7f26b40a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f26b40a3370 0x7f26b40a5830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26b80095f0 tx=0x7f26b8005f90 comp rx=0 tx=0).stop 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 msgr2=0x7f26cc1a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 0x7f26cc1a5920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26c400eb10 tx=0x7f26c400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 shutdown_connections 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26cc078790 0x7f26cc1a5920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26cc077df0 0x7f26cc19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f26b40a3370 0x7f26b40a5830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 --2- 172.21.15.150:0/2130117160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26cc076bb0 0x7f26cc19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:41.967 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.963+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 >> 172.21.15.150:0/2130117160 conn(0x7f26cc0ff4e0 msgr2=0x7f26cc100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.964+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 shutdown_connections 2024-09-15T22:19:41.968 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:41.964+0000 7f26d4200640 1 -- 172.21.15.150:0/2130117160 wait complete. 2024-09-15T22:19:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:42 smithi150 ceph-mon[30886]: pgmap v583: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 452 op/s 2024-09-15T22:19:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:42 smithi169 ceph-mon[35850]: pgmap v583: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 452 op/s 2024-09-15T22:19:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:42 smithi154 ceph-mon[34853]: pgmap v583: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 452 op/s 2024-09-15T22:19:44.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:44 smithi150 ceph-mon[30886]: pgmap v584: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-15T22:19:44.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:44 smithi169 ceph-mon[35850]: pgmap v584: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-15T22:19:44.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:44 smithi154 ceph-mon[34853]: pgmap v584: 97 pgs: 97 active+clean; 2.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-15T22:19:45.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:45 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:45.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:45 smithi150 ceph-mon[30886]: pgmap v585: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 501 op/s 2024-09-15T22:19:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:45 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:45.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:45 smithi169 ceph-mon[35850]: pgmap v585: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 501 op/s 2024-09-15T22:19:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:45 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:19:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:45 smithi154 ceph-mon[34853]: pgmap v585: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 501 op/s 2024-09-15T22:19:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:48 smithi150 ceph-mon[30886]: pgmap v586: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 431 op/s 2024-09-15T22:19:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:48 smithi169 ceph-mon[35850]: pgmap v586: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 431 op/s 2024-09-15T22:19:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:48 smithi154 ceph-mon[34853]: pgmap v586: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 431 op/s 2024-09-15T22:19:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:50 smithi150 ceph-mon[30886]: pgmap v587: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 430 op/s 2024-09-15T22:19:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:50 smithi169 ceph-mon[35850]: pgmap v587: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 430 op/s 2024-09-15T22:19:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:50 smithi154 ceph-mon[34853]: pgmap v587: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 430 op/s 2024-09-15T22:19:52.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:52 smithi150 ceph-mon[30886]: pgmap v588: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 411 op/s 2024-09-15T22:19:52.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:52 smithi169 ceph-mon[35850]: pgmap v588: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 411 op/s 2024-09-15T22:19:52.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:52 smithi154 ceph-mon[34853]: pgmap v588: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 411 op/s 2024-09-15T22:19:54.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:54 smithi150 ceph-mon[30886]: pgmap v589: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-09-15T22:19:54.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:54 smithi169 ceph-mon[35850]: pgmap v589: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-09-15T22:19:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:54 smithi154 ceph-mon[34853]: pgmap v589: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 335 op/s 2024-09-15T22:19:55.102 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 -- 172.21.15.150:0/4247845628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101f40 msgr2=0x7f5dec109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.102 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 --2- 172.21.15.150:0/4247845628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101f40 0x7f5dec109db0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009ca0 tx=0x7f5de402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 -- 172.21.15.150:0/4247845628 shutdown_connections 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 --2- 172.21.15.150:0/4247845628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101f40 0x7f5dec109db0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 --2- 172.21.15.150:0/4247845628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dec101580 0x7f5dec101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 --2- 172.21.15.150:0/4247845628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dec103050 0x7f5dec103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 -- 172.21.15.150:0/4247845628 >> 172.21.15.150:0/4247845628 conn(0x7f5dec0fd0d0 msgr2=0x7f5dec0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 -- 172.21.15.150:0/4247845628 shutdown_connections 2024-09-15T22:19:55.103 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.100+0000 7f5df2200640 1 -- 172.21.15.150:0/4247845628 wait complete. 2024-09-15T22:19:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 Processor -- start 2024-09-15T22:19:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 -- start start 2024-09-15T22:19:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 0x7f5dec075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dec101f40 0x7f5dec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dec103050 0x7f5dec074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec10d6f0 con 0x7f5dec101580 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec10d570 con 0x7f5dec103050 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.101+0000 7f5df2200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec10d870 con 0x7f5dec101f40 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 0x7f5dec075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 0x7f5dec075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57348/0 (socket says 172.21.15.150:57348) 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df1800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dec103050 0x7f5dec074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 -- 172.21.15.150:0/97975572 learned_addr learned my addr 172.21.15.150:0/97975572 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5debe00640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dec101f40 0x7f5dec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 -- 172.21.15.150:0/97975572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dec101f40 msgr2=0x7f5dec0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dec101f40 0x7f5dec0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 -- 172.21.15.150:0/97975572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dec103050 msgr2=0x7f5dec074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dec103050 0x7f5dec074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 -- 172.21.15.150:0/97975572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec0753b0 con 0x7f5dec101580 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.102+0000 7f5df0e00640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 0x7f5dec075fa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5de000e9c0 tx=0x7f5de000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.103+0000 7f5de9600640 1 -- 172.21.15.150:0/97975572 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de000cd80 con 0x7f5dec101580 2024-09-15T22:19:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.103+0000 7f5de9600640 1 -- 172.21.15.150:0/97975572 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de00035f0 con 0x7f5dec101580 2024-09-15T22:19:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.103+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec1a1ea0 con 0x7f5dec101580 2024-09-15T22:19:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.103+0000 7f5de9600640 1 -- 172.21.15.150:0/97975572 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0010690 con 0x7f5dec101580 2024-09-15T22:19:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.103+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec1a22b0 con 0x7f5dec101580 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.105+0000 7f5df6600740 1 Processor -- start 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5de9600640 1 -- 172.21.15.150:0/97975572 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f5de00037a0 con 0x7f5dec101580 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 -- start start 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 0x55f97f6cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6ccba0 0x55f97f6d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f97f631100 con 0x55f97f6cc260 2024-09-15T22:19:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f97f5d91b0 con 0x55f97f6ccba0 2024-09-15T22:19:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df6600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f97f62d0c0 con 0x55f97f6d1c30 2024-09-15T22:19:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 0x55f97f6cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 0x55f97f6cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57356/0 (socket says 172.21.15.150:57356) 2024-09-15T22:19:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5df1800640 1 -- 172.21.15.150:0/3494727750 learned_addr learned my addr 172.21.15.150:0/3494727750 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.106+0000 7f5debe00640 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df1800640 1 -- 172.21.15.150:0/3494727750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 msgr2=0x55f97f6d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df1800640 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6d40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df1800640 1 -- 172.21.15.150:0/3494727750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6ccba0 msgr2=0x55f97f6d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df1800640 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6ccba0 0x55f97f6d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df1800640 1 -- 172.21.15.150:0/3494727750 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f97f344210 con 0x55f97f6cc260 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df1800640 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 0x55f97f6cc660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009ca0 tx=0x7f5de4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5dc2ff59e4e21e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5dde000640 1 -- 172.21.15.150:0/3494727750 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40098c0 con 0x55f97f6cc260 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5de9600640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5dd40a3240 0x7f5dd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5dde000640 1 -- 172.21.15.150:0/3494727750 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de4036040 con 0x55f97f6cc260 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5dde000640 1 -- 172.21.15.150:0/3494727750 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4004270 con 0x55f97f6cc260 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5de9600640 1 -- 172.21.15.150:0/97975572 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f5de00cfc40 con 0x7f5dec101580 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.107+0000 7f5df0e00640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5dd40a3240 0x7f5dd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 -- 172.21.15.150:0/3494727750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 msgr2=0x55f97f6cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 0x55f97f6cc660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009ca0 tx=0x7f5de4009360 comp rx=0 tx=0).stop 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 -- 172.21.15.150:0/3494727750 shutdown_connections 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6d40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6ccba0 0x55f97f6d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 --2- 172.21.15.150:0/3494727750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6cc260 0x55f97f6cc660 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 -- 172.21.15.150:0/3494727750 >> 172.21.15.150:0/3494727750 conn(0x55f97f6c78d0 msgr2=0x55f97f6c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 -- 172.21.15.150:0/3494727750 shutdown_connections 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df0e00640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5dd40a3240 0x7f5dd40a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5de00a4910 tx=0x7f5de0097d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.108+0000 7f5df6600740 1 -- 172.21.15.150:0/3494727750 wait complete. 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 -- start start 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 Processor -- start 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6d61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6d6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f97f6d49c0 con 0x55f97f6ccba0 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f97f5ba090 con 0x55f97f6d1c30 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f97f6d4b40 con 0x55f97f6cc260 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df6600740 10 client.0 _ll_register_callbacks cb 0x55f97f60ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5debe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.109+0000 7f5df1800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6d61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6d6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57372/0 (socket says 172.21.15.150:57372) 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 -- 172.21.15.150:0/3463908454 learned_addr learned my addr 172.21.15.150:0/3463908454 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5df1800640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 -- 172.21.15.150:0/3463908454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 msgr2=0x55f97f6d61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6d61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 -- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 msgr2=0x55f97f6dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 -- 172.21.15.150:0/3463908454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f97f410620 con 0x55f97f6ccba0 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5df1800640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5debe00640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6d6710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800bf80 tx=0x7f5dd80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1156c9f86c70dec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5dd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5dd2a00640 1 -- 172.21.15.150:0/3463908454 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8004020 con 0x55f97f6ccba0 2024-09-15T22:19:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5dd2a00640 1 -- 172.21.15.150:0/3463908454 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f5dd80041c0 con 0x55f97f6ccba0 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.110+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5de4036040 con 0x55f97f6ccba0 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5dd2a00640 1 -- 172.21.15.150:0/3463908454 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5dd80043c0 con 0x55f97f6ccba0 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 10 client.15582 fetch_fsmap learned FSMap version 45 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55f97f6e0600 con 0x55f97f6ccba0 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5dd2a00640 1 -- 172.21.15.150:0/3463908454 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de4036040 con 0x55f97f6ccba0 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5dd2a00640 1 -- 172.21.15.150:0/3463908454 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 45) ==== 8430+0+0 (secure 0 0 0) 0x7f5dd8003ae0 con 0x55f97f6ccba0 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 10 client.15582 fetch_fsmap finished waiting for FSMap version 45 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 20 client.15582 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f6e1d90 0x55f97f6e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 4 client.15582 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.111+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f97f63e830 con 0x55f97f6e1d90 2024-09-15T22:19:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.112+0000 7f5df1800640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f6e1d90 0x55f97f6e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.112+0000 7f5df1800640 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f6e1d90 0x55f97f6e41d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16271dc3eb8a3f08 server_cookie=c8ebdd6cc67fe572 in_seq=0 out_seq=0 2024-09-15T22:19:55.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.112+0000 7f5dd2a00640 10 client.15582 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5dd2a00640 1 -- 172.21.15.150:0/3463908454 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f97f63e830 con 0x55f97f6e1d90 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5dd2a00640 10 client.15582 handle_command_reply: tid=0 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 client.15582 shutdown 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 msgr2=0x55f97f6d6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6d6710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800bf80 tx=0x7f5dd80118d0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 shutdown_connections 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f6e1d90 0x55f97f6e41d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6d6710 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 --2- 172.21.15.150:0/3463908454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6d61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 >> 172.21.15.150:0/3463908454 conn(0x55f97f6c78d0 msgr2=0x55f97f6c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5dd2a00640 0 client.15582 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 shutdown_connections 2024-09-15T22:19:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 1 -- 172.21.15.150:0/3463908454 wait complete. 2024-09-15T22:19:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.113+0000 7f5df6600740 20 client.15582 trim_cache size 0 max 16384 2024-09-15T22:19:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.128+0000 7f5df6600740 1 Processor -- start 2024-09-15T22:19:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.128+0000 7f5df6600740 1 -- start start 2024-09-15T22:19:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df6600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6cc260 0x55f97f6c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df6600740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df6600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df6600740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1ab010 con 0x55f97f6ccba0 2024-09-15T22:19:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df6600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1acdc0 con 0x55f97f6cc260 2024-09-15T22:19:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df6600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1ab7a0 con 0x55f97f6d1c30 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57386/0 (socket says 172.21.15.150:57386) 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 -- 172.21.15.150:0/3639403861 learned_addr learned my addr 172.21.15.150:0/3639403861 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df1800640 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6cc260 0x55f97f6c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df1800640 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 -- 172.21.15.150:0/3639403861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 msgr2=0x55f97f6c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 -- 172.21.15.150:0/3639403861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6cc260 msgr2=0x55f97f6c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6cc260 0x55f97f6c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5debe00640 1 -- 172.21.15.150:0/3639403861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f97f6c76f0 con 0x55f97f6ccba0 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.129+0000 7f5df1800640 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.130+0000 7f5debe00640 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dd710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c010 tx=0x7f5dd8005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6dbe635e29bafe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.130+0000 7f5ddd600640 1 -- 172.21.15.150:0/3639403861 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8030020 con 0x55f97f6ccba0 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.130+0000 7f5ddd600640 1 -- 172.21.15.150:0/3639403861 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd8005520 con 0x55f97f6ccba0 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.130+0000 7f5ddd600640 1 -- 172.21.15.150:0/3639403861 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8028040 con 0x55f97f6ccba0 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.130+0000 7f5df6600740 1 -- 172.21.15.150:0/3639403861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 msgr2=0x55f97f6dd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.130+0000 7f5df6600740 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dd710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c010 tx=0x7f5dd8005b90 comp rx=0 tx=0).stop 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- 172.21.15.150:0/3639403861 shutdown_connections 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6d1c30 0x55f97f6c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dd710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 --2- 172.21.15.150:0/3639403861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6cc260 0x55f97f6c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- 172.21.15.150:0/3639403861 >> 172.21.15.150:0/3639403861 conn(0x55f97f6c78d0 msgr2=0x55f97f6cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- 172.21.15.150:0/3639403861 shutdown_connections 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- 172.21.15.150:0/3639403861 wait complete. 2024-09-15T22:19:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- start start 2024-09-15T22:19:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 Processor -- start 2024-09-15T22:19:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1ac6c0 con 0x55f97f6ccba0 2024-09-15T22:19:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1abf30 con 0x55f97f6d1c30 2024-09-15T22:19:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.131+0000 7f5df6600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1a8ff0 con 0x55f97f6cc260 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5df6600740 10 client.0 _ll_register_callbacks cb 0x7f5dd800bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57388/0 (socket says 172.21.15.150:57388) 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 -- 172.21.15.150:0/1502198469 learned_addr learned my addr 172.21.15.150:0/1502198469 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5df1800640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5df1800640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 -- 172.21.15.150:0/1502198469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 msgr2=0x55f97f6da7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6da7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 -- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 msgr2=0x55f97f6dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 -- 172.21.15.150:0/1502198469 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f97f6dc300 con 0x55f97f6ccba0 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5df1800640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6da7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5debe00640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dad30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8005d80 tx=0x7f5dd800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c5000c17fae1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.132+0000 7f5dd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5dd2a00640 1 -- 172.21.15.150:0/1502198469 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8030070 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5dd2a00640 1 -- 172.21.15.150:0/1502198469 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f5dd8010dc0 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd8005520 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5dd2a00640 1 -- 172.21.15.150:0/1502198469 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5dd8028040 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 10 client.15588 fetch_fsmap learned FSMap version 45 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55f97f6dd580 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5dd2a00640 1 -- 172.21.15.150:0/1502198469 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd8005520 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5dd2a00640 1 -- 172.21.15.150:0/1502198469 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 45) ==== 8430+0+0 (secure 0 0 0) 0x7f5dd802b070 con 0x55f97f6ccba0 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 10 client.15588 fetch_fsmap finished waiting for FSMap version 45 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 20 client.15588 populate_metadata read hostname 'smithi150' 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f74cc70 0x55f97f74f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 4 client.15588 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:19:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.133+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f97f638b80 con 0x55f97f74cc70 2024-09-15T22:19:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.134+0000 7f5df1800640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f74cc70 0x55f97f74f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.134+0000 7f5df1800640 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f74cc70 0x55f97f74f090 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975ce1b5c85bc76a server_cookie=bcaaadce6049b7e8 in_seq=0 out_seq=0 2024-09-15T22:19:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:55.134+0000 7f5dd2a00640 10 client.15588 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:56 smithi150 ceph-mon[30886]: pgmap v590: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 334 op/s 2024-09-15T22:19:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:56 smithi169 ceph-mon[35850]: pgmap v590: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 334 op/s 2024-09-15T22:19:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:56 smithi154 ceph-mon[34853]: pgmap v590: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 334 op/s 2024-09-15T22:19:57.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:19:57 smithi150 ceph-mon[30886]: pgmap v591: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-09-15T22:19:57.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:19:57 smithi169 ceph-mon[35850]: pgmap v591: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-09-15T22:19:57.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:19:57 smithi154 ceph-mon[34853]: pgmap v591: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-09-15T22:19:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.792+0000 7f5dd2a00640 1 -- 172.21.15.150:0/1502198469 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f97f638b80 con 0x55f97f74cc70 2024-09-15T22:19:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.792+0000 7f5dd2a00640 10 client.15588 handle_command_reply: tid=0 2024-09-15T22:19:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.792+0000 7f5df6600740 1 client.15588 shutdown 2024-09-15T22:19:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 msgr2=0x55f97f6dad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dad30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8005d80 tx=0x7f5dd800b790 comp rx=0 tx=0).stop 2024-09-15T22:19:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 shutdown_connections 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55f97f74cc70 0x55f97f74f090 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f97f6d1c30 0x55f97f6dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f97f6ccba0 0x55f97f6dad30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 --2- 172.21.15.150:0/1502198469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f97f6cc260 0x55f97f6da7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 >> 172.21.15.150:0/1502198469 conn(0x55f97f6c78d0 msgr2=0x55f97f6d6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5dd2a00640 0 client.15588 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 shutdown_connections 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 1 -- 172.21.15.150:0/1502198469 wait complete. 2024-09-15T22:19:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.793+0000 7f5df6600740 20 client.15588 trim_cache size 0 max 16384 2024-09-15T22:19:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:19:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:19:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:19:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5dd40a3240 msgr2=0x7f5dd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5dd40a3240 0x7f5dd40a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5de00a4910 tx=0x7f5de0097d50 comp rx=0 tx=0).stop 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 msgr2=0x7f5dec075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 0x7f5dec075fa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5de000e9c0 tx=0x7f5de000ee80 comp rx=0 tx=0).stop 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 shutdown_connections 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dec103050 0x7f5dec074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dec101f40 0x7f5dec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f5dd40a3240 0x7f5dd40a5700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 --2- 172.21.15.150:0/97975572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5dec101580 0x7f5dec075fa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.794+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 >> 172.21.15.150:0/97975572 conn(0x7f5dec0fd0d0 msgr2=0x7f5dec105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.795+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 shutdown_connections 2024-09-15T22:19:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:19:57.795+0000 7f5df2200640 1 -- 172.21.15.150:0/97975572 wait complete. 2024-09-15T22:20:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:00 smithi150 ceph-mon[30886]: pgmap v592: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 953 op/s 2024-09-15T22:20:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:00 smithi150 ceph-mon[30886]: overall HEALTH_OK 2024-09-15T22:20:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:00 smithi169 ceph-mon[35850]: pgmap v592: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 953 op/s 2024-09-15T22:20:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:00 smithi169 ceph-mon[35850]: overall HEALTH_OK 2024-09-15T22:20:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:00 smithi154 ceph-mon[34853]: pgmap v592: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 953 op/s 2024-09-15T22:20:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:00 smithi154 ceph-mon[34853]: overall HEALTH_OK 2024-09-15T22:20:02.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:02 smithi150 ceph-mon[30886]: pgmap v593: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 1.32k op/s 2024-09-15T22:20:02.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:02 smithi169 ceph-mon[35850]: pgmap v593: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 1.32k op/s 2024-09-15T22:20:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:02 smithi154 ceph-mon[34853]: pgmap v593: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 1.32k op/s 2024-09-15T22:20:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:04 smithi150 ceph-mon[30886]: pgmap v594: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 1.39k op/s 2024-09-15T22:20:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:04 smithi169 ceph-mon[35850]: pgmap v594: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 1.39k op/s 2024-09-15T22:20:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:04 smithi154 ceph-mon[34853]: pgmap v594: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 1.39k op/s 2024-09-15T22:20:05.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:05 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:05 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:05.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:05 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:06.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:06 smithi150 ceph-mon[30886]: pgmap v595: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 1.50k op/s 2024-09-15T22:20:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:06 smithi169 ceph-mon[35850]: pgmap v595: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 1.50k op/s 2024-09-15T22:20:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:06 smithi154 ceph-mon[34853]: pgmap v595: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 1.50k op/s 2024-09-15T22:20:07.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:07 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:20:07.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:07 smithi169 ceph-mon[35850]: pgmap v596: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 1.55k op/s 2024-09-15T22:20:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:07 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:20:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:07 smithi154 ceph-mon[34853]: pgmap v596: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 1.55k op/s 2024-09-15T22:20:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:07 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:20:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:07 smithi150 ceph-mon[30886]: pgmap v596: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.5 MiB/s wr, 1.55k op/s 2024-09-15T22:20:10.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:10 smithi150 ceph-mon[30886]: pgmap v597: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 1.31k op/s 2024-09-15T22:20:10.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:10 smithi169 ceph-mon[35850]: pgmap v597: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 1.31k op/s 2024-09-15T22:20:10.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:10 smithi154 ceph-mon[34853]: pgmap v597: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 1.31k op/s 2024-09-15T22:20:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 -- 172.21.15.150:0/79238486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850105910 msgr2=0x7fa85010c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 --2- 172.21.15.150:0/79238486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850105910 0x7fa85010c1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa848009ca0 tx=0x7fa84802a8b0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 -- 172.21.15.150:0/79238486 shutdown_connections 2024-09-15T22:20:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 --2- 172.21.15.150:0/79238486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850105910 0x7fa85010c1a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 --2- 172.21.15.150:0/79238486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850104f50 0x7fa8501053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 --2- 172.21.15.150:0/79238486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850103d60 0x7fa850104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 -- 172.21.15.150:0/79238486 >> 172.21.15.150:0/79238486 conn(0x7fa8500ff4e0 msgr2=0x7fa850101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 -- 172.21.15.150:0/79238486 shutdown_connections 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.911+0000 7fa856e00640 1 -- 172.21.15.150:0/79238486 wait complete. 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 Processor -- start 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 -- start start 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 0x7fa850199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850104f50 0x7fa85019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850105910 0x7fa8501a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa85010fa10 con 0x7fa850105910 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa85010f890 con 0x7fa850104f50 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa856e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa85010fb90 con 0x7fa850103d60 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa84fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 0x7fa850199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa84fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 0x7fa850199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:33740/0 (socket says 172.21.15.150:33740) 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa84fe00640 1 -- 172.21.15.150:0/2647989053 learned_addr learned my addr 172.21.15.150:0/2647989053 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa84f400640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850104f50 0x7fa85019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.912+0000 7fa854e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850105910 0x7fa8501a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84fe00640 1 -- 172.21.15.150:0/2647989053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850104f50 msgr2=0x7fa85019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84fe00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850104f50 0x7fa85019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84fe00640 1 -- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850105910 msgr2=0x7fa8501a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84fe00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850105910 0x7fa8501a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84fe00640 1 -- 172.21.15.150:0/2647989053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8501a1b60 con 0x7fa850103d60 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa854e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850105910 0x7fa8501a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84fe00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 0x7fa850199f40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa84000e9c0 tx=0x7fa84000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84cc00640 1 -- 172.21.15.150:0/2647989053 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84000cde0 con 0x7fa850103d60 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8501a1e50 con 0x7fa850103d60 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84cc00640 1 -- 172.21.15.150:0/2647989053 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa840010910 con 0x7fa850103d60 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa84cc00640 1 -- 172.21.15.150:0/2647989053 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840018a10 con 0x7fa850103d60 2024-09-15T22:20:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.913+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8501a2310 con 0x7fa850103d60 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.917+0000 7fa859c3e740 1 Processor -- start 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.917+0000 7fa859c3e740 1 -- start start 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebda9f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebda9f9d0 0x561ebdaa4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebdaa4a60 0x561ebdaa6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa859c3e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561ebda04100 con 0x561ebdaa4a60 2024-09-15T22:20:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa859c3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561ebd9ac1b0 con 0x561ebda9f090 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa859c3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561ebda000c0 con 0x561ebda9f9d0 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa84cc00640 1 -- 172.21.15.150:0/2647989053 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa84001f020 con 0x7fa850103d60 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebda9f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebda9f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60786/0 (socket says 172.21.15.150:60786) 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 -- 172.21.15.150:0/1701354404 learned_addr learned my addr 172.21.15.150:0/1701354404 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa84f400640 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebdaa4a60 0x561ebdaa6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa84fe00640 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebda9f9d0 0x561ebdaa4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 -- 172.21.15.150:0/1701354404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebda9f9d0 msgr2=0x561ebdaa4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebda9f9d0 0x561ebdaa4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 -- 172.21.15.150:0/1701354404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebdaa4a60 msgr2=0x561ebdaa6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebdaa4a60 0x561ebdaa6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.918+0000 7fa854e00640 1 -- 172.21.15.150:0/1701354404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ebd717210 con 0x561ebda9f090 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.919+0000 7fa854e00640 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebda9f490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa848005e30 tx=0x7fa848009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940769fd15637d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.919+0000 7fa845600640 1 -- 172.21.15.150:0/1701354404 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848030a30 con 0x561ebda9f090 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.919+0000 7fa845600640 1 -- 172.21.15.150:0/1701354404 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa848036040 con 0x561ebda9f090 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.919+0000 7fa845600640 1 -- 172.21.15.150:0/1701354404 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8480044c0 con 0x561ebda9f090 2024-09-15T22:20:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.919+0000 7fa84cc00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8340a32f0 0x7fa8340a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa84fe00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8340a32f0 0x7fa8340a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa84cc00640 1 -- 172.21.15.150:0/2647989053 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa8400cfc00 con 0x7fa850103d60 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 -- 172.21.15.150:0/1701354404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 msgr2=0x561ebda9f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebda9f490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa848005e30 tx=0x7fa848009a20 comp rx=0 tx=0).stop 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 -- 172.21.15.150:0/1701354404 shutdown_connections 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebdaa4a60 0x561ebdaa6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebda9f9d0 0x561ebdaa4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1701354404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebda9f490 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 -- 172.21.15.150:0/1701354404 >> 172.21.15.150:0/1701354404 conn(0x561ebda9a700 msgr2=0x561ebda9ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 -- 172.21.15.150:0/1701354404 shutdown_connections 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 -- 172.21.15.150:0/1701354404 wait complete. 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa84fe00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8340a32f0 0x7fa8340a57b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa8400cda40 tx=0x7fa84000efb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.920+0000 7fa859c3e740 1 -- start start 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 Processor -- start 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebdaa9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 0x561ebdaa96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdab0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561ebdaa79d0 con 0x561ebda9f9d0 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561ebd98d090 con 0x561ebda9f090 2024-09-15T22:20:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561ebdaa7b50 con 0x561ebdaa4a60 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa859c3e740 10 client.0 _ll_register_callbacks cb 0x561ebd9e1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa84f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 0x561ebdaa96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa854e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebdaa9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa84f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 0x561ebdaa96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43340/0 (socket says 172.21.15.150:43340) 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa84f400640 1 -- 172.21.15.150:0/2771757552 learned_addr learned my addr 172.21.15.150:0/2771757552 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.921+0000 7fa854e00640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdab0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa84f400640 1 -- 172.21.15.150:0/2771757552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 msgr2=0x561ebdab0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa84f400640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdab0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa84f400640 1 -- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 msgr2=0x561ebdaa9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa84f400640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebdaa9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa84f400640 1 -- 172.21.15.150:0/2771757552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ebd7e3620 con 0x561ebda9f9d0 2024-09-15T22:20:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa854e00640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdab0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa84f400640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 0x561ebdaa96d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa83c012720 tx=0x7fa83c012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db40b7e5fed34bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa83a000640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:20:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa83a000640 1 -- 172.21.15.150:0/2771757552 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00f920 con 0x561ebda9f9d0 2024-09-15T22:20:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa83a000640 1 -- 172.21.15.150:0/2771757552 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa83c00fac0 con 0x561ebda9f9d0 2024-09-15T22:20:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa848036040 con 0x561ebda9f9d0 2024-09-15T22:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa83a000640 1 -- 172.21.15.150:0/2771757552 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fa83c00fcc0 con 0x561ebda9f9d0 2024-09-15T22:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.922+0000 7fa859c3e740 10 client.15600 fetch_fsmap learned FSMap version 46 2024-09-15T22:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x561ebdab3620 con 0x561ebda9f9d0 2024-09-15T22:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa83a000640 1 -- 172.21.15.150:0/2771757552 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa848036040 con 0x561ebda9f9d0 2024-09-15T22:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa83a000640 1 -- 172.21.15.150:0/2771757552 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 46) ==== 8426+0+0 (secure 0 0 0) 0x7fa83c010430 con 0x561ebda9f9d0 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 10 client.15600 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 20 client.15600 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdab4ca0 0x561ebdab70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 4 client.15600 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ebda11830 con 0x561ebdab4ca0 2024-09-15T22:20:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.923+0000 7fa854e00640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdab4ca0 0x561ebdab70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.924+0000 7fa854e00640 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdab4ca0 0x561ebdab70f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84058d0580c6e70e server_cookie=597f02945d0a1ed3 in_seq=0 out_seq=0 2024-09-15T22:20:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.924+0000 7fa83a000640 10 client.15600 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa83a000640 1 -- 172.21.15.150:0/2771757552 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ebda11830 con 0x561ebdab4ca0 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa83a000640 10 client.15600 handle_command_reply: tid=0 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 client.15600 shutdown 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 msgr2=0x561ebdaa96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 0x561ebdaa96d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa83c012720 tx=0x7fa83c012be0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 shutdown_connections 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdab4ca0 0x561ebdab70f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdab0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f9d0 0x561ebdaa96d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 --2- 172.21.15.150:0/2771757552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f090 0x561ebdaa9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa83a000640 0 client.15600 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.926+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 >> 172.21.15.150:0/2771757552 conn(0x561ebda9a700 msgr2=0x561ebda9bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.927+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 shutdown_connections 2024-09-15T22:20:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.927+0000 7fa859c3e740 1 -- 172.21.15.150:0/2771757552 wait complete. 2024-09-15T22:20:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.927+0000 7fa859c3e740 20 client.15600 trim_cache size 0 max 16384 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.941+0000 7fa859c3e740 1 Processor -- start 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.941+0000 7fa859c3e740 1 -- start start 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebda99770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdab06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebda9baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa859c3e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8501ab1d0 con 0x561ebda9f090 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa859c3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8501acf50 con 0x561ebda9f9d0 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa859c3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8501ab960 con 0x561ebdaa4a60 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebda99770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa84f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdab06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa84f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdab06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60800/0 (socket says 172.21.15.150:60800) 2024-09-15T22:20:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa84f400640 1 -- 172.21.15.150:0/1174677971 learned_addr learned my addr 172.21.15.150:0/1174677971 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebda9baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 -- 172.21.15.150:0/1174677971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 msgr2=0x561ebda9baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebda9baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 -- 172.21.15.150:0/1174677971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 msgr2=0x561ebdab06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdab06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa854e00640 1 -- 172.21.15.150:0/1174677971 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ebda9feb0 con 0x561ebda9f090 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.942+0000 7fa84f400640 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdab06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.943+0000 7fa854e00640 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebda99770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa848004af0 tx=0x7fa84802a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58e21c65661705d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.943+0000 7fa844c00640 1 -- 172.21.15.150:0/1174677971 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848030c30 con 0x561ebda9f090 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.943+0000 7fa844c00640 1 -- 172.21.15.150:0/1174677971 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa848036070 con 0x561ebda9f090 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.943+0000 7fa844c00640 1 -- 172.21.15.150:0/1174677971 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848004620 con 0x561ebda9f090 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.943+0000 7fa859c3e740 1 -- 172.21.15.150:0/1174677971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 msgr2=0x561ebda99770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.943+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebda99770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa848004af0 tx=0x7fa84802a8b0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 -- 172.21.15.150:0/1174677971 shutdown_connections 2024-09-15T22:20:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebda9baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdab06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 --2- 172.21.15.150:0/1174677971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebda99770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 -- 172.21.15.150:0/1174677971 >> 172.21.15.150:0/1174677971 conn(0x561ebda9a700 msgr2=0x561ebda99060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 -- 172.21.15.150:0/1174677971 shutdown_connections 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 -- 172.21.15.150:0/1174677971 wait complete. 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 -- start start 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 Processor -- start 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebdaad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.944+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdaade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa859c3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdaaee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa859c3e740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8501ac880 con 0x561ebda9f090 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa859c3e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8501ac0f0 con 0x561ebda9f9d0 2024-09-15T22:20:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa859c3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8501a91b0 con 0x561ebdaa4a60 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa859c3e740 10 client.0 _ll_register_callbacks cb 0x7fa83c009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdaade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa854e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebdaad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdaade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60806/0 (socket says 172.21.15.150:60806) 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 -- 172.21.15.150:0/470794926 learned_addr learned my addr 172.21.15.150:0/470794926 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa854e00640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdaaee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 -- 172.21.15.150:0/470794926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 msgr2=0x561ebdaaee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdaaee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 -- 172.21.15.150:0/470794926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 msgr2=0x561ebdaad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebdaad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 -- 172.21.15.150:0/470794926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ebdaaf470 con 0x561ebda9f9d0 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa854e00640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdaaee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa84f400640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdaade50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa83c012d40 tx=0x7fa83c00fb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb550e0a8cef261 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa83a000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.945+0000 7fa83a000640 1 -- 172.21.15.150:0/470794926 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02b060 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa848036070 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa83a000640 1 -- 172.21.15.150:0/470794926 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa83c005080 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa83a000640 1 -- 172.21.15.150:0/470794926 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fa83c005280 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 10 client.25610 fetch_fsmap learned FSMap version 46 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x561ebdab07b0 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa83a000640 1 -- 172.21.15.150:0/470794926 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa848036070 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa83a000640 1 -- 172.21.15.150:0/470794926 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 46) ==== 8426+0+0 (secure 0 0 0) 0x7fa83c026430 con 0x561ebda9f9d0 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 10 client.25610 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 20 client.25610 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdb1fe60 0x561ebdb22280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 4 client.25610 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:20:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.946+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ebda0bb80 con 0x561ebdb1fe60 2024-09-15T22:20:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.947+0000 7fa854e00640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdb1fe60 0x561ebdb22280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.947+0000 7fa83a000640 10 client.25610 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:10.947+0000 7fa854e00640 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdb1fe60 0x561ebdb22280 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ffa9e36fd6949f2 server_cookie=bf9b7dee7466442c in_seq=0 out_seq=0 2024-09-15T22:20:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:12 smithi150 ceph-mon[30886]: pgmap v598: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 813 op/s 2024-09-15T22:20:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:12 smithi169 ceph-mon[35850]: pgmap v598: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 813 op/s 2024-09-15T22:20:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:12 smithi154 ceph-mon[34853]: pgmap v598: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 813 op/s 2024-09-15T22:20:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:13 smithi154 ceph-mon[34853]: pgmap v599: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 389 op/s 2024-09-15T22:20:13.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:13 smithi150 ceph-mon[30886]: pgmap v599: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 389 op/s 2024-09-15T22:20:13.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:13 smithi169 ceph-mon[35850]: pgmap v599: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 389 op/s 2024-09-15T22:20:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.441+0000 7fa83a000640 1 -- 172.21.15.150:0/470794926 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ebda0bb80 con 0x561ebdb1fe60 2024-09-15T22:20:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.441+0000 7fa83a000640 10 client.25610 handle_command_reply: tid=0 2024-09-15T22:20:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.441+0000 7fa859c3e740 1 client.25610 shutdown 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.441+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 msgr2=0x561ebdaade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.441+0000 7fa859c3e740 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdaade50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa83c012d40 tx=0x7fa83c00fb50 comp rx=0 tx=0).stop 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 shutdown_connections 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x561ebdb1fe60 0x561ebdb22280 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ebdaa4a60 0x561ebdaaee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ebda9f9d0 0x561ebdaade50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 --2- 172.21.15.150:0/470794926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ebda9f090 0x561ebdaad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 >> 172.21.15.150:0/470794926 conn(0x561ebda9a700 msgr2=0x561ebda99060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa83a000640 0 client.25610 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 shutdown_connections 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 1 -- 172.21.15.150:0/470794926 wait complete. 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.442+0000 7fa859c3e740 20 client.25610 trim_cache size 0 max 16384 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:20:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8340a32f0 msgr2=0x7fa8340a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8340a32f0 0x7fa8340a57b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa8400cda40 tx=0x7fa84000efb0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 msgr2=0x7fa850199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 0x7fa850199f40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa84000e9c0 tx=0x7fa84000ee80 comp rx=0 tx=0).stop 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 shutdown_connections 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa8340a32f0 0x7fa8340a57b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa850105910 0x7fa8501a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa850104f50 0x7fa85019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 --2- 172.21.15.150:0/2647989053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa850103d60 0x7fa850199f40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 >> 172.21.15.150:0/2647989053 conn(0x7fa8500ff4e0 msgr2=0x7fa850108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.443+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 shutdown_connections 2024-09-15T22:20:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:16.444+0000 7fa856e00640 1 -- 172.21.15.150:0/2647989053 wait complete. 2024-09-15T22:20:16.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:16 smithi150 ceph-mon[30886]: pgmap v600: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 1.07k op/s 2024-09-15T22:20:16.678 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:16 smithi154 ceph-mon[34853]: pgmap v600: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 1.07k op/s 2024-09-15T22:20:16.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:16 smithi169 ceph-mon[35850]: pgmap v600: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 1.07k op/s 2024-09-15T22:20:18.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:18 smithi150 ceph-mon[30886]: pgmap v601: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 1.69k op/s 2024-09-15T22:20:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:18 smithi169 ceph-mon[35850]: pgmap v601: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 1.69k op/s 2024-09-15T22:20:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:18 smithi154 ceph-mon[34853]: pgmap v601: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 1.69k op/s 2024-09-15T22:20:20.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:20 smithi150 ceph-mon[30886]: pgmap v602: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 2.04k op/s 2024-09-15T22:20:20.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:20 smithi169 ceph-mon[35850]: pgmap v602: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 2.04k op/s 2024-09-15T22:20:20.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:20 smithi154 ceph-mon[34853]: pgmap v602: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 2.04k op/s 2024-09-15T22:20:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:21 smithi154 ceph-mon[34853]: pgmap v603: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 2.33k op/s 2024-09-15T22:20:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:21 smithi150 ceph-mon[30886]: pgmap v603: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 2.33k op/s 2024-09-15T22:20:21.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:21 smithi169 ceph-mon[35850]: pgmap v603: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 2.33k op/s 2024-09-15T22:20:24.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:24 smithi150 ceph-mon[30886]: pgmap v604: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 2.34k op/s 2024-09-15T22:20:24.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:24 smithi169 ceph-mon[35850]: pgmap v604: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 2.34k op/s 2024-09-15T22:20:24.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:24 smithi154 ceph-mon[34853]: pgmap v604: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 2.34k op/s 2024-09-15T22:20:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:25 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:25.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:25 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:25 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:26.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:26 smithi150 ceph-mon[30886]: pgmap v605: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 2.43k op/s 2024-09-15T22:20:26.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:26 smithi169 ceph-mon[35850]: pgmap v605: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 2.43k op/s 2024-09-15T22:20:26.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:26 smithi154 ceph-mon[34853]: pgmap v605: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 2.43k op/s 2024-09-15T22:20:27.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:27 smithi150 ceph-mon[30886]: pgmap v606: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.71k op/s 2024-09-15T22:20:27.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:27 smithi169 ceph-mon[35850]: pgmap v606: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.71k op/s 2024-09-15T22:20:27.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:27 smithi154 ceph-mon[34853]: pgmap v606: 97 pgs: 97 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.71k op/s 2024-09-15T22:20:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 -- 172.21.15.150:0/1212193966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 msgr2=0x7fdaa810c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 --2- 172.21.15.150:0/1212193966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa810c1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009ca0 tx=0x7fdaa002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 -- 172.21.15.150:0/1212193966 shutdown_connections 2024-09-15T22:20:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 --2- 172.21.15.150:0/1212193966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa810c1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 --2- 172.21.15.150:0/1212193966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 0x7fdaa81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 --2- 172.21.15.150:0/1212193966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 -- 172.21.15.150:0/1212193966 >> 172.21.15.150:0/1212193966 conn(0x7fdaa80ff4e0 msgr2=0x7fdaa8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 -- 172.21.15.150:0/1212193966 shutdown_connections 2024-09-15T22:20:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.600+0000 7fdab0200640 1 -- 172.21.15.150:0/1212193966 wait complete. 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 Processor -- start 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 -- start start 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 0x7fdaa819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa81a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa810fa30 con 0x7fdaa8104f50 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa810f8b0 con 0x7fdaa8105910 2024-09-15T22:20:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.601+0000 7fdab0200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa810fbb0 con 0x7fdaa8103d60 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaad800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 0x7fdaa819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaae200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa81a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaad800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43412/0 (socket says 172.21.15.150:43412) 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaad800640 1 -- 172.21.15.150:0/900731877 learned_addr learned my addr 172.21.15.150:0/900731877 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 -- 172.21.15.150:0/900731877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 msgr2=0x7fdaa8199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 -- 172.21.15.150:0/900731877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 msgr2=0x7fdaa81a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa81a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 -- 172.21.15.150:0/900731877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa81a1bb0 con 0x7fdaa8104f50 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaad800640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaae200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa81a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.602+0000 7fdaace00640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 0x7fdaa819a4d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fda9400e9f0 tx=0x7fda9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.603+0000 7fdaa6000640 1 -- 172.21.15.150:0/900731877 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9400ccc0 con 0x7fdaa8104f50 2024-09-15T22:20:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.603+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa81a1ea0 con 0x7fdaa8104f50 2024-09-15T22:20:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.603+0000 7fdaa6000640 1 -- 172.21.15.150:0/900731877 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda94010910 con 0x7fdaa8104f50 2024-09-15T22:20:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.603+0000 7fdaa6000640 1 -- 172.21.15.150:0/900731877 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94018960 con 0x7fdaa8104f50 2024-09-15T22:20:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.603+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa81a2360 con 0x7fdaa8104f50 2024-09-15T22:20:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.606+0000 7fdab3243740 1 Processor -- start 2024-09-15T22:20:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.606+0000 7fdab3243740 1 -- start start 2024-09-15T22:20:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.606+0000 7fdab3243740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f561f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdab3243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f9d0 0x5607f5624490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdab3243740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f5624a60 0x5607f5626f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdab3243740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5607f5584100 con 0x5607f5624a60 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdab3243740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5607f552c1b0 con 0x5607f561f090 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaa6000640 1 -- 172.21.15.150:0/900731877 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fda94010ac0 con 0x7fdaa8104f50 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdab3243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5607f55800c0 con 0x5607f561f9d0 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaad800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f9d0 0x5607f5624490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaae200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f561f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaad800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f9d0 0x5607f5624490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:43420/0 (socket says 172.21.15.150:43420) 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaad800640 1 -- 172.21.15.150:0/2950635226 learned_addr learned my addr 172.21.15.150:0/2950635226 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaace00640 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f5624a60 0x5607f5626f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaae200640 1 -- 172.21.15.150:0/2950635226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f9d0 msgr2=0x5607f5624490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaae200640 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f9d0 0x5607f5624490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaae200640 1 -- 172.21.15.150:0/2950635226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f5624a60 msgr2=0x5607f5626f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaae200640 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f5624a60 0x5607f5626f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaae200640 1 -- 172.21.15.150:0/2950635226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5297210 con 0x5607f561f090 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.607+0000 7fdaace00640 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f5624a60 0x5607f5626f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fdaae200640 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f561f490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdaa002ade0 tx=0x7fdaa0005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aced65a777a6d77d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fda9aa00640 1 -- 172.21.15.150:0/2950635226 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0031650 con 0x5607f561f090 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fda9aa00640 1 -- 172.21.15.150:0/2950635226 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaa0036040 con 0x5607f561f090 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fda9aa00640 1 -- 172.21.15.150:0/2950635226 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0004710 con 0x5607f561f090 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fdaa6000640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fda900a32f0 0x7fda900a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fdaa6000640 1 -- 172.21.15.150:0/900731877 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fda940cfcf0 con 0x7fdaa8104f50 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fdaad800640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fda900a32f0 0x7fda900a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fdab3243740 1 -- 172.21.15.150:0/2950635226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 msgr2=0x5607f561f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.608+0000 7fdab3243740 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f561f490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdaa002ade0 tx=0x7fdaa0005ef0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 -- 172.21.15.150:0/2950635226 shutdown_connections 2024-09-15T22:20:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f5624a60 0x5607f5626f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f9d0 0x5607f5624490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 --2- 172.21.15.150:0/2950635226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f561f490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 -- 172.21.15.150:0/2950635226 >> 172.21.15.150:0/2950635226 conn(0x5607f561a700 msgr2=0x5607f561ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 -- 172.21.15.150:0/2950635226 shutdown_connections 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 -- 172.21.15.150:0/2950635226 wait complete. 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdaad800640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fda900a32f0 0x7fda900a57b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5607f561b580 tx=0x7fda9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.609+0000 7fdab3243740 1 -- start start 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 Processor -- start 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 0x5607f5631db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5638df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5607f5627850 con 0x5607f561f090 2024-09-15T22:20:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5607f550d090 con 0x5607f561f9d0 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5607f56279d0 con 0x5607f5624a60 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.610+0000 7fdab3243740 10 client.0 _ll_register_callbacks cb 0x5607f5561f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 0x5607f5631db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 0x5607f5631db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55450/0 (socket says 172.21.15.150:55450) 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 -- 172.21.15.150:0/1238887838 learned_addr learned my addr 172.21.15.150:0/1238887838 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 -- 172.21.15.150:0/1238887838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 msgr2=0x5607f5638df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5638df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 -- 172.21.15.150:0/1238887838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f090 msgr2=0x5607f5631870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaad800640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaace00640 1 -- 172.21.15.150:0/1238887838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f5363620 con 0x5607f561f9d0 2024-09-15T22:20:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.611+0000 7fdaad800640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdaace00640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 0x5607f5631db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda9409c2c0 tx=0x7fda9409bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae78165fe266cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fda8f400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:20:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fda8f400640 1 -- 172.21.15.150:0/1238887838 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940bc270 con 0x5607f561f9d0 2024-09-15T22:20:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaa0036040 con 0x5607f561f9d0 2024-09-15T22:20:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fda8f400640 1 -- 172.21.15.150:0/1238887838 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fda9409b780 con 0x5607f561f9d0 2024-09-15T22:20:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fda8f400640 1 -- 172.21.15.150:0/1238887838 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fda940a4ef0 con 0x5607f561f9d0 2024-09-15T22:20:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 10 client.25622 fetch_fsmap learned FSMap version 48 2024-09-15T22:20:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5607f562b670 con 0x5607f561f9d0 2024-09-15T22:20:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fda8f400640 1 -- 172.21.15.150:0/1238887838 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaa0036040 con 0x5607f561f9d0 2024-09-15T22:20:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fda8f400640 1 -- 172.21.15.150:0/1238887838 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 48) ==== 8442+0+0 (secure 0 0 0) 0x7fda940d7040 con 0x5607f561f9d0 2024-09-15T22:20:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 10 client.25622 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:20:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 10 client.25622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 20 client.25622 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.612+0000 7fdab3243740 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f562cd90 0x5607f562f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.613+0000 7fdab3243740 4 client.25622 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.613+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607f5591830 con 0x5607f562cd90 2024-09-15T22:20:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.613+0000 7fdaad800640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f562cd90 0x5607f562f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.613+0000 7fdaad800640 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f562cd90 0x5607f562f230 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b808d85e3949b0c8 server_cookie=ac8dc20beb48f9a8 in_seq=0 out_seq=0 2024-09-15T22:20:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.613+0000 7fda8f400640 10 client.25622 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.614+0000 7fda8f400640 1 -- 172.21.15.150:0/1238887838 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607f5591830 con 0x5607f562cd90 2024-09-15T22:20:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.614+0000 7fda8f400640 10 client.25622 handle_command_reply: tid=0 2024-09-15T22:20:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 client.25622 shutdown 2024-09-15T22:20:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 msgr2=0x5607f5631db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 0x5607f5631db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda9409c2c0 tx=0x7fda9409bc90 comp rx=0 tx=0).stop 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 shutdown_connections 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f562cd90 0x5607f562f230 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5638df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f9d0 0x5607f5631db0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 --2- 172.21.15.150:0/1238887838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 >> 172.21.15.150:0/1238887838 conn(0x5607f561a700 msgr2=0x5607f561bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fda8f400640 0 client.25622 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 shutdown_connections 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 1 -- 172.21.15.150:0/1238887838 wait complete. 2024-09-15T22:20:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.615+0000 7fdab3243740 20 client.25622 trim_cache size 0 max 16384 2024-09-15T22:20:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.634+0000 7fdab3243740 1 Processor -- start 2024-09-15T22:20:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 -- start start 2024-09-15T22:20:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f9d0 0x5607f5638db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5631db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a6db0 con 0x5607f561f9d0 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a8bf0 con 0x5607f561f090 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdab3243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a7540 con 0x5607f5624a60 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdaad800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdaad800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55452/0 (socket says 172.21.15.150:55452) 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdaad800640 1 -- 172.21.15.150:0/1039999460 learned_addr learned my addr 172.21.15.150:0/1039999460 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdaace00640 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f9d0 0x5607f5638db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.635+0000 7fdaae200640 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5631db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaace00640 1 -- 172.21.15.150:0/1039999460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 msgr2=0x5607f5631db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaace00640 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5631db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaace00640 1 -- 172.21.15.150:0/1039999460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 msgr2=0x5607f5631870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaace00640 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaace00640 1 -- 172.21.15.150:0/1039999460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f561a520 con 0x5607f561f9d0 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaad800640 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.636+0000 7fdaace00640 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f9d0 0x5607f5638db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fda94098790 tx=0x7fda9409c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a87baff3fed39a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.637+0000 7fda9a000640 1 -- 172.21.15.150:0/1039999460 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940a03a0 con 0x5607f561f9d0 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.637+0000 7fda9a000640 1 -- 172.21.15.150:0/1039999460 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda940bc0b0 con 0x5607f561f9d0 2024-09-15T22:20:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.637+0000 7fda9a000640 1 -- 172.21.15.150:0/1039999460 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9409b9c0 con 0x5607f561f9d0 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 -- 172.21.15.150:0/1039999460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f9d0 msgr2=0x5607f5638db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f9d0 0x5607f5638db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fda94098790 tx=0x7fda9409c430 comp rx=0 tx=0).stop 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 -- 172.21.15.150:0/1039999460 shutdown_connections 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f5624a60 0x5607f5631db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f561f9d0 0x5607f5638db0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 --2- 172.21.15.150:0/1039999460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f561f090 0x5607f5631870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 -- 172.21.15.150:0/1039999460 >> 172.21.15.150:0/1039999460 conn(0x5607f561a700 msgr2=0x5607f5620c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 -- 172.21.15.150:0/1039999460 shutdown_connections 2024-09-15T22:20:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.638+0000 7fdab3243740 1 -- 172.21.15.150:0/1039999460 wait complete. 2024-09-15T22:20:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.639+0000 7fdab3243740 1 -- start start 2024-09-15T22:20:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.640+0000 7fdab3243740 1 Processor -- start 2024-09-15T22:20:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.642+0000 7fdab3243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f090 0x5607f5634350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.642+0000 7fdab3243740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f5624a60 0x5607f5634890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.642+0000 7fdab3243740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f56378b0 0x5607f5637d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.642+0000 7fdab3243740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a8460 con 0x5607f56378b0 2024-09-15T22:20:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.642+0000 7fdab3243740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a7cd0 con 0x5607f5624a60 2024-09-15T22:20:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.642+0000 7fdab3243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a4d90 con 0x5607f561f090 2024-09-15T22:20:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdab3243740 10 client.0 _ll_register_callbacks cb 0x7fda9400ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaace00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f5624a60 0x5607f5634890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaace00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f5624a60 0x5607f5634890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:55466/0 (socket says 172.21.15.150:55466) 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaace00640 1 -- 172.21.15.150:0/1121692214 learned_addr learned my addr 172.21.15.150:0/1121692214 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaad800640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f090 0x5607f5634350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaae200640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f56378b0 0x5607f5637d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaad800640 1 -- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f5624a60 msgr2=0x5607f5634890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaad800640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f5624a60 0x5607f5634890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaad800640 1 -- 172.21.15.150:0/1121692214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f56378b0 msgr2=0x5607f5637d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaad800640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f56378b0 0x5607f5637d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.643+0000 7fdaad800640 1 -- 172.21.15.150:0/1121692214 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f56382a0 con 0x5607f561f090 2024-09-15T22:20:29.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.644+0000 7fdaad800640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f090 0x5607f5634350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000c00 tx=0x7fda9c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f45d63886d0e246 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:29.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.644+0000 7fda8f400640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.645+0000 7fda8f400640 1 -- 172.21.15.150:0/1121692214 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c012210 con 0x5607f561f090 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.645+0000 7fda8f400640 1 -- 172.21.15.150:0/1121692214 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fda9c011810 con 0x5607f561f090 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.645+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda940bc0b0 con 0x5607f561f090 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.645+0000 7fda8f400640 1 -- 172.21.15.150:0/1121692214 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fda9c011a10 con 0x5607f561f090 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.645+0000 7fdab3243740 10 client.25627 fetch_fsmap learned FSMap version 48 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.645+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5607f56b06c0 con 0x5607f561f090 2024-09-15T22:20:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fda8f400640 1 -- 172.21.15.150:0/1121692214 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda940bc0b0 con 0x5607f561f090 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fda8f400640 1 -- 172.21.15.150:0/1121692214 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 48) ==== 8442+0+0 (secure 0 0 0) 0x7fda9c03c070 con 0x5607f561f090 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdab3243740 10 client.25627 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdab3243740 10 client.25627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdab3243740 20 client.25627 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdab3243740 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f56b1160 0x5607f56b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdab3243740 4 client.25627 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5607f558bb80 con 0x5607f56b1160 2024-09-15T22:20:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.646+0000 7fdaace00640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f56b1160 0x5607f56b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:29.650 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.647+0000 7fdaace00640 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f56b1160 0x5607f56b3580 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a980ff4c01fbb39 server_cookie=be5e2cc5b82513b2 in_seq=0 out_seq=0 2024-09-15T22:20:29.650 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:29.647+0000 7fda8f400640 10 client.25627 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fda8f400640 1 -- 172.21.15.150:0/1121692214 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5607f558bb80 con 0x5607f56b1160 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fda8f400640 10 client.25627 handle_command_reply: tid=0 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 client.25627 shutdown 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f090 msgr2=0x5607f5634350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f090 0x5607f5634350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000c00 tx=0x7fda9c004730 comp rx=0 tx=0).stop 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 shutdown_connections 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5607f56b1160 0x5607f56b3580 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f56378b0 0x5607f5637d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5607f5624a60 0x5607f5634890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 --2- 172.21.15.150:0/1121692214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607f561f090 0x5607f5634350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 >> 172.21.15.150:0/1121692214 conn(0x5607f561a700 msgr2=0x5607f5631830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.408+0000 7fda8f400640 0 client.25627 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.409+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 shutdown_connections 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.409+0000 7fdab3243740 1 -- 172.21.15.150:0/1121692214 wait complete. 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.409+0000 7fdab3243740 20 client.25627 trim_cache size 0 max 16384 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:20:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fda900a32f0 msgr2=0x7fda900a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fda900a32f0 0x7fda900a57b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5607f561b580 tx=0x7fda9c005f90 comp rx=0 tx=0).stop 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 msgr2=0x7fdaa819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 0x7fdaa819a4d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fda9400e9f0 tx=0x7fda9400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 shutdown_connections 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa8105910 0x7fdaa81a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fda900a32f0 0x7fda900a57b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdaa8104f50 0x7fdaa819a4d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 --2- 172.21.15.150:0/900731877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdaa8103d60 0x7fdaa8199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 >> 172.21.15.150:0/900731877 conn(0x7fdaa80ff4e0 msgr2=0x7fdaa81081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 shutdown_connections 2024-09-15T22:20:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:30.410+0000 7fdab0200640 1 -- 172.21.15.150:0/900731877 wait complete. 2024-09-15T22:20:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:30 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:30.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:30 smithi169 ceph-mon[35850]: pgmap v607: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 998 op/s 2024-09-15T22:20:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:30 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:30.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:30 smithi154 ceph-mon[34853]: pgmap v607: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 998 op/s 2024-09-15T22:20:30.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:30 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:20:30.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:30 smithi150 ceph-mon[30886]: pgmap v607: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 998 op/s 2024-09-15T22:20:32.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:32 smithi150 ceph-mon[30886]: pgmap v608: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 638 op/s 2024-09-15T22:20:32.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:32 smithi169 ceph-mon[35850]: pgmap v608: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 638 op/s 2024-09-15T22:20:32.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:32 smithi154 ceph-mon[34853]: pgmap v608: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 638 op/s 2024-09-15T22:20:34.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:34 smithi150 ceph-mon[30886]: pgmap v609: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 338 op/s 2024-09-15T22:20:34.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:34 smithi169 ceph-mon[35850]: pgmap v609: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 338 op/s 2024-09-15T22:20:34.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:34 smithi154 ceph-mon[34853]: pgmap v609: 97 pgs: 97 active+clean; 2.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 338 op/s 2024-09-15T22:20:36.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:36 smithi150 ceph-mon[30886]: pgmap v610: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 378 op/s 2024-09-15T22:20:36.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:36 smithi169 ceph-mon[35850]: pgmap v610: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 378 op/s 2024-09-15T22:20:36.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:36 smithi154 ceph-mon[34853]: pgmap v610: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 378 op/s 2024-09-15T22:20:37.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:37 smithi150 ceph-mon[30886]: pgmap v611: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 353 op/s 2024-09-15T22:20:37.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:37 smithi154 ceph-mon[34853]: pgmap v611: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 353 op/s 2024-09-15T22:20:37.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:37 smithi169 ceph-mon[35850]: pgmap v611: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 353 op/s 2024-09-15T22:20:40.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:40 smithi150 ceph-mon[30886]: pgmap v612: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 354 op/s 2024-09-15T22:20:40.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:40 smithi169 ceph-mon[35850]: pgmap v612: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 354 op/s 2024-09-15T22:20:40.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:40 smithi154 ceph-mon[34853]: pgmap v612: 97 pgs: 97 active+clean; 2.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 354 op/s 2024-09-15T22:20:42.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:42 smithi150 ceph-mon[30886]: pgmap v613: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 383 op/s 2024-09-15T22:20:42.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:42 smithi169 ceph-mon[35850]: pgmap v613: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 383 op/s 2024-09-15T22:20:42.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:42 smithi154 ceph-mon[34853]: pgmap v613: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 383 op/s 2024-09-15T22:20:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 -- 172.21.15.150:0/1993817079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c105340 msgr2=0x7fc01c110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 --2- 172.21.15.150:0/1993817079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c105340 0x7fc01c110490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc014009be0 tx=0x7fc01402a6b0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 -- 172.21.15.150:0/1993817079 shutdown_connections 2024-09-15T22:20:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 --2- 172.21.15.150:0/1993817079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c105340 0x7fc01c110490 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 --2- 172.21.15.150:0/1993817079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 --2- 172.21.15.150:0/1993817079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c074680 0x7fc01c074a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 -- 172.21.15.150:0/1993817079 >> 172.21.15.150:0/1993817079 conn(0x7fc01c0fd0d0 msgr2=0x7fc01c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 -- 172.21.15.150:0/1993817079 shutdown_connections 2024-09-15T22:20:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.535+0000 7fc01be00640 1 -- 172.21.15.150:0/1993817079 wait complete. 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 Processor -- start 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 -- start start 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c074680 0x7fc01c19e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c1a3910 0x7fc01c1a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c113d40 con 0x7fc01c074fc0 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c113bc0 con 0x7fc01c074680 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.536+0000 7fc01be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c113ec0 con 0x7fc01c1a3910 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c074680 0x7fc01c19e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c1a3910 0x7fc01c1a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c19e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56526/0 (socket says 172.21.15.150:56526) 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01a000640 1 -- 172.21.15.150:0/39720472 learned_addr learned my addr 172.21.15.150:0/39720472 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 -- 172.21.15.150:0/39720472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c074680 msgr2=0x7fc01c19e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c074680 0x7fc01c19e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 -- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 msgr2=0x7fc01c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 -- 172.21.15.150:0/39720472 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c1a6370 con 0x7fc01c1a3910 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01a000640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc01b400640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c1a3910 0x7fc01c1a5d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc014034040 tx=0x7fc0140305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.537+0000 7fc013400640 1 -- 172.21.15.150:0/39720472 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014041020 con 0x7fc01c1a3910 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.538+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01c1a6600 con 0x7fc01c1a3910 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.538+0000 7fc013400640 1 -- 172.21.15.150:0/39720472 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc014030740 con 0x7fc01c1a3910 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.538+0000 7fc013400640 1 -- 172.21.15.150:0/39720472 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014036040 con 0x7fc01c1a3910 2024-09-15T22:20:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.538+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01c1a6b10 con 0x7fc01c1a3910 2024-09-15T22:20:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.541+0000 7fc0244c8740 1 Processor -- start 2024-09-15T22:20:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.542+0000 7fc013400640 1 -- 172.21.15.150:0/39720472 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fc014044020 con 0x7fc01c1a3910 2024-09-15T22:20:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.542+0000 7fc0244c8740 1 -- start start 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.542+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b38c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.542+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b391660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.542+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc0244c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55cb5b2f1100 con 0x55cb5b391c30 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc0244c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cb5b2991b0 con 0x55cb5b38cba0 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc0244c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cb5b2ed0c0 con 0x55cb5b38c260 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b38c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b391660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b391660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49318/0 (socket says 172.21.15.150:49318) 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 -- 172.21.15.150:0/2040314901 learned_addr learned my addr 172.21.15.150:0/2040314901 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b38c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41864/0 (socket says 172.21.15.150:41864) 2024-09-15T22:20:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01a000640 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 -- 172.21.15.150:0/2040314901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 msgr2=0x55cb5b38c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b38c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 -- 172.21.15.150:0/2040314901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 msgr2=0x55cb5b3940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.543+0000 7fc01aa00640 1 -- 172.21.15.150:0/2040314901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5b004210 con 0x55cb5b38cba0 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.544+0000 7fc01aa00640 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b391660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009cc0 tx=0x7fc00c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea77da5b1b7bc16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.544+0000 7fc007400640 1 -- 172.21.15.150:0/2040314901 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c005220 con 0x55cb5b38cba0 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.544+0000 7fc007400640 1 -- 172.21.15.150:0/2040314901 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c004c80 con 0x55cb5b38cba0 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.544+0000 7fc007400640 1 -- 172.21.15.150:0/2040314901 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c019970 con 0x55cb5b38cba0 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.544+0000 7fc013400640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0000a32c0 0x7fc0000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.544+0000 7fc013400640 1 -- 172.21.15.150:0/39720472 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc0140f0610 con 0x7fc01c1a3910 2024-09-15T22:20:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc01a000640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0000a32c0 0x7fc0000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 -- 172.21.15.150:0/2040314901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 msgr2=0x55cb5b391660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b391660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009cc0 tx=0x7fc00c011810 comp rx=0 tx=0).stop 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 -- 172.21.15.150:0/2040314901 shutdown_connections 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b391660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2040314901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b38c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 -- 172.21.15.150:0/2040314901 >> 172.21.15.150:0/2040314901 conn(0x55cb5b3878d0 msgr2=0x55cb5b387cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 -- 172.21.15.150:0/2040314901 shutdown_connections 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.545+0000 7fc0244c8740 1 -- 172.21.15.150:0/2040314901 wait complete. 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.546+0000 7fc01a000640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0000a32c0 0x7fc0000a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc008009620 tx=0x7fc008013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.546+0000 7fc0244c8740 1 -- start start 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.546+0000 7fc0244c8740 1 Processor -- start 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b396410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38cba0 0x55cb5b396950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b39d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55cb5b394c00 con 0x55cb5b391c30 2024-09-15T22:20:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cb5b27a090 con 0x55cb5b38c260 2024-09-15T22:20:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cb5b394d80 con 0x55cb5b38cba0 2024-09-15T22:20:43.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc0244c8740 10 client.0 _ll_register_callbacks cb 0x55cb5b2cef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc01a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38cba0 0x55cb5b396950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc01a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38cba0 0x55cb5b396950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41874/0 (socket says 172.21.15.150:41874) 2024-09-15T22:20:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc01a000640 1 -- 172.21.15.150:0/1322421274 learned_addr learned my addr 172.21.15.150:0/1322421274 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b396410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.547+0000 7fc01b400640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b39d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01aa00640 1 -- 172.21.15.150:0/1322421274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38cba0 msgr2=0x55cb5b396950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01aa00640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38cba0 0x55cb5b396950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01aa00640 1 -- 172.21.15.150:0/1322421274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 msgr2=0x55cb5b39d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01aa00640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b39d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01aa00640 1 -- 172.21.15.150:0/1322421274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb5b0d0620 con 0x55cb5b38c260 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01b400640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b39d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc01aa00640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b396410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc00c01b040 tx=0x7fc00c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0001d612f1486e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fbffbe00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fbffbe00640 1 -- 172.21.15.150:0/1322421274 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c029070 con 0x55cb5b38c260 2024-09-15T22:20:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fbffbe00640 1 -- 172.21.15.150:0/1322421274 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc00c004220 con 0x55cb5b38c260 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.548+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc00c004c80 con 0x55cb5b38c260 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fbffbe00640 1 -- 172.21.15.150:0/1322421274 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc00c034050 con 0x55cb5b38c260 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 10 client.25640 fetch_fsmap learned FSMap version 48 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55cb5b3a0780 con 0x55cb5b38c260 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fbffbe00640 1 -- 172.21.15.150:0/1322421274 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c004c80 con 0x55cb5b38c260 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fbffbe00640 1 -- 172.21.15.150:0/1322421274 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 48) ==== 8442+0+0 (secure 0 0 0) 0x7fc00c019c70 con 0x55cb5b38c260 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 10 client.25640 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 10 client.25640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 20 client.25640 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b3a1ca0 0x55cb5b3a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 4 client.25640 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.549+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb5b2fe830 con 0x55cb5b3a1ca0 2024-09-15T22:20:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.550+0000 7fc01a000640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b3a1ca0 0x55cb5b3a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.550+0000 7fbffbe00640 10 client.25640 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.550+0000 7fc01a000640 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b3a1ca0 0x55cb5b3a4100 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c6fbb78853c91ce server_cookie=dded1d527c8f257a in_seq=0 out_seq=0 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fbffbe00640 1 -- 172.21.15.150:0/1322421274 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb5b2fe830 con 0x55cb5b3a1ca0 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fbffbe00640 10 client.25640 handle_command_reply: tid=0 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 client.25640 shutdown 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 msgr2=0x55cb5b396410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b396410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc00c01b040 tx=0x7fc00c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 shutdown_connections 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b3a1ca0 0x55cb5b3a4100 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b39d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38cba0 0x55cb5b396950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 --2- 172.21.15.150:0/1322421274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b396410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fbffbe00640 0 client.25640 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 >> 172.21.15.150:0/1322421274 conn(0x55cb5b3878d0 msgr2=0x55cb5b3890e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 shutdown_connections 2024-09-15T22:20:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.551+0000 7fc0244c8740 1 -- 172.21.15.150:0/1322421274 wait complete. 2024-09-15T22:20:43.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.552+0000 7fc0244c8740 20 client.25640 trim_cache size 0 max 16384 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 Processor -- start 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 -- start start 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b387cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b39d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1af490 con 0x55cb5b391c30 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b12d0 con 0x55cb5b38cba0 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc0244c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1afc20 con 0x55cb5b38c260 2024-09-15T22:20:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b387cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b387cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:41878/0 (socket says 172.21.15.150:41878) 2024-09-15T22:20:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc01a000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b39d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc01aa00640 1 -- 172.21.15.150:0/2710732316 learned_addr learned my addr 172.21.15.150:0/2710732316 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.568+0000 7fc01b400640 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01aa00640 1 -- 172.21.15.150:0/2710732316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 msgr2=0x55cb5b39d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01aa00640 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b39d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01aa00640 1 -- 172.21.15.150:0/2710732316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 msgr2=0x55cb5b3881f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01aa00640 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3881f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01aa00640 1 -- 172.21.15.150:0/2710732316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5b3a4780 con 0x55cb5b38c260 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01b400640 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01a000640 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b39d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc01aa00640 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b387cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009430 tx=0x7fc00c0053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0efda02620e098 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc006a00640 1 -- 172.21.15.150:0/2710732316 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c031030 con 0x55cb5b38c260 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc006a00640 1 -- 172.21.15.150:0/2710732316 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c009e70 con 0x55cb5b38c260 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.569+0000 7fc006a00640 1 -- 172.21.15.150:0/2710732316 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c029070 con 0x55cb5b38c260 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 -- 172.21.15.150:0/2710732316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 msgr2=0x55cb5b387cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b387cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009430 tx=0x7fc00c0053f0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 -- 172.21.15.150:0/2710732316 shutdown_connections 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b391c30 0x55cb5b3881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38cba0 0x55cb5b39d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 --2- 172.21.15.150:0/2710732316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b38c260 0x55cb5b387cb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 -- 172.21.15.150:0/2710732316 >> 172.21.15.150:0/2710732316 conn(0x55cb5b3878d0 msgr2=0x55cb5b3961c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 -- 172.21.15.150:0/2710732316 shutdown_connections 2024-09-15T22:20:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 -- 172.21.15.150:0/2710732316 wait complete. 2024-09-15T22:20:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.570+0000 7fc0244c8740 1 -- start start 2024-09-15T22:20:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 Processor -- start 2024-09-15T22:20:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b39ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b38cba0 0x55cb5b39b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b391c30 0x55cb5b39c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b0b40 con 0x55cb5b38cba0 2024-09-15T22:20:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b03b0 con 0x55cb5b38c260 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1ad470 con 0x55cb5b391c30 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc0244c8740 10 client.0 _ll_register_callbacks cb 0x7fc008009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b39ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b39ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49338/0 (socket says 172.21.15.150:49338) 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc01aa00640 1 -- 172.21.15.150:0/4184167366 learned_addr learned my addr 172.21.15.150:0/4184167366 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc01b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b391c30 0x55cb5b39c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.571+0000 7fc01a000640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b38cba0 0x55cb5b39b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01aa00640 1 -- 172.21.15.150:0/4184167366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b391c30 msgr2=0x55cb5b39c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01aa00640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b391c30 0x55cb5b39c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01aa00640 1 -- 172.21.15.150:0/4184167366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b38cba0 msgr2=0x55cb5b39b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01aa00640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b38cba0 0x55cb5b39b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01aa00640 1 -- 172.21.15.150:0/4184167366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb5b39c730 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01b400640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b391c30 0x55cb5b39c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc01aa00640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b39ac20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009400 tx=0x7fc00c005130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f791c5bd2871198 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fbffbe00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fbffbe00640 1 -- 172.21.15.150:0/4184167366 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c029070 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fbffbe00640 1 -- 172.21.15.150:0/4184167366 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc00c003e20 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc00c009e70 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fbffbe00640 1 -- 172.21.15.150:0/4184167366 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc00c031040 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc0244c8740 10 client.25646 fetch_fsmap learned FSMap version 48 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.572+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55cb5b39da40 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fbffbe00640 1 -- 172.21.15.150:0/4184167366 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c009e70 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fbffbe00640 1 -- 172.21.15.150:0/4184167366 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 48) ==== 8442+0+0 (secure 0 0 0) 0x7fc00c019a50 con 0x55cb5b38c260 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc0244c8740 10 client.25646 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc0244c8740 10 client.25646 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:43.578 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc0244c8740 20 client.25646 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc0244c8740 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b40ce70 0x55cb5b40f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc0244c8740 4 client.25646 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:20:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb5b2f8b80 con 0x55cb5b40ce70 2024-09-15T22:20:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.573+0000 7fc01a000640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b40ce70 0x55cb5b40f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.574+0000 7fc01a000640 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b40ce70 0x55cb5b40f290 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad04346b2a0d29f server_cookie=1ef173dc8015b4a1 in_seq=0 out_seq=0 2024-09-15T22:20:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.574+0000 7fbffbe00640 10 client.25646 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:43 smithi154 ceph-mon[34853]: pgmap v614: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-09-15T22:20:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.794+0000 7fbffbe00640 1 -- 172.21.15.150:0/4184167366 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb5b2f8b80 con 0x55cb5b40ce70 2024-09-15T22:20:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.794+0000 7fbffbe00640 10 client.25646 handle_command_reply: tid=0 2024-09-15T22:20:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.794+0000 7fc0244c8740 1 client.25646 shutdown 2024-09-15T22:20:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 msgr2=0x55cb5b39ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b39ac20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009400 tx=0x7fc00c005130 comp rx=0 tx=0).stop 2024-09-15T22:20:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 shutdown_connections 2024-09-15T22:20:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55cb5b40ce70 0x55cb5b40f290 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb5b391c30 0x55cb5b39c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cb5b38cba0 0x55cb5b39b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 --2- 172.21.15.150:0/4184167366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cb5b38c260 0x55cb5b39ac20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 >> 172.21.15.150:0/4184167366 conn(0x55cb5b3878d0 msgr2=0x55cb5b3861f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.795+0000 7fbffbe00640 0 client.25646 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.796+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 shutdown_connections 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.796+0000 7fc0244c8740 1 -- 172.21.15.150:0/4184167366 wait complete. 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.796+0000 7fc0244c8740 20 client.25646 trim_cache size 0 max 16384 2024-09-15T22:20:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0000a32c0 msgr2=0x7fc0000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0000a32c0 0x7fc0000a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc008009620 tx=0x7fc008013040 comp rx=0 tx=0).stop 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c1a3910 msgr2=0x7fc01c1a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c1a3910 0x7fc01c1a5d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc014034040 tx=0x7fc0140305d0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 shutdown_connections 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc01c1a3910 0x7fc01c1a5d00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0000a32c0 0x7fc0000a5780 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc01c074fc0 0x7fc01c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 --2- 172.21.15.150:0/39720472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc01c074680 0x7fc01c19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 >> 172.21.15.150:0/39720472 conn(0x7fc01c0fd0d0 msgr2=0x7fc01c110010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.797+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 shutdown_connections 2024-09-15T22:20:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:43.798+0000 7fc01be00640 1 -- 172.21.15.150:0/39720472 wait complete. 2024-09-15T22:20:43.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:43 smithi150 ceph-mon[30886]: pgmap v614: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-09-15T22:20:43.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:43 smithi169 ceph-mon[35850]: pgmap v614: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2024-09-15T22:20:46.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:46 smithi150 ceph-mon[30886]: pgmap v615: 97 pgs: 97 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 451 op/s 2024-09-15T22:20:46.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:46 smithi169 ceph-mon[35850]: pgmap v615: 97 pgs: 97 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 451 op/s 2024-09-15T22:20:46.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:46 smithi154 ceph-mon[34853]: pgmap v615: 97 pgs: 97 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 451 op/s 2024-09-15T22:20:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:48 smithi150 ceph-mon[30886]: pgmap v616: 97 pgs: 97 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 447 op/s 2024-09-15T22:20:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:48 smithi169 ceph-mon[35850]: pgmap v616: 97 pgs: 97 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 447 op/s 2024-09-15T22:20:48.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:48 smithi154 ceph-mon[34853]: pgmap v616: 97 pgs: 97 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 447 op/s 2024-09-15T22:20:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:50 smithi150 ceph-mon[30886]: pgmap v617: 97 pgs: 97 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 441 op/s 2024-09-15T22:20:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:50 smithi169 ceph-mon[35850]: pgmap v617: 97 pgs: 97 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 441 op/s 2024-09-15T22:20:50.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:50 smithi154 ceph-mon[34853]: pgmap v617: 97 pgs: 97 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 441 op/s 2024-09-15T22:20:51.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:51 smithi154 ceph-mon[34853]: pgmap v618: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 429 op/s 2024-09-15T22:20:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:51 smithi150 ceph-mon[30886]: pgmap v618: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 429 op/s 2024-09-15T22:20:51.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:51 smithi169 ceph-mon[35850]: pgmap v618: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 429 op/s 2024-09-15T22:20:54.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:54 smithi150 ceph-mon[30886]: pgmap v619: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 411 op/s 2024-09-15T22:20:54.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:54 smithi169 ceph-mon[35850]: pgmap v619: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 411 op/s 2024-09-15T22:20:54.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:54 smithi154 ceph-mon[34853]: pgmap v619: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 411 op/s 2024-09-15T22:20:56.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:56 smithi150 ceph-mon[30886]: pgmap v620: 97 pgs: 97 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 479 op/s 2024-09-15T22:20:56.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:56 smithi169 ceph-mon[35850]: pgmap v620: 97 pgs: 97 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 479 op/s 2024-09-15T22:20:56.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:56 smithi154 ceph-mon[34853]: pgmap v620: 97 pgs: 97 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 479 op/s 2024-09-15T22:20:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 -- 172.21.15.150:0/1056963544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37581023c0 msgr2=0x7f37581047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 --2- 172.21.15.150:0/1056963544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37581023c0 0x7f37581047b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3748009900 tx=0x7f374802a400 comp rx=0 tx=0).stop 2024-09-15T22:20:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 -- 172.21.15.150:0/1056963544 shutdown_connections 2024-09-15T22:20:56.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 --2- 172.21.15.150:0/1056963544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758107620 0x7f3758109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 --2- 172.21.15.150:0/1056963544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3758104cf0 0x7f37581070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 --2- 172.21.15.150:0/1056963544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37581023c0 0x7f37581047b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 -- 172.21.15.150:0/1056963544 >> 172.21.15.150:0/1056963544 conn(0x7f37580fbfa0 msgr2=0x7f37580fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:56.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 -- 172.21.15.150:0/1056963544 shutdown_connections 2024-09-15T22:20:56.927 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.924+0000 7f375d600640 1 -- 172.21.15.150:0/1056963544 wait complete. 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.925+0000 7f375d600640 1 Processor -- start 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.925+0000 7f375d600640 1 -- start start 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375d600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 0x7f3758197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375d600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758104cf0 0x7f3758198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375d600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3758107620 0x7f375819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375d600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f375810d670 con 0x7f3758104cf0 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375d600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f375810d4f0 con 0x7f3758107620 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375d600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f375810d7f0 con 0x7f37581023c0 2024-09-15T22:20:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 0x7f3758197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 0x7f3758197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:45060/0 (socket says 172.21.15.150:45060) 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f374fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758104cf0 0x7f3758198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 -- 172.21.15.150:0/3557244308 learned_addr learned my addr 172.21.15.150:0/3557244308 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375cc00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3758107620 0x7f375819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 -- 172.21.15.150:0/3557244308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3758107620 msgr2=0x7f375819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3758107620 0x7f375819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 -- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758104cf0 msgr2=0x7f3758198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758104cf0 0x7f3758198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f3757e00640 1 -- 172.21.15.150:0/3557244308 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375819f970 con 0x7f37581023c0 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f375cc00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3758107620 0x7f375819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.926+0000 7f374fe00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758104cf0 0x7f3758198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.927+0000 7f3757e00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 0x7f3758197d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3748031440 tx=0x7f3748032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.927+0000 7f3755600640 1 -- 172.21.15.150:0/3557244308 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374803f030 con 0x7f37581023c0 2024-09-15T22:20:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.927+0000 7f3755600640 1 -- 172.21.15.150:0/3557244308 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3748003ce0 con 0x7f37581023c0 2024-09-15T22:20:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.927+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375819fc00 con 0x7f37581023c0 2024-09-15T22:20:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.927+0000 7f3755600640 1 -- 172.21.15.150:0/3557244308 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748035070 con 0x7f37581023c0 2024-09-15T22:20:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.927+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37581a00f0 con 0x7f37581023c0 2024-09-15T22:20:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 Processor -- start 2024-09-15T22:20:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 -- start start 2024-09-15T22:20:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c332a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332fb0 0x556d0c337a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c33a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x556d0c293100 con 0x556d0c338040 2024-09-15T22:20:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556d0c23b1b0 con 0x556d0c332670 2024-09-15T22:20:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3761a8c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d0c28f0c0 con 0x556d0c332fb0 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f3755600640 1 -- 172.21.15.150:0/3557244308 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f3748042030 con 0x7f37581023c0 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.930+0000 7f375cc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c332a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f374fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c33a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c332a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:34952/0 (socket says 172.21.15.150:34952) 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 -- 172.21.15.150:0/1111242132 learned_addr learned my addr 172.21.15.150:0/1111242132 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f3757e00640 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332fb0 0x556d0c337a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 -- 172.21.15.150:0/1111242132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332fb0 msgr2=0x556d0c337a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332fb0 0x556d0c337a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 -- 172.21.15.150:0/1111242132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 msgr2=0x556d0c33a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c33a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 -- 172.21.15.150:0/1111242132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d0bfa6210 con 0x556d0c332670 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f375cc00640 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c332a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3750010480 tx=0x7f3750010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0179e849cf4f554 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f374d200640 1 -- 172.21.15.150:0/1111242132 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750017070 con 0x556d0c332670 2024-09-15T22:20:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f374d200640 1 -- 172.21.15.150:0/1111242132 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3750011c40 con 0x556d0c332670 2024-09-15T22:20:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.931+0000 7f374d200640 1 -- 172.21.15.150:0/1111242132 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375001bd40 con 0x556d0c332670 2024-09-15T22:20:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3755600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f373c0a3240 0x7f373c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3755600640 1 -- 172.21.15.150:0/3557244308 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f37480efec0 con 0x7f37581023c0 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 -- 172.21.15.150:0/1111242132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 msgr2=0x556d0c332a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c332a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3750010480 tx=0x7f3750010940 comp rx=0 tx=0).stop 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3757e00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f373c0a3240 0x7f373c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 -- 172.21.15.150:0/1111242132 shutdown_connections 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c33a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332fb0 0x556d0c337a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1111242132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c332a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 -- 172.21.15.150:0/1111242132 >> 172.21.15.150:0/1111242132 conn(0x556d0c3298d0 msgr2=0x556d0c329cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 -- 172.21.15.150:0/1111242132 shutdown_connections 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.932+0000 7f3761a8c740 1 -- 172.21.15.150:0/1111242132 wait complete. 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3757e00640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f373c0a3240 0x7f373c0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f37480edd00 tx=0x7f3748009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 -- start start 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 Processor -- start 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c33c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 0x556d0c33cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c343d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x556d0c33afb0 con 0x556d0c332fb0 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556d0c21c090 con 0x556d0c332670 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d0c33b130 con 0x556d0c338040 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.933+0000 7f3761a8c740 10 client.0 _ll_register_callbacks cb 0x556d0c270f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 0x556d0c33cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 0x556d0c33cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48290/0 (socket says 172.21.15.150:48290) 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 -- 172.21.15.150:0/2357535266 learned_addr learned my addr 172.21.15.150:0/2357535266 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f375cc00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c343d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f375cc00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c33c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 -- 172.21.15.150:0/2357535266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 msgr2=0x556d0c343d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c343d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 -- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 msgr2=0x556d0c33c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c33c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 -- 172.21.15.150:0/2357535266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0c072620 con 0x556d0c332fb0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f374fe00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 0x556d0c33cd20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3740012d20 tx=0x7f374000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f97c5b46c337aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.934+0000 7f3745600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3745600640 1 -- 172.21.15.150:0/2357535266 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740012110 con 0x556d0c332fb0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3745600640 1 -- 172.21.15.150:0/2357535266 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3740004050 con 0x556d0c332fb0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3750011c40 con 0x556d0c332fb0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3745600640 1 -- 172.21.15.150:0/2357535266 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f37400122b0 con 0x556d0c332fb0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3761a8c740 10 client.15651 fetch_fsmap learned FSMap version 48 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556d0c346c20 con 0x556d0c332fb0 2024-09-15T22:20:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3745600640 1 -- 172.21.15.150:0/2357535266 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3750011c40 con 0x556d0c332fb0 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.935+0000 7f3745600640 1 -- 172.21.15.150:0/2357535266 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 48) ==== 8442+0+0 (secure 0 0 0) 0x7f3740025070 con 0x556d0c332fb0 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3761a8c740 10 client.15651 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3761a8c740 10 client.15651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3761a8c740 20 client.15651 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3761a8c740 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c348360 0x556d0c34a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3761a8c740 4 client.15651 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d0c2a0830 con 0x556d0c348360 2024-09-15T22:20:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f375cc00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c348360 0x556d0c34a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f375cc00640 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c348360 0x556d0c34a7a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f9a098cb5a35aa server_cookie=3ee03035e57a5567 in_seq=0 out_seq=0 2024-09-15T22:20:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.936+0000 7f3745600640 10 client.15651 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.937+0000 7f3745600640 1 -- 172.21.15.150:0/2357535266 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d0c2a0830 con 0x556d0c348360 2024-09-15T22:20:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.937+0000 7f3745600640 10 client.15651 handle_command_reply: tid=0 2024-09-15T22:20:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.937+0000 7f3761a8c740 1 client.15651 shutdown 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.937+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 msgr2=0x556d0c33cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.937+0000 7f3761a8c740 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 0x556d0c33cd20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3740012d20 tx=0x7f374000f790 comp rx=0 tx=0).stop 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 shutdown_connections 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c348360 0x556d0c34a7a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c343d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332fb0 0x556d0c33cd20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 --2- 172.21.15.150:0/2357535266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332670 0x556d0c33c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 >> 172.21.15.150:0/2357535266 conn(0x556d0c3298d0 msgr2=0x556d0c32b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3745600640 0 client.15651 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 shutdown_connections 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 1 -- 172.21.15.150:0/2357535266 wait complete. 2024-09-15T22:20:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.938+0000 7f3761a8c740 20 client.15651 trim_cache size 0 max 16384 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 Processor -- start 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 -- start start 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332670 0x556d0c32acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c343d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c32b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37581a6d50 con 0x556d0c332670 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37581a8b90 con 0x556d0c332fb0 2024-09-15T22:20:56.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.954+0000 7f3761a8c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37581a74e0 con 0x556d0c338040 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f375cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332670 0x556d0c32acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c343d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f375cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332670 0x556d0c32acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48292/0 (socket says 172.21.15.150:48292) 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f375cc00640 1 -- 172.21.15.150:0/1971397572 learned_addr learned my addr 172.21.15.150:0/1971397572 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c343d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:34968/0 (socket says 172.21.15.150:34968) 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f375cc00640 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c32b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 -- 172.21.15.150:0/1971397572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 msgr2=0x556d0c32b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c32b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 -- 172.21.15.150:0/1971397572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332670 msgr2=0x556d0c32acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332670 0x556d0c32acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 -- 172.21.15.150:0/1971397572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d0c3296f0 con 0x556d0c332fb0 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f374fe00640 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c343d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37400106f0 tx=0x7f3740009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5286fbe16dea8eef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.955+0000 7f3747e00640 1 -- 172.21.15.150:0/1971397572 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374002b070 con 0x556d0c332fb0 2024-09-15T22:20:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3747e00640 1 -- 172.21.15.150:0/1971397572 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3740022070 con 0x556d0c332fb0 2024-09-15T22:20:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3747e00640 1 -- 172.21.15.150:0/1971397572 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740003850 con 0x556d0c332fb0 2024-09-15T22:20:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 -- 172.21.15.150:0/1971397572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 msgr2=0x556d0c343d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c343d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37400106f0 tx=0x7f3740009be0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 -- 172.21.15.150:0/1971397572 shutdown_connections 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c338040 0x556d0c32b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c343d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1971397572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c332670 0x556d0c32acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 -- 172.21.15.150:0/1971397572 >> 172.21.15.150:0/1971397572 conn(0x556d0c3298d0 msgr2=0x556d0c328a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 -- 172.21.15.150:0/1971397572 shutdown_connections 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.956+0000 7f3761a8c740 1 -- 172.21.15.150:0/1971397572 wait complete. 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 -- start start 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 Processor -- start 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332670 0x556d0c3414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c341a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c342a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37581a8400 con 0x556d0c338040 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37581a7c70 con 0x556d0c332fb0 2024-09-15T22:20:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37581a4d30 con 0x556d0c332670 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.957+0000 7f3761a8c740 10 client.0 _ll_register_callbacks cb 0x7f3740009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c341a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c341a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:34978/0 (socket says 172.21.15.150:34978) 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 -- 172.21.15.150:0/1454267888 learned_addr learned my addr 172.21.15.150:0/1454267888 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f375cc00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332670 0x556d0c3414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f375cc00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c342a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 -- 172.21.15.150:0/1454267888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332670 msgr2=0x556d0c3414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332670 0x556d0c3414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 -- 172.21.15.150:0/1454267888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 msgr2=0x556d0c342a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c342a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 -- 172.21.15.150:0/1454267888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0c343050 con 0x556d0c332fb0 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f374fe00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c341a30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3740010620 tx=0x7f3740012990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1850c8655de6386f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.958+0000 7f3745600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3745600640 1 -- 172.21.15.150:0/1454267888 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740033020 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3745600640 1 -- 172.21.15.150:0/1454267888 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f3740005410 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3740022070 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3745600640 1 -- 172.21.15.150:0/1454267888 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f374003e050 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3761a8c740 10 client.25664 fetch_fsmap learned FSMap version 48 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556d0c3b30e0 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3745600640 1 -- 172.21.15.150:0/1454267888 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3740022070 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3745600640 1 -- 172.21.15.150:0/1454267888 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 48) ==== 8442+0+0 (secure 0 0 0) 0x7f3740025040 con 0x556d0c332fb0 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3761a8c740 10 client.25664 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3761a8c740 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.959+0000 7f3761a8c740 20 client.25664 populate_metadata read hostname 'smithi150' 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.960+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c3b3b70 0x556d0c3b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.960+0000 7f3761a8c740 4 client.25664 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:20:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.960+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d0c29ab80 con 0x556d0c3b3b70 2024-09-15T22:20:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.960+0000 7f375cc00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c3b3b70 0x556d0c3b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.960+0000 7f375cc00640 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c3b3b70 0x556d0c3b5f90 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a700c48fac20a7 server_cookie=334130342c8342e7 in_seq=0 out_seq=0 2024-09-15T22:20:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.960+0000 7f3745600640 10 client.25664 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.979+0000 7f3745600640 1 -- 172.21.15.150:0/1454267888 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556d0c29ab80 con 0x556d0c3b3b70 2024-09-15T22:20:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.979+0000 7f3745600640 10 client.25664 handle_command_reply: tid=0 2024-09-15T22:20:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.979+0000 7f3761a8c740 1 client.25664 shutdown 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.979+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 msgr2=0x556d0c341a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.979+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c341a30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3740010620 tx=0x7f3740012990 comp rx=0 tx=0).stop 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 shutdown_connections 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x556d0c3b3b70 0x556d0c3b5f90 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d0c338040 0x556d0c342a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d0c332fb0 0x556d0c341a30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 --2- 172.21.15.150:0/1454267888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d0c332670 0x556d0c3414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3745600640 0 client.25664 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:20:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 >> 172.21.15.150:0/1454267888 conn(0x556d0c3298d0 msgr2=0x556d0c329cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 shutdown_connections 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 1 -- 172.21.15.150:0/1454267888 wait complete. 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.980+0000 7f3761a8c740 20 client.25664 trim_cache size 0 max 16384 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:20:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f373c0a3240 msgr2=0x7f373c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f373c0a3240 0x7f373c0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f37480edd00 tx=0x7f3748009260 comp rx=0 tx=0).stop 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 msgr2=0x7f3758197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 0x7f3758197d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3748031440 tx=0x7f3748032ce0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 shutdown_connections 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3758107620 0x7f375819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f373c0a3240 0x7f373c0a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3758104cf0 0x7f3758198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 --2- 172.21.15.150:0/3557244308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37581023c0 0x7f3758197d50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.981+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 >> 172.21.15.150:0/3557244308 conn(0x7f37580fbfa0 msgr2=0x7f3758102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.982+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 shutdown_connections 2024-09-15T22:20:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:20:56.982+0000 7f375d600640 1 -- 172.21.15.150:0/3557244308 wait complete. 2024-09-15T22:20:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:58 smithi169 ceph-mon[35850]: pgmap v621: 97 pgs: 97 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 430 op/s 2024-09-15T22:20:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:58 smithi154 ceph-mon[34853]: pgmap v621: 97 pgs: 97 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 430 op/s 2024-09-15T22:20:58.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:58 smithi150 ceph-mon[30886]: pgmap v621: 97 pgs: 97 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 430 op/s 2024-09-15T22:20:59.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:20:59 smithi169 ceph-mon[35850]: pgmap v622: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 435 op/s 2024-09-15T22:20:59.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:20:59 smithi154 ceph-mon[34853]: pgmap v622: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 435 op/s 2024-09-15T22:20:59.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:20:59 smithi150 ceph-mon[30886]: pgmap v622: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 435 op/s 2024-09-15T22:21:00.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:00 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:21:00.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:00 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:21:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:00 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:21:01.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:01 smithi169 ceph-mon[35850]: pgmap v623: 97 pgs: 97 active+clean; 2.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:21:01.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:01 smithi154 ceph-mon[34853]: pgmap v623: 97 pgs: 97 active+clean; 2.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:21:01.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:01 smithi150 ceph-mon[30886]: pgmap v623: 97 pgs: 97 active+clean; 2.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:21:04.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:04 smithi150 ceph-mon[30886]: pgmap v624: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 406 op/s 2024-09-15T22:21:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:04 smithi169 ceph-mon[35850]: pgmap v624: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 406 op/s 2024-09-15T22:21:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:04 smithi154 ceph-mon[34853]: pgmap v624: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 406 op/s 2024-09-15T22:21:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:06 smithi169 ceph-mon[35850]: pgmap v625: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 470 op/s 2024-09-15T22:21:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:06 smithi154 ceph-mon[34853]: pgmap v625: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 470 op/s 2024-09-15T22:21:06.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:06 smithi150 ceph-mon[30886]: pgmap v625: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 470 op/s 2024-09-15T22:21:07.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:07 smithi169 ceph-mon[35850]: pgmap v626: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 421 op/s 2024-09-15T22:21:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:07 smithi154 ceph-mon[34853]: pgmap v626: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 421 op/s 2024-09-15T22:21:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:07 smithi150 ceph-mon[30886]: pgmap v626: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 421 op/s 2024-09-15T22:21:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:08.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:08.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:08.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:21:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:21:08.914 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:08.914 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:08.914 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:08.914 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:21:09.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:09 smithi169 ceph-mon[35850]: pgmap v627: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 406 op/s 2024-09-15T22:21:09.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:09 smithi154 ceph-mon[34853]: pgmap v627: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 406 op/s 2024-09-15T22:21:09.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:09 smithi150 ceph-mon[30886]: pgmap v627: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 406 op/s 2024-09-15T22:21:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 -- 172.21.15.150:0/1459955119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c103050 msgr2=0x7fa12c103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 --2- 172.21.15.150:0/1459955119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c103050 0x7fa12c103450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa124009900 tx=0x7fa12402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 -- 172.21.15.150:0/1459955119 shutdown_connections 2024-09-15T22:21:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 --2- 172.21.15.150:0/1459955119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa12c101f40 0x7fa12c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 --2- 172.21.15.150:0/1459955119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101580 0x7fa12c101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 --2- 172.21.15.150:0/1459955119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c103050 0x7fa12c103450 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.107+0000 7fa132800640 1 -- 172.21.15.150:0/1459955119 >> 172.21.15.150:0/1459955119 conn(0x7fa12c0fd0d0 msgr2=0x7fa12c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.111+0000 7fa132800640 1 -- 172.21.15.150:0/1459955119 shutdown_connections 2024-09-15T22:21:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.112+0000 7fa132800640 1 -- 172.21.15.150:0/1459955119 wait complete. 2024-09-15T22:21:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.113+0000 7fa132800640 1 Processor -- start 2024-09-15T22:21:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 -- start start 2024-09-15T22:21:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c101580 0x7fa12c070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 0x7fa12c071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa12c103050 0x7fa12c1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c10d720 con 0x7fa12c103050 2024-09-15T22:21:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c10d5a0 con 0x7fa12c101f40 2024-09-15T22:21:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.114+0000 7fa132800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c10d8a0 con 0x7fa12c101580 2024-09-15T22:21:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa131400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c101580 0x7fa12c070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 0x7fa12c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa131e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa12c103050 0x7fa12c1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 0x7fa12c071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60112/0 (socket says 172.21.15.150:60112) 2024-09-15T22:21:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 -- 172.21.15.150:0/1226368718 learned_addr learned my addr 172.21.15.150:0/1226368718 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:10.118 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 -- 172.21.15.150:0/1226368718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c101580 msgr2=0x7fa12c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c101580 0x7fa12c070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 -- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa12c103050 msgr2=0x7fa12c1a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa12c103050 0x7fa12c1a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.116+0000 7fa130a00640 1 -- 172.21.15.150:0/1226368718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c1a8370 con 0x7fa12c101f40 2024-09-15T22:21:10.119 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.117+0000 7fa130a00640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 0x7fa12c071120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa11800ea60 tx=0x7fa11800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:10.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.118+0000 7fa12a000640 1 -- 172.21.15.150:0/1226368718 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11800cde0 con 0x7fa12c101f40 2024-09-15T22:21:10.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.118+0000 7fa12a000640 1 -- 172.21.15.150:0/1226368718 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1180035f0 con 0x7fa12c101f40 2024-09-15T22:21:10.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.118+0000 7fa12a000640 1 -- 172.21.15.150:0/1226368718 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118010670 con 0x7fa12c101f40 2024-09-15T22:21:10.120 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.118+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c1a8540 con 0x7fa12c101f40 2024-09-15T22:21:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.118+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c1a89e0 con 0x7fa12c101f40 2024-09-15T22:21:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.126+0000 7fa12a000640 1 -- 172.21.15.150:0/1226368718 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa1180037a0 con 0x7fa12c101f40 2024-09-15T22:21:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.128+0000 7fa12a000640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa1140a3390 0x7fa1140a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.131 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.128+0000 7fa12a000640 1 -- 172.21.15.150:0/1226368718 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa1180cfbe0 con 0x7fa12c101f40 2024-09-15T22:21:10.132 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.130+0000 7fa131400640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa1140a3390 0x7fa1140a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.132+0000 7fa131400640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa1140a3390 0x7fa1140a5850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa124031610 tx=0x7fa124005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.135+0000 7fa136cc9740 1 Processor -- start 2024-09-15T22:21:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.136+0000 7fa136cc9740 1 -- start start 2024-09-15T22:21:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.137+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b06660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.137+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b0b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.137+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b0e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.137+0000 7fa136cc9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5570b9a6b100 con 0x5570b9b0bc30 2024-09-15T22:21:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.137+0000 7fa136cc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5570b9a131b0 con 0x5570b9b06260 2024-09-15T22:21:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.137+0000 7fa136cc9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570b9a670c0 con 0x5570b9b06ba0 2024-09-15T22:21:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.138+0000 7fa131400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b06660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.138+0000 7fa131400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b06660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60120/0 (socket says 172.21.15.150:60120) 2024-09-15T22:21:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.138+0000 7fa131400640 1 -- 172.21.15.150:0/452101590 learned_addr learned my addr 172.21.15.150:0/452101590 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.139+0000 7fa130a00640 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b0b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.140+0000 7fa131400640 1 -- 172.21.15.150:0/452101590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 msgr2=0x5570b9b0b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.140+0000 7fa131400640 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b0b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.140+0000 7fa131400640 1 -- 172.21.15.150:0/452101590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 msgr2=0x5570b9b0e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.140+0000 7fa131400640 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b0e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.140+0000 7fa131400640 1 -- 172.21.15.150:0/452101590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b977e210 con 0x5570b9b06260 2024-09-15T22:21:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.140+0000 7fa130a00640 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b0b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.142+0000 7fa131400640 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b06660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa124033000 tx=0x7fa12402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e91d2b41500620 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.143+0000 7fa11e600640 1 -- 172.21.15.150:0/452101590 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124035050 con 0x5570b9b06260 2024-09-15T22:21:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.143+0000 7fa11e600640 1 -- 172.21.15.150:0/452101590 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa124047e00 con 0x5570b9b06260 2024-09-15T22:21:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.143+0000 7fa11e600640 1 -- 172.21.15.150:0/452101590 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124049270 con 0x5570b9b06260 2024-09-15T22:21:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.144+0000 7fa136cc9740 1 -- 172.21.15.150:0/452101590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 msgr2=0x5570b9b06660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.144+0000 7fa136cc9740 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b06660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa124033000 tx=0x7fa12402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.145+0000 7fa136cc9740 1 -- 172.21.15.150:0/452101590 shutdown_connections 2024-09-15T22:21:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.145+0000 7fa136cc9740 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b0e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.145+0000 7fa136cc9740 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b0b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.145+0000 7fa136cc9740 1 --2- 172.21.15.150:0/452101590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b06660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.145+0000 7fa136cc9740 1 -- 172.21.15.150:0/452101590 >> 172.21.15.150:0/452101590 conn(0x5570b9b018d0 msgr2=0x5570b9b01cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.146+0000 7fa136cc9740 1 -- 172.21.15.150:0/452101590 shutdown_connections 2024-09-15T22:21:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.146+0000 7fa136cc9740 1 -- 172.21.15.150:0/452101590 wait complete. 2024-09-15T22:21:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.146+0000 7fa136cc9740 1 -- start start 2024-09-15T22:21:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.147+0000 7fa136cc9740 1 Processor -- start 2024-09-15T22:21:10.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.148+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.148+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06ba0 0x5570b9b108f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.150 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.148+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b17930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.148+0000 7fa136cc9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5570b9b0eb40 con 0x5570b9b0bc30 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.148+0000 7fa136cc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5570b99f4090 con 0x5570b9b06ba0 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.148+0000 7fa136cc9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570b9b0ecc0 con 0x5570b9b06260 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.149+0000 7fa136cc9740 10 client.0 _ll_register_callbacks cb 0x5570b9a48f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.149+0000 7fa131400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.149+0000 7fa131400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b103b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:48384/0 (socket says 172.21.15.150:48384) 2024-09-15T22:21:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.149+0000 7fa131400640 1 -- 172.21.15.150:0/2288414780 learned_addr learned my addr 172.21.15.150:0/2288414780 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.149+0000 7fa130a00640 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06ba0 0x5570b9b108f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.150+0000 7fa131400640 1 -- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06ba0 msgr2=0x5570b9b108f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.150+0000 7fa131400640 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06ba0 0x5570b9b108f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.150+0000 7fa131400640 1 -- 172.21.15.150:0/2288414780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 msgr2=0x5570b9b17930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.150+0000 7fa131400640 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b17930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.150+0000 7fa131400640 1 -- 172.21.15.150:0/2288414780 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b984a620 con 0x5570b9b06260 2024-09-15T22:21:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.151+0000 7fa112a00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:21:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.151+0000 7fa131400640 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b103b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa124009900 tx=0x7fa124009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2243ff0ab47967 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.151+0000 7fa112a00640 1 -- 172.21.15.150:0/2288414780 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12405f060 con 0x5570b9b06260 2024-09-15T22:21:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.151+0000 7fa112a00640 1 -- 172.21.15.150:0/2288414780 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa124049070 con 0x5570b9b06260 2024-09-15T22:21:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.151+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa124047e00 con 0x5570b9b06260 2024-09-15T22:21:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.152+0000 7fa112a00640 1 -- 172.21.15.150:0/2288414780 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fa124035040 con 0x5570b9b06260 2024-09-15T22:21:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.155+0000 7fa136cc9740 10 client.25672 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.155+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5570b9b0eb40 con 0x5570b9b06260 2024-09-15T22:21:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.156+0000 7fa112a00640 1 -- 172.21.15.150:0/2288414780 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa124047e00 con 0x5570b9b06260 2024-09-15T22:21:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.156+0000 7fa112a00640 1 -- 172.21.15.150:0/2288414780 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7fa124003670 con 0x5570b9b06260 2024-09-15T22:21:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.157+0000 7fa136cc9740 10 client.25672 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.157+0000 7fa136cc9740 10 client.25672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.157+0000 7fa136cc9740 20 client.25672 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.157+0000 7fa136cc9740 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b1b990 0x5570b9b1ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.157+0000 7fa136cc9740 4 client.25672 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.157+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570b9a78830 con 0x5570b9b1b990 2024-09-15T22:21:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.159+0000 7fa130a00640 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b1b990 0x5570b9b1ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.159+0000 7fa130a00640 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b1b990 0x5570b9b1ddc0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c3a2cc08dcce76 server_cookie=fb42e976ded33544 in_seq=0 out_seq=0 2024-09-15T22:21:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.160+0000 7fa112a00640 10 client.25672 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.160+0000 7fa112a00640 1 -- 172.21.15.150:0/2288414780 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570b9a78830 con 0x5570b9b1b990 2024-09-15T22:21:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.160+0000 7fa112a00640 10 client.25672 handle_command_reply: tid=0 2024-09-15T22:21:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 client.25672 shutdown 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 msgr2=0x5570b9b103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b103b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa124009900 tx=0x7fa124009650 comp rx=0 tx=0).stop 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 shutdown_connections 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b1b990 0x5570b9b1ddc0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b17930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06ba0 0x5570b9b108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 --2- 172.21.15.150:0/2288414780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b103b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.161+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 >> 172.21.15.150:0/2288414780 conn(0x5570b9b018d0 msgr2=0x5570b9b030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.162+0000 7fa112a00640 0 client.25672 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.162+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 shutdown_connections 2024-09-15T22:21:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.162+0000 7fa136cc9740 1 -- 172.21.15.150:0/2288414780 wait complete. 2024-09-15T22:21:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.163+0000 7fa136cc9740 20 client.25672 trim_cache size 0 max 16384 2024-09-15T22:21:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.198+0000 7fa136cc9740 1 Processor -- start 2024-09-15T22:21:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.198+0000 7fa136cc9740 1 -- start start 2024-09-15T22:21:10.201 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b0ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.201 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b06ba0 0x5570b9b178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.201 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b0bc30 0x5570b9b104d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.201 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa136cc9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1af660 con 0x5570b9b06ba0 2024-09-15T22:21:10.201 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa136cc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b14a0 con 0x5570b9b0bc30 2024-09-15T22:21:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa136cc9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1afdf0 con 0x5570b9b06260 2024-09-15T22:21:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa131400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b0ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa131400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b0ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:48388/0 (socket says 172.21.15.150:48388) 2024-09-15T22:21:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa131400640 1 -- 172.21.15.150:0/1817023573 learned_addr learned my addr 172.21.15.150:0/1817023573 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.199+0000 7fa131400640 1 -- 172.21.15.150:0/1817023573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b0bc30 msgr2=0x5570b9b104d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.200+0000 7fa131400640 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b0bc30 0x5570b9b104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.200+0000 7fa131400640 1 -- 172.21.15.150:0/1817023573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b06ba0 msgr2=0x5570b9b178f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.200+0000 7fa131400640 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b06ba0 0x5570b9b178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.200+0000 7fa131400640 1 -- 172.21.15.150:0/1817023573 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b9b0e020 con 0x5570b9b06260 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.200+0000 7fa131400640 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b0ff90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa124003a70 tx=0x7fa1240038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5f8d6182f97b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.201+0000 7fa11dc00640 1 -- 172.21.15.150:0/1817023573 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124069030 con 0x5570b9b06260 2024-09-15T22:21:10.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.201+0000 7fa11dc00640 1 -- 172.21.15.150:0/1817023573 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa124049070 con 0x5570b9b06260 2024-09-15T22:21:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.201+0000 7fa11dc00640 1 -- 172.21.15.150:0/1817023573 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12405f070 con 0x5570b9b06260 2024-09-15T22:21:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.202+0000 7fa136cc9740 1 -- 172.21.15.150:0/1817023573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 msgr2=0x5570b9b0ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.202+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b0ff90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa124003a70 tx=0x7fa1240038b0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.202+0000 7fa136cc9740 1 -- 172.21.15.150:0/1817023573 shutdown_connections 2024-09-15T22:21:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.202+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b0bc30 0x5570b9b104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.202+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b06ba0 0x5570b9b178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.203+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1817023573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06260 0x5570b9b0ff90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.203+0000 7fa136cc9740 1 -- 172.21.15.150:0/1817023573 >> 172.21.15.150:0/1817023573 conn(0x5570b9b018d0 msgr2=0x5570b9b07df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:10.206 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.203+0000 7fa136cc9740 1 -- 172.21.15.150:0/1817023573 shutdown_connections 2024-09-15T22:21:10.206 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.203+0000 7fa136cc9740 1 -- 172.21.15.150:0/1817023573 wait complete. 2024-09-15T22:21:10.206 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.204+0000 7fa136cc9740 1 -- start start 2024-09-15T22:21:10.206 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.204+0000 7fa136cc9740 1 Processor -- start 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.204+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b14840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.204+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b14d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa136cc9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b84690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa136cc9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b0d10 con 0x5570b9b0bc30 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa136cc9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b0580 con 0x5570b9b06260 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa136cc9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1ad640 con 0x5570b9b06ba0 2024-09-15T22:21:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa136cc9740 10 client.0 _ll_register_callbacks cb 0x7fa118009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa131400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b14840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa130a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b14d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa130a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b14d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:48398/0 (socket says 172.21.15.150:48398) 2024-09-15T22:21:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa130a00640 1 -- 172.21.15.150:0/1721046738 learned_addr learned my addr 172.21.15.150:0/1721046738 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.205+0000 7fa131e00640 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b84690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.206+0000 7fa131400640 1 -- 172.21.15.150:0/1721046738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 msgr2=0x5570b9b14d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.206+0000 7fa131400640 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b14d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.206+0000 7fa131400640 1 -- 172.21.15.150:0/1721046738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 msgr2=0x5570b9b84690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.206+0000 7fa131400640 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b84690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.206+0000 7fa131400640 1 -- 172.21.15.150:0/1721046738 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b9b84bd0 con 0x5570b9b06260 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa131400640 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b14840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa124049240 tx=0x7fa124049870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95860732cea7bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa112a00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa112a00640 1 -- 172.21.15.150:0/1721046738 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124069070 con 0x5570b9b06260 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa112a00640 1 -- 172.21.15.150:0/1721046738 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa12404f040 con 0x5570b9b06260 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa124049070 con 0x5570b9b06260 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa112a00640 1 -- 172.21.15.150:0/1721046738 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fa12405f040 con 0x5570b9b06260 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa136cc9740 10 client.25676 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.207+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5570b9b85e60 con 0x5570b9b06260 2024-09-15T22:21:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa112a00640 1 -- 172.21.15.150:0/1721046738 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa124049070 con 0x5570b9b06260 2024-09-15T22:21:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa112a00640 1 -- 172.21.15.150:0/1721046738 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7fa124004c90 con 0x5570b9b06260 2024-09-15T22:21:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa136cc9740 10 client.25676 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa136cc9740 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa136cc9740 20 client.25676 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:10.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b867f0 0x5570b9b88c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:10.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa136cc9740 4 client.25676 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:21:10.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.208+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570b9a72b80 con 0x5570b9b867f0 2024-09-15T22:21:10.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.209+0000 7fa130a00640 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b867f0 0x5570b9b88c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:10.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.210+0000 7fa112a00640 10 client.25676 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:10.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.210+0000 7fa130a00640 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b867f0 0x5570b9b88c10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec6dd7280cdd6e37 server_cookie=671cc9c98998300 in_seq=0 out_seq=0 2024-09-15T22:21:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.229+0000 7fa112a00640 1 -- 172.21.15.150:0/1721046738 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570b9a72b80 con 0x5570b9b867f0 2024-09-15T22:21:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.229+0000 7fa112a00640 10 client.25676 handle_command_reply: tid=0 2024-09-15T22:21:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.229+0000 7fa136cc9740 1 client.25676 shutdown 2024-09-15T22:21:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 msgr2=0x5570b9b14840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b14840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa124049240 tx=0x7fa124049870 comp rx=0 tx=0).stop 2024-09-15T22:21:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 shutdown_connections 2024-09-15T22:21:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570b9b867f0 0x5570b9b88c10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570b9b0bc30 0x5570b9b84690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa112a00640 0 client.25676 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570b9b06ba0 0x5570b9b14d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 --2- 172.21.15.150:0/1721046738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570b9b06260 0x5570b9b14840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 >> 172.21.15.150:0/1721046738 conn(0x5570b9b018d0 msgr2=0x5570b9b0ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 shutdown_connections 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.230+0000 7fa136cc9740 1 -- 172.21.15.150:0/1721046738 wait complete. 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.231+0000 7fa136cc9740 20 client.25676 trim_cache size 0 max 16384 2024-09-15T22:21:10.233 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:21:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:21:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:21:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:21:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.231+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa1140a3390 msgr2=0x7fa1140a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.231+0000 7fa132800640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa1140a3390 0x7fa1140a5850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa124031610 tx=0x7fa124005fd0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.231+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 msgr2=0x7fa12c071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.231+0000 7fa132800640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 0x7fa12c071120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa11800ea60 tx=0x7fa11800ef20 comp rx=0 tx=0).stop 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 shutdown_connections 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa1140a3390 0x7fa1140a5850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa12c103050 0x7fa12c1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12c101f40 0x7fa12c071120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 --2- 172.21.15.150:0/1226368718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa12c101580 0x7fa12c070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 >> 172.21.15.150:0/1226368718 conn(0x7fa12c0fd0d0 msgr2=0x7fa12c105fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 shutdown_connections 2024-09-15T22:21:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:10.232+0000 7fa132800640 1 -- 172.21.15.150:0/1226368718 wait complete. 2024-09-15T22:21:12.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:12 smithi150 ceph-mon[30886]: pgmap v628: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-15T22:21:12.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:12 smithi169 ceph-mon[35850]: pgmap v628: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-15T22:21:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:12 smithi154 ceph-mon[34853]: pgmap v628: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-15T22:21:14.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:14 smithi169 ceph-mon[35850]: pgmap v629: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 373 op/s 2024-09-15T22:21:14.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:14 smithi154 ceph-mon[34853]: pgmap v629: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 373 op/s 2024-09-15T22:21:14.886 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:14 smithi150 ceph-mon[30886]: pgmap v629: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 373 op/s 2024-09-15T22:21:15.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:15 smithi169 ceph-mon[35850]: pgmap v630: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 508 op/s 2024-09-15T22:21:15.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:15 smithi154 ceph-mon[34853]: pgmap v630: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 508 op/s 2024-09-15T22:21:15.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:15 smithi150 ceph-mon[30886]: pgmap v630: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 508 op/s 2024-09-15T22:21:18.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:18 smithi169 ceph-mon[35850]: pgmap v631: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 469 op/s 2024-09-15T22:21:18.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:18 smithi154 ceph-mon[34853]: pgmap v631: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 469 op/s 2024-09-15T22:21:18.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:18 smithi150 ceph-mon[30886]: pgmap v631: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 469 op/s 2024-09-15T22:21:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:19 smithi154 ceph-mon[34853]: pgmap v632: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 485 op/s 2024-09-15T22:21:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:19 smithi150 ceph-mon[30886]: pgmap v632: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 485 op/s 2024-09-15T22:21:19.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:19 smithi169 ceph-mon[35850]: pgmap v632: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 485 op/s 2024-09-15T22:21:22.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:22 smithi150 ceph-mon[30886]: pgmap v633: 97 pgs: 97 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 489 op/s 2024-09-15T22:21:22.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:22 smithi169 ceph-mon[35850]: pgmap v633: 97 pgs: 97 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 489 op/s 2024-09-15T22:21:22.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:22 smithi154 ceph-mon[34853]: pgmap v633: 97 pgs: 97 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 489 op/s 2024-09-15T22:21:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 -- 172.21.15.150:0/3804762080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0102d50 msgr2=0x7f2de01031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 --2- 172.21.15.150:0/3804762080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0102d50 0x7f2de01031d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009900 tx=0x7f2dcc02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 -- 172.21.15.150:0/3804762080 shutdown_connections 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 --2- 172.21.15.150:0/3804762080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0103710 0x7f2de0109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 --2- 172.21.15.150:0/3804762080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0102d50 0x7f2de01031d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 --2- 172.21.15.150:0/3804762080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de0101b60 0x7f2de0101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 -- 172.21.15.150:0/3804762080 >> 172.21.15.150:0/3804762080 conn(0x7f2de00fd2c0 msgr2=0x7f2de00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 -- 172.21.15.150:0/3804762080 shutdown_connections 2024-09-15T22:21:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.404+0000 7f2de4c00640 1 -- 172.21.15.150:0/3804762080 wait complete. 2024-09-15T22:21:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.405+0000 7f2de4c00640 1 Processor -- start 2024-09-15T22:21:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.405+0000 7f2de4c00640 1 -- start start 2024-09-15T22:21:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.405+0000 7f2de4c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 0x7f2de019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.405+0000 7f2de4c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de0102d50 0x7f2de019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2de4c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0103710 0x7f2de01a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2de4c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2de010d830 con 0x7f2de0102d50 2024-09-15T22:21:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2de4c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de010d6b0 con 0x7f2de0103710 2024-09-15T22:21:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2de4c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2de010d9b0 con 0x7f2de0101b60 2024-09-15T22:21:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 0x7f2de019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 0x7f2de019a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:38880/0 (socket says 172.21.15.150:38880) 2024-09-15T22:21:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 -- 172.21.15.150:0/1503015462 learned_addr learned my addr 172.21.15.150:0/1503015462 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2dde800640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0103710 0x7f2de01a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 -- 172.21.15.150:0/1503015462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0103710 msgr2=0x7f2de01a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0103710 0x7f2de01a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 -- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de0102d50 msgr2=0x7f2de019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de0102d50 0x7f2de019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.406+0000 7f2ddde00640 1 -- 172.21.15.150:0/1503015462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de01a1c80 con 0x7f2de0101b60 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.407+0000 7f2ddde00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 0x7f2de019a060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000e9c0 tx=0x7f2dd000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.407+0000 7f2dd6a00640 1 -- 172.21.15.150:0/1503015462 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000cd80 con 0x7f2de0101b60 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.407+0000 7f2dd6a00640 1 -- 172.21.15.150:0/1503015462 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd00035f0 con 0x7f2de0101b60 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.407+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de01a1f70 con 0x7f2de0101b60 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.407+0000 7f2dd6a00640 1 -- 172.21.15.150:0/1503015462 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0010690 con 0x7f2de0101b60 2024-09-15T22:21:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.407+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de01a2480 con 0x7f2de0101b60 2024-09-15T22:21:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.414+0000 7f2de79e3740 1 Processor -- start 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.414+0000 7f2dd6a00640 1 -- 172.21.15.150:0/1503015462 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f2dd0004020 con 0x7f2de0101b60 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.414+0000 7f2de79e3740 1 -- start start 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a718a0 0x5557c8a71ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a76ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a77270 0x5557c8a79730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2de79e3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5557c89ce100 con 0x5557c8a77270 2024-09-15T22:21:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2de79e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557c89761b0 con 0x5557c8a718a0 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2de79e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5557c89ca0c0 con 0x5557c8a721e0 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a76ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a76ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:38894/0 (socket says 172.21.15.150:38894) 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.415+0000 7f2ddde00640 1 -- 172.21.15.150:0/213091964 learned_addr learned my addr 172.21.15.150:0/213091964 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddd400640 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a77270 0x5557c8a79730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddde00640 1 -- 172.21.15.150:0/213091964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a718a0 msgr2=0x5557c8a71ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddde00640 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a718a0 0x5557c8a71ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddde00640 1 -- 172.21.15.150:0/213091964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a77270 msgr2=0x5557c8a79730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddde00640 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a77270 0x5557c8a79730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddde00640 1 -- 172.21.15.150:0/213091964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c86e1210 con 0x5557c8a721e0 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddd400640 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a77270 0x5557c8a79730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2ddde00640 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a76ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00d3d50 tx=0x7f2dd00d8800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=424cd879fcfe4bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.416+0000 7f2dd6a00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2dc40a3440 0x7f2dc40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.417+0000 7f2dcb000640 1 -- 172.21.15.150:0/213091964 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0098660 con 0x5557c8a721e0 2024-09-15T22:21:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.417+0000 7f2dcb000640 1 -- 172.21.15.150:0/213091964 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd009cac0 con 0x5557c8a721e0 2024-09-15T22:21:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.417+0000 7f2dcb000640 1 -- 172.21.15.150:0/213091964 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0098490 con 0x5557c8a721e0 2024-09-15T22:21:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.417+0000 7f2dd6a00640 1 -- 172.21.15.150:0/1503015462 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f2dd00cfe30 con 0x7f2de0101b60 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 -- 172.21.15.150:0/213091964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 msgr2=0x5557c8a76ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a76ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00d3d50 tx=0x7f2dd00d8800 comp rx=0 tx=0).stop 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2dde800640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2dc40a3440 0x7f2dc40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 -- 172.21.15.150:0/213091964 shutdown_connections 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a77270 0x5557c8a79730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a76ca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 --2- 172.21.15.150:0/213091964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a718a0 0x5557c8a71ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.418+0000 7f2de79e3740 1 -- 172.21.15.150:0/213091964 >> 172.21.15.150:0/213091964 conn(0x5557c8a64700 msgr2=0x5557c8a64b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.419+0000 7f2de79e3740 1 -- 172.21.15.150:0/213091964 shutdown_connections 2024-09-15T22:21:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.419+0000 7f2dde800640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2dc40a3440 0x7f2dc40a5900 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005fd0 tx=0x7f2dd8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.419+0000 7f2de79e3740 1 -- 172.21.15.150:0/213091964 wait complete. 2024-09-15T22:21:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 -- start start 2024-09-15T22:21:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 Processor -- start 2024-09-15T22:21:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a718a0 0x5557c8a6a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a721e0 0x5557c8a6aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8a6fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5557c8a69080 con 0x5557c8a721e0 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557c8957090 con 0x5557c8a77270 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.420+0000 7f2de79e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5557c8a69200 con 0x5557c8a718a0 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2de79e3740 10 client.0 _ll_register_callbacks cb 0x5557c89abf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8a6fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2ddd400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a721e0 0x5557c8a6aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8a6fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36902/0 (socket says 172.21.15.150:36902) 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 -- 172.21.15.150:0/3396804793 learned_addr learned my addr 172.21.15.150:0/3396804793 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2ddde00640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a718a0 0x5557c8a6a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 -- 172.21.15.150:0/3396804793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a718a0 msgr2=0x5557c8a6a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a718a0 0x5557c8a6a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 -- 172.21.15.150:0/3396804793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a721e0 msgr2=0x5557c8a6aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.421+0000 7f2dde800640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a721e0 0x5557c8a6aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.422+0000 7f2dde800640 1 -- 172.21.15.150:0/3396804793 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c87ad620 con 0x5557c8a77270 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.422+0000 7f2ddde00640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a718a0 0x5557c8a6a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.422+0000 7f2dde800640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8a6fed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8011c30 tx=0x7f2dd8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62c77d94a326df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.422+0000 7f2dbf400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.422+0000 7f2dbf400640 1 -- 172.21.15.150:0/3396804793 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8022070 con 0x5557c8a77270 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.422+0000 7f2dbf400640 1 -- 172.21.15.150:0/3396804793 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f2dd8003b70 con 0x5557c8a77270 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.423+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd009cac0 con 0x5557c8a77270 2024-09-15T22:21:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.423+0000 7f2dbf400640 1 -- 172.21.15.150:0/3396804793 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f2dd802c050 con 0x5557c8a77270 2024-09-15T22:21:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.423+0000 7f2de79e3740 10 client.25685 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.423+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5557c8a7d5f0 con 0x5557c8a77270 2024-09-15T22:21:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.423+0000 7f2dbf400640 1 -- 172.21.15.150:0/3396804793 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd009cac0 con 0x5557c8a77270 2024-09-15T22:21:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.423+0000 7f2dbf400640 1 -- 172.21.15.150:0/3396804793 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f2dd8027440 con 0x5557c8a77270 2024-09-15T22:21:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2de79e3740 10 client.25685 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2de79e3740 10 client.25685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2de79e3740 20 client.25685 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8a7ecc0 0x5557c8a810f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2de79e3740 4 client.25685 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557c89db830 con 0x5557c8a7ecc0 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2ddde00640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8a7ecc0 0x5557c8a810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.424+0000 7f2dbf400640 10 client.25685 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.425+0000 7f2ddde00640 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8a7ecc0 0x5557c8a810f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adcf1522b5af82f2 server_cookie=808a1836d25132a5 in_seq=0 out_seq=0 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2dbf400640 1 -- 172.21.15.150:0/3396804793 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5557c89db830 con 0x5557c8a7ecc0 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2dbf400640 10 client.25685 handle_command_reply: tid=0 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 client.25685 shutdown 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 msgr2=0x5557c8a6fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8a6fed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8011c30 tx=0x7f2dd8004ab0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 shutdown_connections 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8a7ecc0 0x5557c8a810f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8a6fed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a721e0 0x5557c8a6aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3396804793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a718a0 0x5557c8a6a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 >> 172.21.15.150:0/3396804793 conn(0x5557c8a64700 msgr2=0x5557c8a65f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2dbf400640 0 client.25685 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 shutdown_connections 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.426+0000 7f2de79e3740 1 -- 172.21.15.150:0/3396804793 wait complete. 2024-09-15T22:21:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.427+0000 7f2de79e3740 20 client.25685 trim_cache size 0 max 16384 2024-09-15T22:21:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.455+0000 7f2de79e3740 1 Processor -- start 2024-09-15T22:21:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.455+0000 7f2de79e3740 1 -- start start 2024-09-15T22:21:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.455+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a5f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a721e0 0x5557c8a6a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a77270 0x5557c8a6aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2de79e3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01a7060 con 0x5557c8a718a0 2024-09-15T22:21:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2de79e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01a8ea0 con 0x5557c8a721e0 2024-09-15T22:21:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2de79e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01a77f0 con 0x5557c8a77270 2024-09-15T22:21:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a5f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2ddde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a5f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:59238/0 (socket says 172.21.15.150:59238) 2024-09-15T22:21:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2ddde00640 1 -- 172.21.15.150:0/3729619908 learned_addr learned my addr 172.21.15.150:0/3729619908 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2dde800640 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a77270 0x5557c8a6aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.456+0000 7f2ddd400640 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a721e0 0x5557c8a6a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dde800640 1 -- 172.21.15.150:0/3729619908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a721e0 msgr2=0x5557c8a6a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dde800640 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a721e0 0x5557c8a6a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dde800640 1 -- 172.21.15.150:0/3729619908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 msgr2=0x5557c8a5f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dde800640 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a5f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dde800640 1 -- 172.21.15.150:0/3729619908 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c8a6a710 con 0x5557c8a77270 2024-09-15T22:21:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2ddde00640 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a5f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dde800640 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a77270 0x5557c8a6aea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8027890 tx=0x7f2dd8004a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6dd012a9389fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.457+0000 7f2dca600640 1 -- 172.21.15.150:0/3729619908 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8028e60 con 0x5557c8a77270 2024-09-15T22:21:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.458+0000 7f2dca600640 1 -- 172.21.15.150:0/3729619908 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd800ee90 con 0x5557c8a77270 2024-09-15T22:21:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.458+0000 7f2dca600640 1 -- 172.21.15.150:0/3729619908 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd802c050 con 0x5557c8a77270 2024-09-15T22:21:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.458+0000 7f2de79e3740 1 -- 172.21.15.150:0/3729619908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a77270 msgr2=0x5557c8a6aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a77270 0x5557c8a6aea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8027890 tx=0x7f2dd8004a00 comp rx=0 tx=0).stop 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 -- 172.21.15.150:0/3729619908 shutdown_connections 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a77270 0x5557c8a6aea0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a721e0 0x5557c8a6a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 --2- 172.21.15.150:0/3729619908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a5f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 -- 172.21.15.150:0/3729619908 >> 172.21.15.150:0/3729619908 conn(0x5557c8a64700 msgr2=0x5557c8a73420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.459+0000 7f2de79e3740 1 -- 172.21.15.150:0/3729619908 shutdown_connections 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.460+0000 7f2de79e3740 1 -- 172.21.15.150:0/3729619908 wait complete. 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.460+0000 7f2de79e3740 1 -- start start 2024-09-15T22:21:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 Processor -- start 2024-09-15T22:21:23.463 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a90050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a90590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8ae7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01a8710 con 0x5557c8a718a0 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01a7f80 con 0x5557c8a77270 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2de01a5000 con 0x5557c8a721e0 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2de79e3740 10 client.0 _ll_register_callbacks cb 0x7f2dd8010ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2dde800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8ae7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2dde800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8ae7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:36918/0 (socket says 172.21.15.150:36918) 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.461+0000 7f2dde800640 1 -- 172.21.15.150:0/391027397 learned_addr learned my addr 172.21.15.150:0/391027397 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.462+0000 7f2dde800640 1 -- 172.21.15.150:0/391027397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 msgr2=0x5557c8a90590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.462+0000 7f2dde800640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a90590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.462+0000 7f2dde800640 1 -- 172.21.15.150:0/391027397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 msgr2=0x5557c8a90050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.462+0000 7f2ddde00640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a90050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.463+0000 7f2dde800640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a90050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.463+0000 7f2dde800640 1 -- 172.21.15.150:0/391027397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c8af8de0 con 0x5557c8a77270 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.463+0000 7f2ddde00640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a90050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.463+0000 7f2dde800640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8ae7840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8027980 tx=0x7f2dd8004ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d42f10cceb372c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.463+0000 7f2dbf400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.463+0000 7f2dbf400640 1 -- 172.21.15.150:0/391027397 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8040020 con 0x5557c8a77270 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.464+0000 7f2dbf400640 1 -- 172.21.15.150:0/391027397 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f2dd803c450 con 0x5557c8a77270 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.464+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd800ee90 con 0x5557c8a77270 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.464+0000 7f2dbf400640 1 -- 172.21.15.150:0/391027397 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f2dd802c070 con 0x5557c8a77270 2024-09-15T22:21:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.464+0000 7f2de79e3740 10 client.25691 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.464+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5557c8afa0f0 con 0x5557c8a77270 2024-09-15T22:21:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.464+0000 7f2dbf400640 1 -- 172.21.15.150:0/391027397 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd800ee90 con 0x5557c8a77270 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2dbf400640 1 -- 172.21.15.150:0/391027397 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f2dd803cce0 con 0x5557c8a77270 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2de79e3740 10 client.25691 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2de79e3740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2de79e3740 20 client.25691 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2de79e3740 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8afaa50 0x5557c8afce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2de79e3740 4 client.25691 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5557c8a5fd80 con 0x5557c8afaa50 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.465+0000 7f2ddde00640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8afaa50 0x5557c8afce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.466+0000 7f2ddde00640 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8afaa50 0x5557c8afce70 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a4853587bb3591 server_cookie=4d070d75dfee9bb8 in_seq=0 out_seq=0 2024-09-15T22:21:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.466+0000 7f2dbf400640 10 client.25691 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.484+0000 7f2dbf400640 1 -- 172.21.15.150:0/391027397 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5557c8a5fd80 con 0x5557c8afaa50 2024-09-15T22:21:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.484+0000 7f2dbf400640 10 client.25691 handle_command_reply: tid=0 2024-09-15T22:21:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.484+0000 7f2de79e3740 1 client.25691 shutdown 2024-09-15T22:21:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 msgr2=0x5557c8ae7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8ae7840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8027980 tx=0x7f2dd8004ca0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 shutdown_connections 2024-09-15T22:21:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5557c8afaa50 0x5557c8afce70 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c8a77270 0x5557c8ae7840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557c8a721e0 0x5557c8a90590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 --2- 172.21.15.150:0/391027397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5557c8a718a0 0x5557c8a90050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 >> 172.21.15.150:0/391027397 conn(0x5557c8a64700 msgr2=0x5557c8a6a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2dbf400640 0 client.25691 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 shutdown_connections 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.485+0000 7f2de79e3740 1 -- 172.21.15.150:0/391027397 wait complete. 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.486+0000 7f2de79e3740 20 client.25691 trim_cache size 0 max 16384 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:21:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:21:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2dc40a3440 msgr2=0x7f2dc40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2dc40a3440 0x7f2dc40a5900 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005fd0 tx=0x7f2dd8009500 comp rx=0 tx=0).stop 2024-09-15T22:21:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 msgr2=0x7f2de019a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 0x7f2de019a060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000e9c0 tx=0x7f2dd000ee80 comp rx=0 tx=0).stop 2024-09-15T22:21:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 shutdown_connections 2024-09-15T22:21:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de0103710 0x7f2de01a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f2dc40a3440 0x7f2dc40a5900 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de0102d50 0x7f2de019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 --2- 172.21.15.150:0/1503015462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2de0101b60 0x7f2de019a060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.487+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 >> 172.21.15.150:0/1503015462 conn(0x7f2de00fd2c0 msgr2=0x7f2de0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.488+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 shutdown_connections 2024-09-15T22:21:23.491 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:23.489+0000 7f2de4c00640 1 -- 172.21.15.150:0/1503015462 wait complete. 2024-09-15T22:21:23.749 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:23 smithi150 ceph-mon[30886]: pgmap v634: 97 pgs: 97 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 471 op/s 2024-09-15T22:21:23.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:23 smithi154 ceph-mon[34853]: pgmap v634: 97 pgs: 97 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 471 op/s 2024-09-15T22:21:23.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:23 smithi169 ceph-mon[35850]: pgmap v634: 97 pgs: 97 active+clean; 2.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 471 op/s 2024-09-15T22:21:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:25 smithi154 ceph-mon[34853]: pgmap v635: 97 pgs: 97 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 539 op/s 2024-09-15T22:21:25.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:25 smithi150 ceph-mon[30886]: pgmap v635: 97 pgs: 97 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 539 op/s 2024-09-15T22:21:25.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:25 smithi169 ceph-mon[35850]: pgmap v635: 97 pgs: 97 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 539 op/s 2024-09-15T22:21:27.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:27 smithi154 ceph-mon[34853]: pgmap v636: 97 pgs: 97 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 406 op/s 2024-09-15T22:21:27.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:27 smithi150 ceph-mon[30886]: pgmap v636: 97 pgs: 97 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 406 op/s 2024-09-15T22:21:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:27 smithi169 ceph-mon[35850]: pgmap v636: 97 pgs: 97 active+clean; 2.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 406 op/s 2024-09-15T22:21:29.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:29 smithi154 ceph-mon[34853]: pgmap v637: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 394 op/s 2024-09-15T22:21:29.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:29 smithi150 ceph-mon[30886]: pgmap v637: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 394 op/s 2024-09-15T22:21:29.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:29 smithi169 ceph-mon[35850]: pgmap v637: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 394 op/s 2024-09-15T22:21:31.762 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:31 smithi169 ceph-mon[35850]: pgmap v638: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2024-09-15T22:21:31.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:31 smithi154 ceph-mon[34853]: pgmap v638: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2024-09-15T22:21:31.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:31 smithi150 ceph-mon[30886]: pgmap v638: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 361 op/s 2024-09-15T22:21:33.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:33 smithi154 ceph-mon[34853]: pgmap v639: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 328 op/s 2024-09-15T22:21:33.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:33 smithi150 ceph-mon[30886]: pgmap v639: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 328 op/s 2024-09-15T22:21:33.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:33 smithi169 ceph-mon[35850]: pgmap v639: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 328 op/s 2024-09-15T22:21:35.753 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:35 smithi150 ceph-mon[30886]: pgmap v640: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 416 op/s 2024-09-15T22:21:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:35 smithi154 ceph-mon[34853]: pgmap v640: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 416 op/s 2024-09-15T22:21:35.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:35 smithi169 ceph-mon[35850]: pgmap v640: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 416 op/s 2024-09-15T22:21:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.612+0000 7fb972c00640 1 -- 172.21.15.150:0/3852701142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c105720 msgr2=0x7fb96c10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.612+0000 7fb972c00640 1 --2- 172.21.15.150:0/3852701142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c105720 0x7fb96c10bfb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb964009ca0 tx=0x7fb96402a8b0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 -- 172.21.15.150:0/3852701142 shutdown_connections 2024-09-15T22:21:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 --2- 172.21.15.150:0/3852701142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c105720 0x7fb96c10bfb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 --2- 172.21.15.150:0/3852701142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c104d60 0x7fb96c1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 --2- 172.21.15.150:0/3852701142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96c103b70 0x7fb96c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 -- 172.21.15.150:0/3852701142 >> 172.21.15.150:0/3852701142 conn(0x7fb96c0ff2f0 msgr2=0x7fb96c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 -- 172.21.15.150:0/3852701142 shutdown_connections 2024-09-15T22:21:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.613+0000 7fb972c00640 1 -- 172.21.15.150:0/3852701142 wait complete. 2024-09-15T22:21:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.614+0000 7fb972c00640 1 Processor -- start 2024-09-15T22:21:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.614+0000 7fb972c00640 1 -- start start 2024-09-15T22:21:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96c103b70 0x7fb96c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 0x7fb96c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c105720 0x7fb96c1a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c10f840 con 0x7fb96c105720 2024-09-15T22:21:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c10f6c0 con 0x7fb96c104d60 2024-09-15T22:21:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c10f9c0 con 0x7fb96c103b70 2024-09-15T22:21:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 0x7fb96c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb972200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c105720 0x7fb96c1a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 0x7fb96c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49922/0 (socket says 172.21.15.150:49922) 2024-09-15T22:21:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 -- 172.21.15.150:0/3005935449 learned_addr learned my addr 172.21.15.150:0/3005935449 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb971800640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96c103b70 0x7fb96c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 -- 172.21.15.150:0/3005935449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96c103b70 msgr2=0x7fb96c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96c103b70 0x7fb96c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 -- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c105720 msgr2=0x7fb96c1a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c105720 0x7fb96c1a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.615+0000 7fb970e00640 1 -- 172.21.15.150:0/3005935449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c1a1a50 con 0x7fb96c104d60 2024-09-15T22:21:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.616+0000 7fb970e00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 0x7fb96c19a370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e9f0 tx=0x7fb95800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.616+0000 7fb96a000640 1 -- 172.21.15.150:0/3005935449 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95800cd80 con 0x7fb96c104d60 2024-09-15T22:21:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.616+0000 7fb96a000640 1 -- 172.21.15.150:0/3005935449 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb958010910 con 0x7fb96c104d60 2024-09-15T22:21:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.616+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c1a1d40 con 0x7fb96c104d60 2024-09-15T22:21:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.616+0000 7fb96a000640 1 -- 172.21.15.150:0/3005935449 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958018990 con 0x7fb96c104d60 2024-09-15T22:21:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.616+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c1a2230 con 0x7fb96c104d60 2024-09-15T22:21:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 Processor -- start 2024-09-15T22:21:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 -- start start 2024-09-15T22:21:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d810484660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d810489660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d81048c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d8103e9100 con 0x55d810484ba0 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d8103911b0 con 0x55d810484260 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.620+0000 7fb977248740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8103e50c0 con 0x55d810489c30 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d810484660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb96a000640 1 -- 172.21.15.150:0/3005935449 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fb958010ac0 con 0x7fb96c104d60 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d810484660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49936/0 (socket says 172.21.15.150:49936) 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 -- 172.21.15.150:0/2818484725 learned_addr learned my addr 172.21.15.150:0/2818484725 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb971800640 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d810489660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 -- 172.21.15.150:0/2818484725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 msgr2=0x55d81048c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d81048c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 -- 172.21.15.150:0/2818484725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 msgr2=0x55d810489660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d810489660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 -- 172.21.15.150:0/2818484725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8100fc210 con 0x55d810484260 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb972200640 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d810484660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb964009ca0 tx=0x7fb964009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=654041912621d704 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.621+0000 7fb95ea00640 1 -- 172.21.15.150:0/2818484725 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964030a30 con 0x55d810484260 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb95ea00640 1 -- 172.21.15.150:0/2818484725 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb964036030 con 0x55d810484260 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb95ea00640 1 -- 172.21.15.150:0/2818484725 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9640044e0 con 0x55d810484260 2024-09-15T22:21:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 -- 172.21.15.150:0/2818484725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 msgr2=0x55d810484660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d810484660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb964009ca0 tx=0x7fb964009a20 comp rx=0 tx=0).stop 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 -- 172.21.15.150:0/2818484725 shutdown_connections 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d81048c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d810489660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 --2- 172.21.15.150:0/2818484725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d810484660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 -- 172.21.15.150:0/2818484725 >> 172.21.15.150:0/2818484725 conn(0x55d81047f8d0 msgr2=0x55d81047fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.622+0000 7fb977248740 1 -- 172.21.15.150:0/2818484725 shutdown_connections 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.623+0000 7fb977248740 1 -- 172.21.15.150:0/2818484725 wait complete. 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.623+0000 7fb96a000640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9540a3150 0x7fb9540a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.623+0000 7fb977248740 1 -- start start 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.623+0000 7fb96a000640 1 -- 172.21.15.150:0/3005935449 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fb9580cfc90 con 0x7fb96c104d60 2024-09-15T22:21:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.623+0000 7fb972200640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9540a3150 0x7fb9540a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.623+0000 7fb977248740 1 Processor -- start 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d81048e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d81048e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d8104959d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d81048cba0 con 0x55d810484ba0 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d810372090 con 0x55d810484260 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d81048cd20 con 0x55d810489c30 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb977248740 10 client.0 _ll_register_callbacks cb 0x55d8103c6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb972200640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9540a3150 0x7fb9540a5610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb964030ff0 tx=0x7fb96402a8b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb971800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d81048e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb971800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d81048e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49944/0 (socket says 172.21.15.150:49944) 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb971800640 1 -- 172.21.15.150:0/337004853 learned_addr learned my addr 172.21.15.150:0/337004853 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb970e00640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d81048e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.624+0000 7fb972200640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d8104959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb971800640 1 -- 172.21.15.150:0/337004853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 msgr2=0x55d8104959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb971800640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d8104959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb971800640 1 -- 172.21.15.150:0/337004853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 msgr2=0x55d81048e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb971800640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d81048e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb971800640 1 -- 172.21.15.150:0/337004853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8101c8620 con 0x55d810484260 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb971800640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d81048e450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb960012730 tx=0x7fb960012bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448652ce8b34e814 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb953400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb953400640 1 -- 172.21.15.150:0/337004853 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96000f920 con 0x55d810484260 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb964036030 con 0x55d810484260 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb953400640 1 -- 172.21.15.150:0/337004853 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fb96000fac0 con 0x55d810484260 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb953400640 1 -- 172.21.15.150:0/337004853 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb96000fcc0 con 0x55d810484260 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb977248740 10 client.25703 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.625+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d8104a10f0 con 0x55d810484260 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb953400640 1 -- 172.21.15.150:0/337004853 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb964036030 con 0x55d810484260 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb953400640 1 -- 172.21.15.150:0/337004853 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7fb9600104c0 con 0x55d810484260 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb977248740 10 client.25703 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb977248740 10 client.25703 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb977248740 20 client.25703 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb977248740 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d8104a2770 0x55d8104a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb977248740 4 client.25703 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8103f6830 con 0x55d8104a2770 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.626+0000 7fb970e00640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d8104a2770 0x55d8104a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.627+0000 7fb970e00640 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d8104a2770 0x55d8104a4bf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5367f2d44d8d951 server_cookie=e302dce495e0828b in_seq=0 out_seq=0 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.627+0000 7fb953400640 10 client.25703 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.627+0000 7fb953400640 1 -- 172.21.15.150:0/337004853 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8103f6830 con 0x55d8104a2770 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.627+0000 7fb953400640 10 client.25703 handle_command_reply: tid=0 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.627+0000 7fb977248740 1 client.25703 shutdown 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 msgr2=0x55d81048e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d81048e450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb960012730 tx=0x7fb960012bf0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 shutdown_connections 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d8104a2770 0x55d8104a4bf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810489c30 0x55d8104959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484ba0 0x55d81048e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb953400640 0 client.25703 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 --2- 172.21.15.150:0/337004853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484260 0x55d81048e450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 >> 172.21.15.150:0/337004853 conn(0x55d81047f8d0 msgr2=0x55d8104810e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 shutdown_connections 2024-09-15T22:21:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 1 -- 172.21.15.150:0/337004853 wait complete. 2024-09-15T22:21:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.628+0000 7fb977248740 20 client.25703 trim_cache size 0 max 16384 2024-09-15T22:21:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.643+0000 7fb977248740 1 Processor -- start 2024-09-15T22:21:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.643+0000 7fb977248740 1 -- start start 2024-09-15T22:21:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.643+0000 7fb977248740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484260 0x55d81047ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb977248740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484ba0 0x55d810495990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb977248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 0x55d810480cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb977248740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1a6c60 con 0x55d810484260 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb977248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1a8aa0 con 0x55d810489c30 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb977248740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1a73f0 con 0x55d810484ba0 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 0x55d810480cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 0x55d810480cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49956/0 (socket says 172.21.15.150:49956) 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 -- 172.21.15.150:0/2144741053 learned_addr learned my addr 172.21.15.150:0/2144741053 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb971800640 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484260 0x55d81047ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb970e00640 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484ba0 0x55d810495990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 -- 172.21.15.150:0/2144741053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484ba0 msgr2=0x55d810495990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484ba0 0x55d810495990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 -- 172.21.15.150:0/2144741053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484260 msgr2=0x55d81047ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484260 0x55d81047ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 -- 172.21.15.150:0/2144741053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d810485080 con 0x55d810489c30 2024-09-15T22:21:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb971800640 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484260 0x55d81047ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.644+0000 7fb972200640 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 0x55d810480cc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb964045000 tx=0x7fb964050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca17fc68311b8dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.645+0000 7fb95e000640 1 -- 172.21.15.150:0/2144741053 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964056040 con 0x55d810489c30 2024-09-15T22:21:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.645+0000 7fb95e000640 1 -- 172.21.15.150:0/2144741053 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb96405f070 con 0x55d810489c30 2024-09-15T22:21:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.645+0000 7fb95e000640 1 -- 172.21.15.150:0/2144741053 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96404f460 con 0x55d810489c30 2024-09-15T22:21:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.645+0000 7fb977248740 1 -- 172.21.15.150:0/2144741053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 msgr2=0x55d810480cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.645+0000 7fb977248740 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 0x55d810480cc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb964045000 tx=0x7fb964050000 comp rx=0 tx=0).stop 2024-09-15T22:21:36.652 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 -- 172.21.15.150:0/2144741053 shutdown_connections 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810489c30 0x55d810480cc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484ba0 0x55d810495990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 --2- 172.21.15.150:0/2144741053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810484260 0x55d81047ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 -- 172.21.15.150:0/2144741053 >> 172.21.15.150:0/2144741053 conn(0x55d81047f8d0 msgr2=0x55d81048e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 -- 172.21.15.150:0/2144741053 shutdown_connections 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 -- 172.21.15.150:0/2144741053 wait complete. 2024-09-15T22:21:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 -- start start 2024-09-15T22:21:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.646+0000 7fb977248740 1 Processor -- start 2024-09-15T22:21:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484260 0x55d8104932e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 0x55d810493820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810489c30 0x55d810494830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1a8310 con 0x55d810489c30 2024-09-15T22:21:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1a7b80 con 0x55d810484ba0 2024-09-15T22:21:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1a4c60 con 0x55d810484260 2024-09-15T22:21:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb977248740 10 client.0 _ll_register_callbacks cb 0x7fb960009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 0x55d810493820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 0x55d810493820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:49958/0 (socket says 172.21.15.150:49958) 2024-09-15T22:21:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb971800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484260 0x55d8104932e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 -- 172.21.15.150:0/2237476416 learned_addr learned my addr 172.21.15.150:0/2237476416 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb972200640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810489c30 0x55d810494830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 -- 172.21.15.150:0/2237476416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484260 msgr2=0x55d8104932e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484260 0x55d8104932e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 -- 172.21.15.150:0/2237476416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810489c30 msgr2=0x55d810494830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810489c30 0x55d810494830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb970e00640 1 -- 172.21.15.150:0/2237476416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d810494e40 con 0x55d810484ba0 2024-09-15T22:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.647+0000 7fb971800640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484260 0x55d8104932e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb970e00640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 0x55d810493820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb958098730 tx=0x7fb9580bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=349924cf121b4a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb953400640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:21:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb953400640 1 -- 172.21.15.150:0/2237476416 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9580af070 con 0x55d810484ba0 2024-09-15T22:21:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb953400640 1 -- 172.21.15.150:0/2237476416 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fb958098940 con 0x55d810484ba0 2024-09-15T22:21:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb96405f070 con 0x55d810484ba0 2024-09-15T22:21:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb953400640 1 -- 172.21.15.150:0/2237476416 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb9580bae60 con 0x55d810484ba0 2024-09-15T22:21:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 10 client.25709 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d81050d860 con 0x55d810484ba0 2024-09-15T22:21:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb953400640 1 -- 172.21.15.150:0/2237476416 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb96405f070 con 0x55d810484ba0 2024-09-15T22:21:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb953400640 1 -- 172.21.15.150:0/2237476416 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7fb9580b0260 con 0x55d810484ba0 2024-09-15T22:21:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 10 client.25709 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 10 client.25709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 20 client.25709 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d81050e280 0x55d8105106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 4 client.25709 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:21:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.648+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8103f0b80 con 0x55d81050e280 2024-09-15T22:21:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.649+0000 7fb971800640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d81050e280 0x55d8105106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.649+0000 7fb953400640 10 client.25709 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.649+0000 7fb971800640 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d81050e280 0x55d8105106a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d982257278e7cde server_cookie=30a860ae3a25b181 in_seq=0 out_seq=0 2024-09-15T22:21:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb953400640 1 -- 172.21.15.150:0/2237476416 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8103f0b80 con 0x55d81050e280 2024-09-15T22:21:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb953400640 10 client.25709 handle_command_reply: tid=0 2024-09-15T22:21:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 client.25709 shutdown 2024-09-15T22:21:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 msgr2=0x55d810493820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 0x55d810493820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb958098730 tx=0x7fb9580bc040 comp rx=0 tx=0).stop 2024-09-15T22:21:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 shutdown_connections 2024-09-15T22:21:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d81050e280 0x55d8105106a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d810489c30 0x55d810494830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb953400640 0 client.25709 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d810484ba0 0x55d810493820 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 --2- 172.21.15.150:0/2237476416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d810484260 0x55d8104932e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 >> 172.21.15.150:0/2237476416 conn(0x55d81047f8d0 msgr2=0x55d81047ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 shutdown_connections 2024-09-15T22:21:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 1 -- 172.21.15.150:0/2237476416 wait complete. 2024-09-15T22:21:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.660+0000 7fb977248740 20 client.25709 trim_cache size 0 max 16384 2024-09-15T22:21:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:21:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:21:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:21:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:21:36.668 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9540a3150 msgr2=0x7fb9540a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9540a3150 0x7fb9540a5610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb964030ff0 tx=0x7fb96402a8b0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 msgr2=0x7fb96c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 0x7fb96c19a370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e9f0 tx=0x7fb95800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 shutdown_connections 2024-09-15T22:21:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fb9540a3150 0x7fb9540a5610 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c105720 0x7fb96c1a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb96c104d60 0x7fb96c19a370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 --2- 172.21.15.150:0/3005935449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb96c103b70 0x7fb96c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 >> 172.21.15.150:0/3005935449 conn(0x7fb96c0ff2f0 msgr2=0x7fb96c1080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 shutdown_connections 2024-09-15T22:21:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:36.661+0000 7fb972c00640 1 -- 172.21.15.150:0/3005935449 wait complete. 2024-09-15T22:21:37.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:37 smithi154 ceph-mon[34853]: pgmap v641: 97 pgs: 97 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 347 op/s 2024-09-15T22:21:37.827 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:37 smithi150 ceph-mon[30886]: pgmap v641: 97 pgs: 97 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 347 op/s 2024-09-15T22:21:37.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:37 smithi169 ceph-mon[35850]: pgmap v641: 97 pgs: 97 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 347 op/s 2024-09-15T22:21:39.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:39 smithi154 ceph-mon[34853]: pgmap v642: 97 pgs: 97 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 372 op/s 2024-09-15T22:21:39.867 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:39 smithi150 ceph-mon[30886]: pgmap v642: 97 pgs: 97 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 372 op/s 2024-09-15T22:21:39.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:39 smithi169 ceph-mon[35850]: pgmap v642: 97 pgs: 97 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 372 op/s 2024-09-15T22:21:41.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:41 smithi154 ceph-mon[34853]: pgmap v643: 97 pgs: 97 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 376 op/s 2024-09-15T22:21:41.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:41 smithi150 ceph-mon[30886]: pgmap v643: 97 pgs: 97 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 376 op/s 2024-09-15T22:21:41.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:41 smithi169 ceph-mon[35850]: pgmap v643: 97 pgs: 97 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 376 op/s 2024-09-15T22:21:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:43 smithi154 ceph-mon[34853]: pgmap v644: 97 pgs: 97 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 382 op/s 2024-09-15T22:21:43.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:43 smithi150 ceph-mon[30886]: pgmap v644: 97 pgs: 97 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 382 op/s 2024-09-15T22:21:43.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:43 smithi169 ceph-mon[35850]: pgmap v644: 97 pgs: 97 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 382 op/s 2024-09-15T22:21:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:45 smithi154 ceph-mon[34853]: pgmap v645: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 480 op/s 2024-09-15T22:21:45.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:45 smithi150 ceph-mon[30886]: pgmap v645: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 480 op/s 2024-09-15T22:21:45.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:45 smithi169 ceph-mon[35850]: pgmap v645: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 480 op/s 2024-09-15T22:21:48.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:48 smithi154 ceph-mon[34853]: pgmap v646: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 405 op/s 2024-09-15T22:21:48.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:48 smithi150 ceph-mon[30886]: pgmap v646: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 405 op/s 2024-09-15T22:21:48.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:48 smithi169 ceph-mon[35850]: pgmap v646: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 405 op/s 2024-09-15T22:21:49.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:49 smithi154 ceph-mon[34853]: pgmap v647: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 408 op/s 2024-09-15T22:21:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 -- 172.21.15.150:0/2340604082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820103b70 msgr2=0x7f7820103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 --2- 172.21.15.150:0/2340604082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820103b70 0x7f7820103f70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7810009900 tx=0x7f781002a410 comp rx=0 tx=0).stop 2024-09-15T22:21:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 -- 172.21.15.150:0/2340604082 shutdown_connections 2024-09-15T22:21:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 --2- 172.21.15.150:0/2340604082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820105720 0x7f782010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 --2- 172.21.15.150:0/2340604082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820104d60 0x7f78201051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 --2- 172.21.15.150:0/2340604082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820103b70 0x7f7820103f70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 -- 172.21.15.150:0/2340604082 >> 172.21.15.150:0/2340604082 conn(0x7f78200ff2f0 msgr2=0x7f7820101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 -- 172.21.15.150:0/2340604082 shutdown_connections 2024-09-15T22:21:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.776+0000 7f781f200640 1 -- 172.21.15.150:0/2340604082 wait complete. 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.777+0000 7f781f200640 1 Processor -- start 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.777+0000 7f781f200640 1 -- start start 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781f200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820103b70 0x7f7820199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781f200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 0x7f782019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820105720 0x7f78201a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781f200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f782010f840 con 0x7f7820105720 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781f200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f782010f6c0 con 0x7f7820103b70 2024-09-15T22:21:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781f200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f782010f9c0 con 0x7f7820104d60 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 0x7f782019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820103b70 0x7f7820199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820105720 0x7f78201a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 0x7f782019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49670/0 (socket says 172.21.15.150:49670) 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 -- 172.21.15.150:0/4245549486 learned_addr learned my addr 172.21.15.150:0/4245549486 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820103b70 0x7f7820199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:43142/0 (socket says 172.21.15.150:43142) 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 -- 172.21.15.150:0/4245549486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820103b70 msgr2=0x7f7820199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820103b70 0x7f7820199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 -- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820105720 msgr2=0x7f78201a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820105720 0x7f78201a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.778+0000 7f781d400640 1 -- 172.21.15.150:0/4245549486 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78201a1ac0 con 0x7f7820104d60 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.779+0000 7f781d400640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 0x7f782019a3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f780c00ea60 tx=0x7f780c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.779+0000 7f7816a00640 1 -- 172.21.15.150:0/4245549486 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c00cde0 con 0x7f7820104d60 2024-09-15T22:21:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.779+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78201a1db0 con 0x7f7820104d60 2024-09-15T22:21:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.779+0000 7f7816a00640 1 -- 172.21.15.150:0/4245549486 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f780c0035f0 con 0x7f7820104d60 2024-09-15T22:21:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.779+0000 7f7816a00640 1 -- 172.21.15.150:0/4245549486 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c010670 con 0x7f7820104d60 2024-09-15T22:21:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.779+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78201a2270 con 0x7f7820104d60 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 Processor -- start 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7816a00640 1 -- 172.21.15.150:0/4245549486 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f780c0037a0 con 0x7f7820104d60 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 -- start start 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246884660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246889660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x56224688c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5622467e9100 con 0x562246884260 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5622467911b0 con 0x562246884ba0 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.782+0000 7f7827c44740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622467e50c0 con 0x562246889c30 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246884660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246889660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246889660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:43154/0 (socket says 172.21.15.150:43154) 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 -- 172.21.15.150:0/1588618000 learned_addr learned my addr 172.21.15.150:0/1588618000 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781d400640 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x56224688c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 -- 172.21.15.150:0/1588618000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 msgr2=0x56224688c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x56224688c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 -- 172.21.15.150:0/1588618000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 msgr2=0x562246884660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246884660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 -- 172.21.15.150:0/1588618000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622464fc210 con 0x562246884ba0 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781d400640 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x56224688c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781e800640 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246884660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:49.795 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.783+0000 7f781de00640 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246889660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7810006010 tx=0x7f7810004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eadeeb8a76fbb897 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f780b400640 1 -- 172.21.15.150:0/1588618000 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810035040 con 0x562246884ba0 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f780b400640 1 -- 172.21.15.150:0/1588618000 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7810004430 con 0x562246884ba0 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f780b400640 1 -- 172.21.15.150:0/1588618000 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100316b0 con 0x562246884ba0 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7816a00640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f78040a3240 0x7f78040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7816a00640 1 -- 172.21.15.150:0/4245549486 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f780c0cfc30 con 0x7f7820104d60 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f781e800640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f78040a3240 0x7f78040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 -- 172.21.15.150:0/1588618000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 msgr2=0x562246889660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246889660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7810006010 tx=0x7f7810004040 comp rx=0 tx=0).stop 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 -- 172.21.15.150:0/1588618000 shutdown_connections 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x56224688c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246889660 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 --2- 172.21.15.150:0/1588618000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246884660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.784+0000 7f7827c44740 1 -- 172.21.15.150:0/1588618000 >> 172.21.15.150:0/1588618000 conn(0x56224687f8d0 msgr2=0x56224687fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.785+0000 7f7827c44740 1 -- 172.21.15.150:0/1588618000 shutdown_connections 2024-09-15T22:21:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.785+0000 7f7827c44740 1 -- 172.21.15.150:0/1588618000 wait complete. 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.785+0000 7f781e800640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f78040a3240 0x7f78040a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7818009fd0 tx=0x7f7818009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.785+0000 7f7827c44740 1 -- start start 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.785+0000 7f7827c44740 1 Processor -- start 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884260 0x56224688e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884ba0 0x56224688e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x562246895920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56224688cba0 con 0x562246884ba0 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562246772090 con 0x562246884260 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56224688cd20 con 0x562246889c30 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f7827c44740 10 client.0 _ll_register_callbacks cb 0x5622467c6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x562246895920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884ba0 0x56224688e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781de00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884260 0x56224688e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x562246895920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49682/0 (socket says 172.21.15.150:49682) 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 -- 172.21.15.150:0/2531402352 learned_addr learned my addr 172.21.15.150:0/2531402352 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 -- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884260 msgr2=0x56224688e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884260 0x56224688e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 -- 172.21.15.150:0/2531402352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884ba0 msgr2=0x56224688e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884ba0 0x56224688e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781e800640 1 -- 172.21.15.150:0/2531402352 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622465c8620 con 0x562246889c30 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.786+0000 7f781d400640 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884ba0 0x56224688e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f781e800640 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x562246895920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7818005f40 tx=0x7f7818004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf14e56b8d7376e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f77ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:21:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f77ffe00640 1 -- 172.21.15.150:0/2531402352 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818004b20 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f77ffe00640 1 -- 172.21.15.150:0/2531402352 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7818017030 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7810004430 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f77ffe00640 1 -- 172.21.15.150:0/2531402352 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f7818004cc0 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f7827c44740 10 client.25720 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5622468987e0 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.787+0000 7f77ffe00640 1 -- 172.21.15.150:0/2531402352 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7810004430 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f77ffe00640 1 -- 172.21.15.150:0/2531402352 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f7818005590 con 0x562246889c30 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f7827c44740 10 client.25720 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f7827c44740 10 client.25720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f7827c44740 20 client.25720 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f7827c44740 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246899f90 0x56224689c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f7827c44740 4 client.25720 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622467f6830 con 0x562246899f90 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.788+0000 7f781de00640 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246899f90 0x56224689c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.789+0000 7f781de00640 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246899f90 0x56224689c3f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b7d44aa2c6dc95 server_cookie=7367a70d6673f106 in_seq=0 out_seq=0 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.789+0000 7f77ffe00640 10 client.25720 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.789+0000 7f77ffe00640 1 -- 172.21.15.150:0/2531402352 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622467f6830 con 0x562246899f90 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.789+0000 7f77ffe00640 10 client.25720 handle_command_reply: tid=0 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.789+0000 7f7827c44740 1 client.25720 shutdown 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 msgr2=0x562246895920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x562246895920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7818005f40 tx=0x7f7818004ab0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 shutdown_connections 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246899f90 0x56224689c3f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246889c30 0x562246895920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884ba0 0x56224688e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 --2- 172.21.15.150:0/2531402352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884260 0x56224688e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f77ffe00640 0 client.25720 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 >> 172.21.15.150:0/2531402352 conn(0x56224687f8d0 msgr2=0x5622468810e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 shutdown_connections 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 1 -- 172.21.15.150:0/2531402352 wait complete. 2024-09-15T22:21:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.790+0000 7f7827c44740 20 client.25720 trim_cache size 0 max 16384 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 Processor -- start 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 -- start start 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56224687f8d0 0x56224687a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246884260 0x5622468958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246880780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f78201ab1b0 con 0x56224687f8d0 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78201acff0 con 0x562246884ba0 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f7827c44740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78201ab940 con 0x562246884260 2024-09-15T22:21:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f781de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56224687f8d0 0x56224687a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f781e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246880780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f781d400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246884260 0x5622468958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f781e800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246880780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:43174/0 (socket says 172.21.15.150:43174) 2024-09-15T22:21:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.805+0000 7f781e800640 1 -- 172.21.15.150:0/1023418492 learned_addr learned my addr 172.21.15.150:0/1023418492 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781e800640 1 -- 172.21.15.150:0/1023418492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246884260 msgr2=0x5622468958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781e800640 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246884260 0x5622468958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781e800640 1 -- 172.21.15.150:0/1023418492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56224687f8d0 msgr2=0x56224687a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781e800640 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56224687f8d0 0x56224687a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781e800640 1 -- 172.21.15.150:0/1023418492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224687f6f0 con 0x562246884ba0 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781d400640 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246884260 0x5622468958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f781e800640 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246880780 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7818018040 tx=0x7f7818011610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f61ac482564f63cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f780aa00640 1 -- 172.21.15.150:0/1023418492 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818037030 con 0x562246884ba0 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f780aa00640 1 -- 172.21.15.150:0/1023418492 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f781801fce0 con 0x562246884ba0 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.806+0000 7f780aa00640 1 -- 172.21.15.150:0/1023418492 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818032dc0 con 0x562246884ba0 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 -- 172.21.15.150:0/1023418492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 msgr2=0x562246880780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246880780 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7818018040 tx=0x7f7818011610 comp rx=0 tx=0).stop 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 -- 172.21.15.150:0/1023418492 shutdown_connections 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246880780 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562246884260 0x5622468958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 --2- 172.21.15.150:0/1023418492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56224687f8d0 0x56224687a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 -- 172.21.15.150:0/1023418492 >> 172.21.15.150:0/1023418492 conn(0x5622468897c0 msgr2=0x562246885de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 -- 172.21.15.150:0/1023418492 shutdown_connections 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 -- 172.21.15.150:0/1023418492 wait complete. 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 -- start start 2024-09-15T22:21:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.807+0000 7f7827c44740 1 Processor -- start 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 0x562246892dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246893300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246894310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f78201ac860 con 0x562246884260 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78201ac0d0 con 0x562246884ba0 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78201a9190 con 0x56224687f8d0 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f7827c44740 10 client.0 _ll_register_callbacks cb 0x7f7818011c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 0x562246892dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 0x562246892dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:49694/0 (socket says 172.21.15.150:49694) 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 -- 172.21.15.150:0/1834773742 learned_addr learned my addr 172.21.15.150:0/1834773742 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781d400640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246893300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781e800640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246894310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 -- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 msgr2=0x562246894310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246894310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 -- 172.21.15.150:0/1834773742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 msgr2=0x562246893300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246893300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781de00640 1 -- 172.21.15.150:0/1834773742 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562246894920 con 0x56224687f8d0 2024-09-15T22:21:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.808+0000 7f781e800640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246894310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f781de00640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 0x562246892dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f781002aa00 tx=0x7f781002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=649c5f2819e6a902 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f77ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f77ffe00640 1 -- 172.21.15.150:0/1834773742 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810035040 con 0x56224687f8d0 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f77ffe00640 1 -- 172.21.15.150:0/1834773742 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7810031ac0 con 0x56224687f8d0 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f781801fce0 con 0x56224687f8d0 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f77ffe00640 1 -- 172.21.15.150:0/1834773742 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f7810031cc0 con 0x56224687f8d0 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f7827c44740 10 client.25726 fetch_fsmap learned FSMap version 49 2024-09-15T22:21:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562246895ca0 con 0x56224687f8d0 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.809+0000 7f77ffe00640 1 -- 172.21.15.150:0/1834773742 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f781801fce0 con 0x56224687f8d0 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f77ffe00640 1 -- 172.21.15.150:0/1834773742 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f781005b510 con 0x56224687f8d0 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f7827c44740 10 client.25726 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f7827c44740 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f7827c44740 20 client.25726 populate_metadata read hostname 'smithi150' 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f7827c44740 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246889c30 0x56224690fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f7827c44740 4 client.25726 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:21:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5622467f0b80 con 0x562246889c30 2024-09-15T22:21:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f781d400640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246889c30 0x56224690fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f77ffe00640 10 client.25726 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.810+0000 7f781d400640 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246889c30 0x56224690fa30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e4110c70a675e0b server_cookie=7abeb3e1112de830 in_seq=0 out_seq=0 2024-09-15T22:21:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f77ffe00640 1 -- 172.21.15.150:0/1834773742 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622467f0b80 con 0x562246889c30 2024-09-15T22:21:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f77ffe00640 10 client.25726 handle_command_reply: tid=0 2024-09-15T22:21:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 client.25726 shutdown 2024-09-15T22:21:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 msgr2=0x562246892dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 0x562246892dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f781002aa00 tx=0x7f781002a410 comp rx=0 tx=0).stop 2024-09-15T22:21:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 shutdown_connections 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x562246889c30 0x56224690fa30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562246884ba0 0x562246894310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562246884260 0x562246893300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 --2- 172.21.15.150:0/1834773742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56224687f8d0 0x562246892dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f77ffe00640 0 client.25726 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 >> 172.21.15.150:0/1834773742 conn(0x5622468897c0 msgr2=0x56224687e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 shutdown_connections 2024-09-15T22:21:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 1 -- 172.21.15.150:0/1834773742 wait complete. 2024-09-15T22:21:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.820+0000 7f7827c44740 20 client.25726 trim_cache size 0 max 16384 2024-09-15T22:21:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:21:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:21:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:21:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f78040a3240 msgr2=0x7f78040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f78040a3240 0x7f78040a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7818009fd0 tx=0x7f7818009500 comp rx=0 tx=0).stop 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 msgr2=0x7f782019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 0x7f782019a3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f780c00ea60 tx=0x7f780c00ef20 comp rx=0 tx=0).stop 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 shutdown_connections 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f78040a3240 0x7f78040a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7820105720 0x7f78201a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7820104d60 0x7f782019a3e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 --2- 172.21.15.150:0/4245549486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7820103b70 0x7f7820199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 >> 172.21.15.150:0/4245549486 conn(0x7f78200ff2f0 msgr2=0x7f7820108130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 shutdown_connections 2024-09-15T22:21:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:21:49.821+0000 7f781f200640 1 -- 172.21.15.150:0/4245549486 wait complete. 2024-09-15T22:21:49.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:49 smithi150 ceph-mon[30886]: pgmap v647: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 408 op/s 2024-09-15T22:21:49.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:49 smithi169 ceph-mon[35850]: pgmap v647: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 408 op/s 2024-09-15T22:21:51.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:51 smithi154 ceph-mon[34853]: pgmap v648: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 396 op/s 2024-09-15T22:21:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:51 smithi150 ceph-mon[30886]: pgmap v648: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 396 op/s 2024-09-15T22:21:51.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:51 smithi169 ceph-mon[35850]: pgmap v648: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 396 op/s 2024-09-15T22:21:53.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:53 smithi154 ceph-mon[34853]: pgmap v649: 97 pgs: 97 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 386 op/s 2024-09-15T22:21:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:53 smithi150 ceph-mon[30886]: pgmap v649: 97 pgs: 97 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 386 op/s 2024-09-15T22:21:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:53 smithi169 ceph-mon[35850]: pgmap v649: 97 pgs: 97 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 386 op/s 2024-09-15T22:21:55.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:55 smithi154 ceph-mon[34853]: pgmap v650: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 474 op/s 2024-09-15T22:21:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:55 smithi150 ceph-mon[30886]: pgmap v650: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 474 op/s 2024-09-15T22:21:55.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:55 smithi169 ceph-mon[35850]: pgmap v650: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 474 op/s 2024-09-15T22:21:57.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:57 smithi154 ceph-mon[34853]: pgmap v651: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 376 op/s 2024-09-15T22:21:57.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:57 smithi150 ceph-mon[30886]: pgmap v651: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 376 op/s 2024-09-15T22:21:57.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:57 smithi169 ceph-mon[35850]: pgmap v651: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 376 op/s 2024-09-15T22:21:59.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:21:59 smithi154 ceph-mon[34853]: pgmap v652: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 409 op/s 2024-09-15T22:21:59.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:21:59 smithi150 ceph-mon[30886]: pgmap v652: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 409 op/s 2024-09-15T22:21:59.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:21:59 smithi169 ceph-mon[35850]: pgmap v652: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 409 op/s 2024-09-15T22:22:01.762 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:01 smithi169 ceph-mon[35850]: pgmap v653: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 428 op/s 2024-09-15T22:22:01.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:01 smithi154 ceph-mon[34853]: pgmap v653: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 428 op/s 2024-09-15T22:22:01.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:01 smithi150 ceph-mon[30886]: pgmap v653: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 428 op/s 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.943+0000 7f6561c00640 1 -- 172.21.15.150:0/622296726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c104f50 msgr2=0x7f655c1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.943+0000 7f6561c00640 1 --2- 172.21.15.150:0/622296726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c104f50 0x7f655c1053d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6548009900 tx=0x7f654802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 -- 172.21.15.150:0/622296726 shutdown_connections 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 --2- 172.21.15.150:0/622296726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c105910 0x7f655c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 --2- 172.21.15.150:0/622296726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c104f50 0x7f655c1053d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 --2- 172.21.15.150:0/622296726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f655c103d60 0x7f655c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 -- 172.21.15.150:0/622296726 >> 172.21.15.150:0/622296726 conn(0x7f655c0ff4e0 msgr2=0x7f655c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 -- 172.21.15.150:0/622296726 shutdown_connections 2024-09-15T22:22:02.947 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.944+0000 7f6561c00640 1 -- 172.21.15.150:0/622296726 wait complete. 2024-09-15T22:22:02.948 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 Processor -- start 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 -- start start 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f655c103d60 0x7f655c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c104f50 0x7f655c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c105910 0x7f655c1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f655c10f9e0 con 0x7f655c105910 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f655c10f860 con 0x7f655c104f50 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f6561c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f655c10fb60 con 0x7f655c103d60 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.945+0000 7f655b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c105910 0x7f655c1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.949 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f655c103d60 0x7f655c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c104f50 0x7f655c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c105910 0x7f655c1a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55030/0 (socket says 172.21.15.150:55030) 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655b400640 1 -- 172.21.15.150:0/3212899996 learned_addr learned my addr 172.21.15.150:0/3212899996 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 -- 172.21.15.150:0/3212899996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f655c103d60 msgr2=0x7f655c199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f655c103d60 0x7f655c199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 -- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c105910 msgr2=0x7f655c1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c105910 0x7f655c1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 -- 172.21.15.150:0/3212899996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655c1a1bd0 con 0x7f655c104f50 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f655a000640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c104f50 0x7f655c19a4f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6548031440 tx=0x7f6548031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.946+0000 7f6553400640 1 -- 172.21.15.150:0/3212899996 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654803f070 con 0x7f655c104f50 2024-09-15T22:22:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.947+0000 7f6553400640 1 -- 172.21.15.150:0/3212899996 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6548003cd0 con 0x7f655c104f50 2024-09-15T22:22:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.947+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655c1a1e60 con 0x7f655c104f50 2024-09-15T22:22:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.947+0000 7f6553400640 1 -- 172.21.15.150:0/3212899996 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548035070 con 0x7f655c104f50 2024-09-15T22:22:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.947+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655c1a22d0 con 0x7f655c104f50 2024-09-15T22:22:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.949+0000 7f6564c31740 1 Processor -- start 2024-09-15T22:22:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 -- start start 2024-09-15T22:22:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d6d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d72490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d74f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55df69cd2100 con 0x55df69d6d9d0 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55df69c7a1b0 con 0x55df69d6d090 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6564c31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df69cce0c0 con 0x55df69d72a60 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f6553400640 1 -- 172.21.15.150:0/3212899996 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f654803b560 con 0x7f655c104f50 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f655aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d72490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f655aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d72490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55034/0 (socket says 172.21.15.150:55034) 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f655aa00640 1 -- 172.21.15.150:0/2651692820 learned_addr learned my addr 172.21.15.150:0/2651692820 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f655b400640 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d6d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.950+0000 7f655a000640 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d74f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655aa00640 1 -- 172.21.15.150:0/2651692820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 msgr2=0x55df69d74f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655aa00640 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d74f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655aa00640 1 -- 172.21.15.150:0/2651692820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 msgr2=0x55df69d6d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655aa00640 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d6d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655aa00640 1 -- 172.21.15.150:0/2651692820 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df699e5210 con 0x55df69d6d9d0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655b400640 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d6d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f655aa00640 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d72490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f654c00bcb0 tx=0x7f654c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7de325f5a0437e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f6547e00640 1 -- 172.21.15.150:0/2651692820 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c005020 con 0x55df69d6d9d0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f6547e00640 1 -- 172.21.15.150:0/2651692820 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f654c0047a0 con 0x55df69d6d9d0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f6547e00640 1 -- 172.21.15.150:0/2651692820 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c0116a0 con 0x55df69d6d9d0 2024-09-15T22:22:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.951+0000 7f6553400640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65400a3370 0x7f65400a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6553400640 1 -- 172.21.15.150:0/3212899996 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f65480efd30 con 0x7f655c104f50 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f655b400640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65400a3370 0x7f65400a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 -- 172.21.15.150:0/2651692820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 msgr2=0x55df69d72490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d72490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f654c00bcb0 tx=0x7f654c0107a0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 -- 172.21.15.150:0/2651692820 shutdown_connections 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d74f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d72490 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 --2- 172.21.15.150:0/2651692820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d6d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 -- 172.21.15.150:0/2651692820 >> 172.21.15.150:0/2651692820 conn(0x55df69d68700 msgr2=0x55df69d68b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 -- 172.21.15.150:0/2651692820 shutdown_connections 2024-09-15T22:22:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f6564c31740 1 -- 172.21.15.150:0/2651692820 wait complete. 2024-09-15T22:22:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.952+0000 7f655b400640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65400a3370 0x7f65400a5830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65540049d0 tx=0x7f6554009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 -- start start 2024-09-15T22:22:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 Processor -- start 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d77220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d77760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55df69d75a30 con 0x55df69d72a60 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55df69c5b090 con 0x55df69d6d9d0 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df69d75bb0 con 0x55df69d6d090 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.953+0000 7f6564c31740 10 client.0 _ll_register_callbacks cb 0x55df69caff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d77220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d77220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:45420/0 (socket says 172.21.15.150:45420) 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 -- 172.21.15.150:0/610478967 learned_addr learned my addr 172.21.15.150:0/610478967 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655a000640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d77760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655b400640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 -- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 msgr2=0x55df69d77760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d77760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 -- 172.21.15.150:0/610478967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 msgr2=0x55df69d7e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 -- 172.21.15.150:0/610478967 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df69ab1620 con 0x55df69d6d090 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f655aa00640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d77220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f654c00b5f0 tx=0x7f654c004b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5178c6ba5ad04a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.954+0000 7f6544c00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6544c00640 1 -- 172.21.15.150:0/610478967 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c02b060 con 0x55df69d6d090 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6544c00640 1 -- 172.21.15.150:0/610478967 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f654c0051e0 con 0x55df69d6d090 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f654c0047a0 con 0x55df69d6d090 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6544c00640 1 -- 172.21.15.150:0/610478967 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f654c0053e0 con 0x55df69d6d090 2024-09-15T22:22:02.963 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6564c31740 10 client.25738 fetch_fsmap learned FSMap version 49 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55df69d81590 con 0x55df69d6d090 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6544c00640 1 -- 172.21.15.150:0/610478967 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f654c0047a0 con 0x55df69d6d090 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.955+0000 7f6544c00640 1 -- 172.21.15.150:0/610478967 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f654c01b430 con 0x55df69d6d090 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6564c31740 10 client.25738 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6564c31740 10 client.25738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6564c31740 20 client.25738 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6564c31740 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69d829f0 0x55df69d84de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6564c31740 4 client.25738 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df69cdf830 con 0x55df69d829f0 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f655a000640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69d829f0 0x55df69d84de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f655a000640 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69d829f0 0x55df69d84de0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e14db4f1e42dd0e server_cookie=f0e2ff20ca2f6bc4 in_seq=0 out_seq=0 2024-09-15T22:22:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.956+0000 7f6544c00640 10 client.25738 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6544c00640 1 -- 172.21.15.150:0/610478967 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df69cdf830 con 0x55df69d829f0 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6544c00640 10 client.25738 handle_command_reply: tid=0 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 client.25738 shutdown 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 msgr2=0x55df69d77220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d77220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f654c00b5f0 tx=0x7f654c004b80 comp rx=0 tx=0).stop 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 shutdown_connections 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69d829f0 0x55df69d84de0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d77760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6564c31740 1 --2- 172.21.15.150:0/610478967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d77220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.958+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 >> 172.21.15.150:0/610478967 conn(0x55df69d68700 msgr2=0x55df69d69f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.957+0000 7f6544c00640 0 client.25738 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.958+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 shutdown_connections 2024-09-15T22:22:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.958+0000 7f6564c31740 1 -- 172.21.15.150:0/610478967 wait complete. 2024-09-15T22:22:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.958+0000 7f6564c31740 20 client.25738 trim_cache size 0 max 16384 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 Processor -- start 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 -- start start 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d7e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d67770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ab1c0 con 0x55df69d6d9d0 2024-09-15T22:22:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ad000 con 0x55df69d6d090 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f6564c31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ab950 con 0x55df69d72a60 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f655a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d7e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f655a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d7e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55052/0 (socket says 172.21.15.150:55052) 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f655a000640 1 -- 172.21.15.150:0/2093477756 learned_addr learned my addr 172.21.15.150:0/2093477756 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f655aa00640 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.973+0000 7f655b400640 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d67770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655a000640 1 -- 172.21.15.150:0/2093477756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 msgr2=0x55df69d67770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655a000640 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d67770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655a000640 1 -- 172.21.15.150:0/2093477756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 msgr2=0x55df69d777f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655a000640 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d777f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655a000640 1 -- 172.21.15.150:0/2093477756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df69d68520 con 0x55df69d6d9d0 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655b400640 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d67770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f655a000640 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d7e6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f65480b87d0 tx=0x7f654802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6591bd8af05947f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f6547400640 1 -- 172.21.15.150:0/2093477756 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548048040 con 0x55df69d6d9d0 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f6547400640 1 -- 172.21.15.150:0/2093477756 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65480bc370 con 0x55df69d6d9d0 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.974+0000 7f6547400640 1 -- 172.21.15.150:0/2093477756 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480c4aa0 con 0x55df69d6d9d0 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 -- 172.21.15.150:0/2093477756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 msgr2=0x55df69d7e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d7e6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f65480b87d0 tx=0x7f654802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 -- 172.21.15.150:0/2093477756 shutdown_connections 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d72a60 0x55df69d67770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d6d9d0 0x55df69d7e6c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 --2- 172.21.15.150:0/2093477756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d090 0x55df69d777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 -- 172.21.15.150:0/2093477756 >> 172.21.15.150:0/2093477756 conn(0x55df69d68700 msgr2=0x55df69d67060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 -- 172.21.15.150:0/2093477756 shutdown_connections 2024-09-15T22:22:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 -- 172.21.15.150:0/2093477756 wait complete. 2024-09-15T22:22:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 -- start start 2024-09-15T22:22:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.975+0000 7f6564c31740 1 Processor -- start 2024-09-15T22:22:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d7bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ac870 con 0x55df69d72a60 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ac0e0 con 0x55df69d6d9d0 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1a91a0 con 0x55df69d6d090 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f6564c31740 10 client.0 _ll_register_callbacks cb 0x7f654c00bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55054/0 (socket says 172.21.15.150:55054) 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 -- 172.21.15.150:0/1759443048 learned_addr learned my addr 172.21.15.150:0/1759443048 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655a000640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d7bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655aa00640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 -- 172.21.15.150:0/1759443048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 msgr2=0x55df69d7ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d7ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 -- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 msgr2=0x55df69d7bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d7bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655b400640 1 -- 172.21.15.150:0/1759443048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df69d7d560 con 0x55df69d72a60 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655aa00640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d7ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.976+0000 7f655a000640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d7bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f655b400640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7cf50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f655400fd70 tx=0x7f6554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd98bcc096f2f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6544c00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6544c00640 1 -- 172.21.15.150:0/1759443048 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655402f060 con 0x55df69d72a60 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65480bc370 con 0x55df69d72a60 2024-09-15T22:22:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6544c00640 1 -- 172.21.15.150:0/1759443048 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f655401db20 con 0x55df69d72a60 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6544c00640 1 -- 172.21.15.150:0/1759443048 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f655401dd20 con 0x55df69d72a60 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6564c31740 10 client.15729 fetch_fsmap learned FSMap version 49 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55df69d7e900 con 0x55df69d72a60 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.977+0000 7f6544c00640 1 -- 172.21.15.150:0/1759443048 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65480bc370 con 0x55df69d72a60 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6544c00640 1 -- 172.21.15.150:0/1759443048 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f6554035670 con 0x55df69d72a60 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6564c31740 10 client.15729 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6564c31740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6564c31740 20 client.15729 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6564c31740 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69dede20 0x55df69df0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6564c31740 4 client.15729 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df69cd9b80 con 0x55df69dede20 2024-09-15T22:22:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f655aa00640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69dede20 0x55df69df0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f655aa00640 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69dede20 0x55df69df0240 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46fdc1385f3ad19a server_cookie=3e618ed174494058 in_seq=0 out_seq=0 2024-09-15T22:22:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.978+0000 7f6544c00640 10 client.15729 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.990+0000 7f6544c00640 1 -- 172.21.15.150:0/1759443048 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df69cd9b80 con 0x55df69dede20 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.990+0000 7f6544c00640 10 client.15729 handle_command_reply: tid=0 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.990+0000 7f6564c31740 1 client.15729 shutdown 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 msgr2=0x55df69d7cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7cf50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f655400fd70 tx=0x7f6554004a40 comp rx=0 tx=0).stop 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 shutdown_connections 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55df69dede20 0x55df69df0240 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df69d72a60 0x55df69d7cf50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df69d6d9d0 0x55df69d7bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6544c00640 0 client.15729 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 --2- 172.21.15.150:0/1759443048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df69d6d090 0x55df69d7ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 >> 172.21.15.150:0/1759443048 conn(0x55df69d68700 msgr2=0x55df69d67880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 shutdown_connections 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 1 -- 172.21.15.150:0/1759443048 wait complete. 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.991+0000 7f6564c31740 20 client.15729 trim_cache size 0 max 16384 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:22:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:22:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:22:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:22:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65400a3370 msgr2=0x7f65400a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65400a3370 0x7f65400a5830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65540049d0 tx=0x7f6554009500 comp rx=0 tx=0).stop 2024-09-15T22:22:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c104f50 msgr2=0x7f655c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c104f50 0x7f655c19a4f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6548031440 tx=0x7f6548031b60 comp rx=0 tx=0).stop 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 shutdown_connections 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f65400a3370 0x7f65400a5830 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c105910 0x7f655c1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c104f50 0x7f655c19a4f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 --2- 172.21.15.150:0/3212899996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f655c103d60 0x7f655c199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 >> 172.21.15.150:0/3212899996 conn(0x7f655c0ff4e0 msgr2=0x7f655c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 shutdown_connections 2024-09-15T22:22:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:02.992+0000 7f6561c00640 1 -- 172.21.15.150:0/3212899996 wait complete. 2024-09-15T22:22:03.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:03 smithi154 ceph-mon[34853]: pgmap v654: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 392 op/s 2024-09-15T22:22:03.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:03 smithi150 ceph-mon[30886]: pgmap v654: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 392 op/s 2024-09-15T22:22:03.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:03 smithi169 ceph-mon[35850]: pgmap v654: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 392 op/s 2024-09-15T22:22:05.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:05 smithi154 ceph-mon[34853]: pgmap v655: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 395 op/s 2024-09-15T22:22:05.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:05 smithi150 ceph-mon[30886]: pgmap v655: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 395 op/s 2024-09-15T22:22:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:05 smithi169 ceph-mon[35850]: pgmap v655: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 395 op/s 2024-09-15T22:22:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:07 smithi154 ceph-mon[34853]: pgmap v656: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-09-15T22:22:07.828 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:07 smithi150 ceph-mon[30886]: pgmap v656: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-09-15T22:22:07.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:07 smithi169 ceph-mon[35850]: pgmap v656: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-09-15T22:22:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:08 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:08.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:08 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:08.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:08 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:09.637 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:09 smithi150 ceph-mon[30886]: pgmap v657: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 327 op/s 2024-09-15T22:22:09.712 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:09 smithi169 ceph-mon[35850]: pgmap v657: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 327 op/s 2024-09-15T22:22:09.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:09 smithi154 ceph-mon[34853]: pgmap v657: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 327 op/s 2024-09-15T22:22:11.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:10 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:10 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:11.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:10 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:12.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:12.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:12.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:11 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:12.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:11 smithi169 ceph-mon[35850]: pgmap v658: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 310 op/s 2024-09-15T22:22:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:11 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:12.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:11 smithi154 ceph-mon[34853]: pgmap v658: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 310 op/s 2024-09-15T22:22:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:12.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:11 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:22:12.427 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:11 smithi150 ceph-mon[30886]: pgmap v658: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 310 op/s 2024-09-15T22:22:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:13 smithi154 ceph-mon[34853]: pgmap v659: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 262 op/s 2024-09-15T22:22:13.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:13 smithi150 ceph-mon[30886]: pgmap v659: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 262 op/s 2024-09-15T22:22:13.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:13 smithi169 ceph-mon[35850]: pgmap v659: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 262 op/s 2024-09-15T22:22:15.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:15 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:22:15.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:15 smithi154 ceph-mon[34853]: pgmap v660: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 385 op/s 2024-09-15T22:22:15.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:15 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:22:15.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:15 smithi150 ceph-mon[30886]: pgmap v660: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 385 op/s 2024-09-15T22:22:15.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:15 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:22:15.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:15 smithi169 ceph-mon[35850]: pgmap v660: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 385 op/s 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.146+0000 7fa7c0c00640 1 -- 172.21.15.150:0/4166173737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 msgr2=0x7fa7bc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.146+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/4166173737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc103f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac009900 tx=0x7fa7ac02a3f0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.146+0000 7fa7c0c00640 1 -- 172.21.15.150:0/4166173737 shutdown_connections 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.147+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/4166173737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc105720 0x7fa7bc10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.147+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/4166173737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc104d60 0x7fa7bc1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.147+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/4166173737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc103f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.147+0000 7fa7c0c00640 1 -- 172.21.15.150:0/4166173737 >> 172.21.15.150:0/4166173737 conn(0x7fa7bc0ff2f0 msgr2=0x7fa7bc101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.147+0000 7fa7c0c00640 1 -- 172.21.15.150:0/4166173737 shutdown_connections 2024-09-15T22:22:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.147+0000 7fa7c0c00640 1 -- 172.21.15.150:0/4166173737 wait complete. 2024-09-15T22:22:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 Processor -- start 2024-09-15T22:22:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 -- start start 2024-09-15T22:22:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc104d60 0x7fa7bc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc105720 0x7fa7bc1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc10f840 con 0x7fa7bc104d60 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc10f6c0 con 0x7fa7bc103b70 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7c0c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc10f9c0 con 0x7fa7bc105720 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53202/0 (socket says 172.21.15.150:53202) 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7bb400640 1 -- 172.21.15.150:0/1239384472 learned_addr learned my addr 172.21.15.150:0/1239384472 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7baa00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc104d60 0x7fa7bc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.148+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc105720 0x7fa7bc1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7bb400640 1 -- 172.21.15.150:0/1239384472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc105720 msgr2=0x7fa7bc1a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7bb400640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc105720 0x7fa7bc1a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7bb400640 1 -- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc104d60 msgr2=0x7fa7bc19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7bb400640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc104d60 0x7fa7bc19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7bb400640 1 -- 172.21.15.150:0/1239384472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1a1ac0 con 0x7fa7bc103b70 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7bb400640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc199ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac031440 tx=0x7fa7ac032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7b3e00640 1 -- 172.21.15.150:0/1239384472 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac03f030 con 0x7fa7bc103b70 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7b3e00640 1 -- 172.21.15.150:0/1239384472 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac003ce0 con 0x7fa7bc103b70 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a1d50 con 0x7fa7bc103b70 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7b3e00640 1 -- 172.21.15.150:0/1239384472 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac035070 con 0x7fa7bc103b70 2024-09-15T22:22:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.149+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a21d0 con 0x7fa7bc103b70 2024-09-15T22:22:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.153+0000 7fa7c51ff740 1 Processor -- start 2024-09-15T22:22:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.153+0000 7fa7c51ff740 1 -- start start 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 0x55a855294660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294ba0 0x55a855299660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855299c30 0x55a85529c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a8551f9100 con 0x55a855294ba0 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8551a11b0 con 0x55a855294260 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a8551f50c0 con 0x55a855299c30 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7b3e00640 1 -- 172.21.15.150:0/1239384472 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa7ac042030 con 0x7fa7bc103b70 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 0x55a855294660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 0x55a855294660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53210/0 (socket says 172.21.15.150:53210) 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3055511104 learned_addr learned my addr 172.21.15.150:0/3055511104 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bb400640 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294ba0 0x55a855299660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7baa00640 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855299c30 0x55a85529c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3055511104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855299c30 msgr2=0x55a85529c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855299c30 0x55a85529c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3055511104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294ba0 msgr2=0x55a855299660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294ba0 0x55a855299660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3055511104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a854f0c210 con 0x55a855294260 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.154+0000 7fa7baa00640 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855299c30 0x55a85529c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.155+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 0x55a855294660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009fd0 tx=0x7fa7b4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aea1ecb7571a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.155+0000 7fa7a7e00640 1 -- 172.21.15.150:0/3055511104 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4011700 con 0x55a855294260 2024-09-15T22:22:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.155+0000 7fa7a7e00640 1 -- 172.21.15.150:0/3055511104 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4011d80 con 0x55a855294260 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.155+0000 7fa7a7e00640 1 -- 172.21.15.150:0/3055511104 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b401a380 con 0x55a855294260 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7b3e00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa7a00a32c0 0x7fa7a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3055511104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 msgr2=0x55a855294660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 0x55a855294660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009fd0 tx=0x7fa7b4010860 comp rx=0 tx=0).stop 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3055511104 shutdown_connections 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855299c30 0x55a85529c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294ba0 0x55a855299660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3055511104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855294260 0x55a855294660 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3055511104 >> 172.21.15.150:0/3055511104 conn(0x55a85528f8d0 msgr2=0x55a85528fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7b3e00640 1 -- 172.21.15.150:0/1239384472 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa7ac0f01e0 con 0x7fa7bc103b70 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7bb400640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa7a00a32c0 0x7fa7a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3055511104 shutdown_connections 2024-09-15T22:22:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.156+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3055511104 wait complete. 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7bb400640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa7a00a32c0 0x7fa7a00a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b9140 tx=0x7fa7ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 -- start start 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 Processor -- start 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294260 0x55a85529e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 0x55a85529e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855299c30 0x55a8552a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a85529cc00 con 0x55a855294260 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a855182090 con 0x55a855299c30 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a85529cd80 con 0x55a855294ba0 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.157+0000 7fa7c51ff740 10 client.0 _ll_register_callbacks cb 0x55a8551d6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294260 0x55a85529e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.167 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 0x55a85529e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 0x55a85529e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:53980/0 (socket says 172.21.15.150:53980) 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 -- 172.21.15.150:0/2495345007 learned_addr learned my addr 172.21.15.150:0/2495345007 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855299c30 0x55a8552a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 -- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855299c30 msgr2=0x55a8552a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855299c30 0x55a8552a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 -- 172.21.15.150:0/2495345007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294260 msgr2=0x55a85529e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294260 0x55a85529e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 -- 172.21.15.150:0/2495345007 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a854fd8620 con 0x55a855294ba0 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294260 0x55a85529e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7baa00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 0x55a85529e9e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80136e0 tx=0x7fa7a8013ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d4919cd5f83616 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:22:16.168 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7a4c00640 1 -- 172.21.15.150:0/2495345007 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8004440 con 0x55a855294ba0 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7b4011d80 con 0x55a855294ba0 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.158+0000 7fa7a4c00640 1 -- 172.21.15.150:0/2495345007 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa7a80119c0 con 0x55a855294ba0 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7a4c00640 1 -- 172.21.15.150:0/2495345007 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa7a8011bc0 con 0x55a855294ba0 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 10 client.25750 fetch_fsmap learned FSMap version 50 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a8552a88a0 con 0x55a855294ba0 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7a4c00640 1 -- 172.21.15.150:0/2495345007 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4011d80 con 0x55a855294ba0 2024-09-15T22:22:16.169 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7a4c00640 1 -- 172.21.15.150:0/2495345007 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7fa7a801a070 con 0x55a855294ba0 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 10 client.25750 fetch_fsmap finished waiting for FSMap version 50 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 10 client.25750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 20 client.25750 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a8552aa050 0x55a8552ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 4 client.25750 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.159+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a855206830 con 0x55a8552aa050 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.160+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a8552aa050 0x55a8552ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.160+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a8552aa050 0x55a8552ac490 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c72f4f86cc1e00 server_cookie=e443ad3c9d39c544 in_seq=0 out_seq=0 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.160+0000 7fa7a4c00640 10 client.25750 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:16.171 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7a4c00640 1 -- 172.21.15.150:0/2495345007 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a855206830 con 0x55a8552aa050 2024-09-15T22:22:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7a4c00640 10 client.25750 handle_command_reply: tid=0 2024-09-15T22:22:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 client.25750 shutdown 2024-09-15T22:22:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 msgr2=0x55a85529e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 0x55a85529e9e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80136e0 tx=0x7fa7a8013ba0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 shutdown_connections 2024-09-15T22:22:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a8552aa050 0x55a8552ac490 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a855299c30 0x55a8552a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294ba0 0x55a85529e9e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/2495345007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a855294260 0x55a85529e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7a4c00640 0 client.25750 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.161+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 >> 172.21.15.150:0/2495345007 conn(0x55a85528f8d0 msgr2=0x55a8552910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.162+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 shutdown_connections 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.162+0000 7fa7c51ff740 1 -- 172.21.15.150:0/2495345007 wait complete. 2024-09-15T22:22:16.174 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.162+0000 7fa7c51ff740 20 client.25750 trim_cache size 0 max 16384 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.177+0000 7fa7c51ff740 1 Processor -- start 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.177+0000 7fa7c51ff740 1 -- start start 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 0x55a855294640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 0x55a8552a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a855290750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1ab080 con 0x55a85528f8d0 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1acec0 con 0x55a8552997c0 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1ab810 con 0x55a855294260 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 0x55a855294640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7baa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 0x55a8552a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 0x55a855294640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53236/0 (socket says 172.21.15.150:53236) 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7baa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 0x55a8552a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53854/0 (socket says 172.21.15.150:53854) 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3153301669 learned_addr learned my addr 172.21.15.150:0/3153301669 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3153301669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 msgr2=0x55a855290750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a855290750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3153301669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 msgr2=0x55a8552a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 0x55a8552a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7bbe00640 1 -- 172.21.15.150:0/3153301669 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a855295080 con 0x55a8552997c0 2024-09-15T22:22:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.178+0000 7fa7baa00640 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 0x55a8552a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 0x55a855294640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009f70 tx=0x7fa7b4009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e941e1322350d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7a7400640 1 -- 172.21.15.150:0/3153301669 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b402f030 con 0x55a8552997c0 2024-09-15T22:22:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7a7400640 1 -- 172.21.15.150:0/3153301669 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4003970 con 0x55a8552997c0 2024-09-15T22:22:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7a7400640 1 -- 172.21.15.150:0/3153301669 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4025040 con 0x55a8552997c0 2024-09-15T22:22:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3153301669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 msgr2=0x55a855294640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 0x55a855294640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009f70 tx=0x7fa7b4009280 comp rx=0 tx=0).stop 2024-09-15T22:22:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3153301669 shutdown_connections 2024-09-15T22:22:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a855290750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a85528f8d0 0x55a8552a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/3153301669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8552997c0 0x55a855294640 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.179+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3153301669 >> 172.21.15.150:0/3153301669 conn(0x55a85528aa50 msgr2=0x55a855295de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.180+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3153301669 shutdown_connections 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.180+0000 7fa7c51ff740 1 -- 172.21.15.150:0/3153301669 wait complete. 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.180+0000 7fa7c51ff740 1 -- start start 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.180+0000 7fa7c51ff740 1 Processor -- start 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.180+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 0x55a8552a3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.180+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a8552a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7c51ff740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a8552997c0 0x55a8552a4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1ac730 con 0x55a8552997c0 2024-09-15T22:22:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1abfa0 con 0x55a85528f8d0 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7c51ff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1a9060 con 0x55a855294260 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7c51ff740 10 client.0 _ll_register_callbacks cb 0x7fa7a8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 0x55a8552a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 0x55a8552a3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:53242/0 (socket says 172.21.15.150:53242) 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 -- 172.21.15.150:0/57612257 learned_addr learned my addr 172.21.15.150:0/57612257 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a8552997c0 0x55a8552a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7baa00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a8552a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 -- 172.21.15.150:0/57612257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 msgr2=0x55a8552a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a8552a3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 -- 172.21.15.150:0/57612257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a8552997c0 msgr2=0x55a8552a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a8552997c0 0x55a8552a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7bbe00640 1 -- 172.21.15.150:0/57612257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8552a4b20 con 0x55a85528f8d0 2024-09-15T22:22:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.181+0000 7fa7baa00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a8552a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7bbe00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 0x55a8552a3010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa7b401c8b0 tx=0x7fa7b401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0b27ecb0a7ddde server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7a4c00640 1 -- 172.21.15.150:0/57612257 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b402f040 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7b4003970 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7a4c00640 1 -- 172.21.15.150:0/57612257 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa7b4011700 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7a4c00640 1 -- 172.21.15.150:0/57612257 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa7b402ae80 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 10 client.25763 fetch_fsmap learned FSMap version 50 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a855314d70 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7a4c00640 1 -- 172.21.15.150:0/57612257 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4003970 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7a4c00640 1 -- 172.21.15.150:0/57612257 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7fa7b402a850 con 0x55a85528f8d0 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 10 client.25763 fetch_fsmap finished waiting for FSMap version 50 2024-09-15T22:22:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 10 client.25763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 20 client.25763 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.182+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a855294ba0 0x55a8553174b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.183+0000 7fa7c51ff740 4 client.25763 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.183+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a855200b80 con 0x55a855294ba0 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.183+0000 7fa7baa00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a855294ba0 0x55a8553174b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.183+0000 7fa7baa00640 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a855294ba0 0x55a8553174b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b12356c849c510f server_cookie=3c6e83e3057009e7 in_seq=0 out_seq=0 2024-09-15T22:22:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.183+0000 7fa7a4c00640 10 client.25763 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.205+0000 7fa7a4c00640 1 -- 172.21.15.150:0/57612257 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a855200b80 con 0x55a855294ba0 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.205+0000 7fa7a4c00640 10 client.25763 handle_command_reply: tid=0 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.205+0000 7fa7c51ff740 1 client.25763 shutdown 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.205+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 msgr2=0x55a8552a3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.205+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 0x55a8552a3010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa7b401c8b0 tx=0x7fa7b401c480 comp rx=0 tx=0).stop 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 shutdown_connections 2024-09-15T22:22:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55a855294ba0 0x55a8553174b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a8552997c0 0x55a8552a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7a4c00640 0 client.25763 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a855294260 0x55a8552a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 --2- 172.21.15.150:0/57612257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a85528f8d0 0x55a8552a3010 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 >> 172.21.15.150:0/57612257 conn(0x55a85528aa50 msgr2=0x55a85528e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 shutdown_connections 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 1 -- 172.21.15.150:0/57612257 wait complete. 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.206+0000 7fa7c51ff740 20 client.25763 trim_cache size 0 max 16384 2024-09-15T22:22:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:22:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:22:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:22:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:22:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa7a00a32c0 msgr2=0x7fa7a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa7a00a32c0 0x7fa7a00a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b9140 tx=0x7fa7ac009260 comp rx=0 tx=0).stop 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 msgr2=0x7fa7bc199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc199ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac031440 tx=0x7fa7ac032ce0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 shutdown_connections 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc105720 0x7fa7bc1a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa7a00a32c0 0x7fa7a00a5780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7bc104d60 0x7fa7bc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 --2- 172.21.15.150:0/1239384472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7bc103b70 0x7fa7bc199ea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 >> 172.21.15.150:0/1239384472 conn(0x7fa7bc0ff2f0 msgr2=0x7fa7bc108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 shutdown_connections 2024-09-15T22:22:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:16.207+0000 7fa7c0c00640 1 -- 172.21.15.150:0/1239384472 wait complete. 2024-09-15T22:22:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:17 smithi154 ceph-mon[34853]: pgmap v661: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 362 op/s 2024-09-15T22:22:17.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:17 smithi150 ceph-mon[30886]: pgmap v661: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 362 op/s 2024-09-15T22:22:17.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:17 smithi169 ceph-mon[35850]: pgmap v661: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 362 op/s 2024-09-15T22:22:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:19 smithi154 ceph-mon[34853]: pgmap v662: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 507 op/s 2024-09-15T22:22:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:19 smithi150 ceph-mon[30886]: pgmap v662: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 507 op/s 2024-09-15T22:22:19.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:19 smithi169 ceph-mon[35850]: pgmap v662: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 507 op/s 2024-09-15T22:22:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:21 smithi154 ceph-mon[34853]: pgmap v663: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 542 op/s 2024-09-15T22:22:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:21 smithi150 ceph-mon[30886]: pgmap v663: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 542 op/s 2024-09-15T22:22:21.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:21 smithi169 ceph-mon[35850]: pgmap v663: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 542 op/s 2024-09-15T22:22:23.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:23 smithi154 ceph-mon[34853]: pgmap v664: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 537 op/s 2024-09-15T22:22:23.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:23 smithi150 ceph-mon[30886]: pgmap v664: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 537 op/s 2024-09-15T22:22:23.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:23 smithi169 ceph-mon[35850]: pgmap v664: 97 pgs: 97 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 537 op/s 2024-09-15T22:22:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:25 smithi154 ceph-mon[34853]: pgmap v665: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 671 op/s 2024-09-15T22:22:25.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:25 smithi150 ceph-mon[30886]: pgmap v665: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 671 op/s 2024-09-15T22:22:25.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:25 smithi169 ceph-mon[35850]: pgmap v665: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 671 op/s 2024-09-15T22:22:27.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:27 smithi154 ceph-mon[34853]: pgmap v666: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 549 op/s 2024-09-15T22:22:27.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:27 smithi150 ceph-mon[30886]: pgmap v666: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 549 op/s 2024-09-15T22:22:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:27 smithi169 ceph-mon[35850]: pgmap v666: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 549 op/s 2024-09-15T22:22:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.348+0000 7f0d82c00640 1 -- 172.21.15.150:0/1589263125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c105910 msgr2=0x7f0d7c10c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.348+0000 7f0d82c00640 1 --2- 172.21.15.150:0/1589263125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c105910 0x7f0d7c10c1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009ca0 tx=0x7f0d7402a8b0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 -- 172.21.15.150:0/1589263125 shutdown_connections 2024-09-15T22:22:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 --2- 172.21.15.150:0/1589263125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c105910 0x7f0d7c10c1a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 --2- 172.21.15.150:0/1589263125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c104f50 0x7f0d7c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 --2- 172.21.15.150:0/1589263125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d7c103d60 0x7f0d7c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 -- 172.21.15.150:0/1589263125 >> 172.21.15.150:0/1589263125 conn(0x7f0d7c0ff4e0 msgr2=0x7f0d7c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 -- 172.21.15.150:0/1589263125 shutdown_connections 2024-09-15T22:22:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.349+0000 7f0d82c00640 1 -- 172.21.15.150:0/1589263125 wait complete. 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 Processor -- start 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 -- start start 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 0x7f0d7c199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c104f50 0x7f0d7c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d7c105910 0x7f0d7c1a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c10f9c0 con 0x7f0d7c104f50 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c10f840 con 0x7f0d7c103d60 2024-09-15T22:22:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d82c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c10fb40 con 0x7f0d7c105910 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 0x7f0d7c199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 0x7f0d7c199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:43592/0 (socket says 172.21.15.150:43592) 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d7be00640 1 -- 172.21.15.150:0/4265090787 learned_addr learned my addr 172.21.15.150:0/4265090787 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d80c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d7c105910 0x7f0d7c1a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.350+0000 7f0d73400640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c104f50 0x7f0d7c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d7be00640 1 -- 172.21.15.150:0/4265090787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d7c105910 msgr2=0x7f0d7c1a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d7be00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d7c105910 0x7f0d7c1a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d7be00640 1 -- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c104f50 msgr2=0x7f0d7c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d7be00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c104f50 0x7f0d7c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d7be00640 1 -- 172.21.15.150:0/4265090787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c1a1b50 con 0x7f0d7c103d60 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d7be00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 0x7f0d7c199f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d950 tx=0x7f0d6c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d79600640 1 -- 172.21.15.150:0/4265090787 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c017020 con 0x7f0d7c103d60 2024-09-15T22:22:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c1a1e40 con 0x7f0d7c103d60 2024-09-15T22:22:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d79600640 1 -- 172.21.15.150:0/4265090787 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d6c009c30 con 0x7f0d7c103d60 2024-09-15T22:22:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d79600640 1 -- 172.21.15.150:0/4265090787 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00f6b0 con 0x7f0d7c103d60 2024-09-15T22:22:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.351+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1a22a0 con 0x7f0d7c103d60 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.354+0000 7f0d85be0740 1 Processor -- start 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.354+0000 7f0d85be0740 1 -- start start 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.354+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 0x55c4617ec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.354+0000 7f0d79600640 1 -- 172.21.15.150:0/4265090787 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f0d6c01a020 con 0x7f0d7c103d60 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.354+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617ec9d0 0x55c4617f1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.354+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 0x55c4617f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d85be0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c461751100 con 0x55c4617ec9d0 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d85be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c4616f91b0 con 0x55c4617f1a60 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d85be0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c46174d0c0 con 0x55c4617ec090 2024-09-15T22:22:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 0x55c4617ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d73400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 0x55c4617f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617ec9d0 0x55c4617f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d73400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 0x55c4617f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:43608/0 (socket says 172.21.15.150:43608) 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 0x55c4617ec490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44470/0 (socket says 172.21.15.150:44470) 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d73400640 1 -- 172.21.15.150:0/4273627008 learned_addr learned my addr 172.21.15.150:0/4273627008 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 -- 172.21.15.150:0/4273627008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 msgr2=0x55c4617f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 0x55c4617f3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 -- 172.21.15.150:0/4273627008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617ec9d0 msgr2=0x55c4617f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617ec9d0 0x55c4617f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 -- 172.21.15.150:0/4273627008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c461464210 con 0x55c4617ec090 2024-09-15T22:22:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d73400640 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 0x55c4617f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.355+0000 7f0d80c00640 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 0x55c4617ec490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006010 tx=0x7f0d74009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbe36935aebac6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d71200640 1 -- 172.21.15.150:0/4273627008 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74030a30 con 0x55c4617ec090 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d71200640 1 -- 172.21.15.150:0/4273627008 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d74036030 con 0x55c4617ec090 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d71200640 1 -- 172.21.15.150:0/4273627008 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740046b0 con 0x55c4617ec090 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d79600640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0d600a32f0 0x7f0d600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d85be0740 1 -- 172.21.15.150:0/4273627008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 msgr2=0x55c4617ec490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d85be0740 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 0x55c4617ec490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006010 tx=0x7f0d74009a20 comp rx=0 tx=0).stop 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d79600640 1 -- 172.21.15.150:0/4265090787 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f0d6c0cf920 con 0x7f0d7c103d60 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d7be00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0d600a32f0 0x7f0d600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d85be0740 1 -- 172.21.15.150:0/4273627008 shutdown_connections 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d85be0740 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617f1a60 0x55c4617f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.356+0000 7f0d85be0740 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617ec9d0 0x55c4617f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d85be0740 1 --2- 172.21.15.150:0/4273627008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec090 0x55c4617ec490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d85be0740 1 -- 172.21.15.150:0/4273627008 >> 172.21.15.150:0/4273627008 conn(0x55c4617e7700 msgr2=0x55c4617e7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d85be0740 1 -- 172.21.15.150:0/4273627008 shutdown_connections 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d85be0740 1 -- 172.21.15.150:0/4273627008 wait complete. 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d7be00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0d600a32f0 0x7f0d600a57b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0cfbc0 tx=0x7f0d6c0d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d85be0740 1 -- start start 2024-09-15T22:22:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.357+0000 7f0d85be0740 1 Processor -- start 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617f6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55c4617f49d0 con 0x55c4617f1a60 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c4616da090 con 0x55c4617ec090 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c4617f4b50 con 0x55c4617ec9d0 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d85be0740 10 client.0 _ll_register_callbacks cb 0x55c46172ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d80c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d80c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617f6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44486/0 (socket says 172.21.15.150:44486) 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 -- 172.21.15.150:0/497251322 learned_addr learned my addr 172.21.15.150:0/497251322 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 -- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 msgr2=0x55c4617f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 -- 172.21.15.150:0/497251322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 msgr2=0x55c4617fd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d73400640 1 -- 172.21.15.150:0/497251322 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c461530620 con 0x55c4617ec9d0 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.358+0000 7f0d80c00640 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d73400640 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617f6810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d640126e0 tx=0x7f0d64012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd825dd67dc0b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d69600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:22:29.367 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d69600640 1 -- 172.21.15.150:0/497251322 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64012110 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d74036030 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d69600640 1 -- 172.21.15.150:0/497251322 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f0d64004050 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d69600640 1 -- 172.21.15.150:0/497251322 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f0d64022030 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d85be0740 10 client.25765 fetch_fsmap learned FSMap version 50 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55c4618006f0 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.359+0000 7f0d69600640 1 -- 172.21.15.150:0/497251322 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d74036030 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d69600640 1 -- 172.21.15.150:0/497251322 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7f0d640038c0 con 0x55c4617ec9d0 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d85be0740 10 client.25765 fetch_fsmap finished waiting for FSMap version 50 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d85be0740 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d85be0740 20 client.25765 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d85be0740 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c461801e30 0x55c461804250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d85be0740 4 client.25765 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c46175e830 con 0x55c461801e30 2024-09-15T22:22:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.360+0000 7f0d80c00640 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c461801e30 0x55c461804250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.361+0000 7f0d80c00640 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c461801e30 0x55c461804250 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4bb2f00472c4258 server_cookie=9f3d24c65180a3c3 in_seq=0 out_seq=0 2024-09-15T22:22:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.361+0000 7f0d69600640 10 client.25765 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.361+0000 7f0d69600640 1 -- 172.21.15.150:0/497251322 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c46175e830 con 0x55c461801e30 2024-09-15T22:22:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.361+0000 7f0d69600640 10 client.25765 handle_command_reply: tid=0 2024-09-15T22:22:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 client.25765 shutdown 2024-09-15T22:22:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 msgr2=0x55c4617f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617f6810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d640126e0 tx=0x7f0d64012ba0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 shutdown_connections 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c461801e30 0x55c461804250 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617f6810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d69600640 0 client.25765 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 --2- 172.21.15.150:0/497251322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 >> 172.21.15.150:0/497251322 conn(0x55c4617e7700 msgr2=0x55c4617e8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 shutdown_connections 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 1 -- 172.21.15.150:0/497251322 wait complete. 2024-09-15T22:22:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.362+0000 7f0d85be0740 20 client.25765 trim_cache size 0 max 16384 2024-09-15T22:22:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 Processor -- start 2024-09-15T22:22:29.380 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 -- start start 2024-09-15T22:22:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617e8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617e8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1ab1c0 con 0x55c4617f1a60 2024-09-15T22:22:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1ad000 con 0x55c4617ec090 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.378+0000 7f0d85be0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1ab950 con 0x55c4617ec9d0 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44496/0 (socket says 172.21.15.150:44496) 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 -- 172.21.15.150:0/1799772303 learned_addr learned my addr 172.21.15.150:0/1799772303 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d80c00640 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d80c00640 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 -- 172.21.15.150:0/1799772303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 msgr2=0x55c4617e8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617e8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 -- 172.21.15.150:0/1799772303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 msgr2=0x55c4617e8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617e8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d73400640 1 -- 172.21.15.150:0/1799772303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4617ed7a0 con 0x55c4617ec9d0 2024-09-15T22:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.379+0000 7f0d80c00640 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.380+0000 7f0d73400640 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fd7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d640126b0 tx=0x7f0d640275c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976e8b83575b0563 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.380+0000 7f0d6be00640 1 -- 172.21.15.150:0/1799772303 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64034070 con 0x55c4617ec9d0 2024-09-15T22:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.380+0000 7f0d6be00640 1 -- 172.21.15.150:0/1799772303 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d64003ad0 con 0x55c4617ec9d0 2024-09-15T22:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.380+0000 7f0d6be00640 1 -- 172.21.15.150:0/1799772303 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d640050c0 con 0x55c4617ec9d0 2024-09-15T22:22:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.381+0000 7f0d85be0740 1 -- 172.21.15.150:0/1799772303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 msgr2=0x55c4617fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.381+0000 7f0d85be0740 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fd7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d640126b0 tx=0x7f0d640275c0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 -- 172.21.15.150:0/1799772303 shutdown_connections 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fd7a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 --2- 172.21.15.150:0/1799772303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 -- 172.21.15.150:0/1799772303 >> 172.21.15.150:0/1799772303 conn(0x55c4617e7700 msgr2=0x55c4617edcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 -- 172.21.15.150:0/1799772303 shutdown_connections 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 -- 172.21.15.150:0/1799772303 wait complete. 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.382+0000 7f0d85be0740 1 -- start start 2024-09-15T22:22:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 Processor -- start 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1ac870 con 0x55c4617f1a60 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1ac0e0 con 0x55c4617ec090 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1a91a0 con 0x55c4617ec9d0 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d85be0740 10 client.0 _ll_register_callbacks cb 0x7f0d64009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d73400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d73400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44512/0 (socket says 172.21.15.150:44512) 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.383+0000 7f0d73400640 1 -- 172.21.15.150:0/3355287722 learned_addr learned my addr 172.21.15.150:0/3355287722 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d80c00640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d80c00640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d73400640 1 -- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 msgr2=0x55c4617faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d73400640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617faaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d73400640 1 -- 172.21.15.150:0/3355287722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 msgr2=0x55c4617fbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d73400640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d73400640 1 -- 172.21.15.150:0/3355287722 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4617fc600 con 0x55c4617ec9d0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d73400640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fafe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0d640093b0 tx=0x7f0d64005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b8041fe14d9b386 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.384+0000 7f0d69600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.385+0000 7f0d69600640 1 -- 172.21.15.150:0/3355287722 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64034070 con 0x55c4617ec9d0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.385+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c461758b80 con 0x55c4617ec9d0 2024-09-15T22:22:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.385+0000 7f0d69600640 1 -- 172.21.15.150:0/3355287722 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f0d64023040 con 0x55c4617ec9d0 2024-09-15T22:22:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.385+0000 7f0d69600640 1 -- 172.21.15.150:0/3355287722 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f0d64003800 con 0x55c4617ec9d0 2024-09-15T22:22:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 10 client.25771 fetch_fsmap learned FSMap version 50 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55c4617fd910 con 0x55c4617ec9d0 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d69600640 1 -- 172.21.15.150:0/3355287722 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c461758b80 con 0x55c4617ec9d0 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d69600640 1 -- 172.21.15.150:0/3355287722 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7f0d64027a60 con 0x55c4617ec9d0 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 10 client.25771 fetch_fsmap finished waiting for FSMap version 50 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 10 client.25771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 20 client.25771 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c46186d0e0 0x55c46186f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 4 client.25771 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.386+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4616d57c0 con 0x55c46186d0e0 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.387+0000 7f0d80c00640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c46186d0e0 0x55c46186f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.387+0000 7f0d69600640 10 client.25771 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.387+0000 7f0d80c00640 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c46186d0e0 0x55c46186f500 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c9d6506d0343537 server_cookie=59d969d039ffaa88 in_seq=0 out_seq=0 2024-09-15T22:22:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.404+0000 7f0d69600640 1 -- 172.21.15.150:0/3355287722 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4616d57c0 con 0x55c46186d0e0 2024-09-15T22:22:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.404+0000 7f0d69600640 10 client.25771 handle_command_reply: tid=0 2024-09-15T22:22:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 client.25771 shutdown 2024-09-15T22:22:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 msgr2=0x55c4617fafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fafe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0d640093b0 tx=0x7f0d64005f10 comp rx=0 tx=0).stop 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 shutdown_connections 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55c46186d0e0 0x55c46186f500 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c4617f1a60 0x55c4617fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4617ec9d0 0x55c4617fafe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 --2- 172.21.15.150:0/3355287722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4617ec090 0x55c4617faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d69600640 0 client.25771 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 >> 172.21.15.150:0/3355287722 conn(0x55c4617e7700 msgr2=0x55c4617e6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 shutdown_connections 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 1 -- 172.21.15.150:0/3355287722 wait complete. 2024-09-15T22:22:29.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.405+0000 7f0d85be0740 20 client.25771 trim_cache size 0 max 16384 2024-09-15T22:22:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:22:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:22:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:22:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:22:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0d600a32f0 msgr2=0x7f0d600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0d600a32f0 0x7f0d600a57b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0cfbc0 tx=0x7f0d6c0d5530 comp rx=0 tx=0).stop 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 msgr2=0x7f0d7c199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 0x7f0d7c199f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d950 tx=0x7f0d6c00de10 comp rx=0 tx=0).stop 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 shutdown_connections 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d7c105910 0x7f0d7c1a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f0d600a32f0 0x7f0d600a57b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c104f50 0x7f0d7c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 --2- 172.21.15.150:0/4265090787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7c103d60 0x7f0d7c199f30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 >> 172.21.15.150:0/4265090787 conn(0x7f0d7c0ff4e0 msgr2=0x7f0d7c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 shutdown_connections 2024-09-15T22:22:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:29.406+0000 7f0d82c00640 1 -- 172.21.15.150:0/4265090787 wait complete. 2024-09-15T22:22:29.760 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:29 smithi150 ceph-mon[30886]: pgmap v667: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 539 op/s 2024-09-15T22:22:29.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:29 smithi154 ceph-mon[34853]: pgmap v667: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 539 op/s 2024-09-15T22:22:29.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:29 smithi169 ceph-mon[35850]: pgmap v667: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 539 op/s 2024-09-15T22:22:31.761 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:31 smithi169 ceph-mon[35850]: pgmap v668: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 393 op/s 2024-09-15T22:22:31.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:31 smithi154 ceph-mon[34853]: pgmap v668: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 393 op/s 2024-09-15T22:22:31.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:31 smithi150 ceph-mon[30886]: pgmap v668: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 393 op/s 2024-09-15T22:22:33.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:33 smithi154 ceph-mon[34853]: pgmap v669: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 968 KiB/s wr, 295 op/s 2024-09-15T22:22:33.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:33 smithi150 ceph-mon[30886]: pgmap v669: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 968 KiB/s wr, 295 op/s 2024-09-15T22:22:33.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:33 smithi169 ceph-mon[35850]: pgmap v669: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 968 KiB/s wr, 295 op/s 2024-09-15T22:22:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:35 smithi154 ceph-mon[34853]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 361 op/s 2024-09-15T22:22:35.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:35 smithi150 ceph-mon[30886]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 361 op/s 2024-09-15T22:22:35.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:35 smithi169 ceph-mon[35850]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 361 op/s 2024-09-15T22:22:37.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:37 smithi154 ceph-mon[34853]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 866 KiB/s wr, 231 op/s 2024-09-15T22:22:37.827 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:37 smithi150 ceph-mon[30886]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 866 KiB/s wr, 231 op/s 2024-09-15T22:22:37.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:37 smithi169 ceph-mon[35850]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 866 KiB/s wr, 231 op/s 2024-09-15T22:22:39.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:39 smithi154 ceph-mon[34853]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-09-15T22:22:39.887 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:39 smithi150 ceph-mon[30886]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-09-15T22:22:39.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:39 smithi169 ceph-mon[35850]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-09-15T22:22:41.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:41 smithi150 ceph-mon[30886]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-09-15T22:22:41.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:41 smithi154 ceph-mon[34853]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-09-15T22:22:41.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:41 smithi169 ceph-mon[35850]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.531+0000 7f2922600640 1 -- 172.21.15.150:0/725285528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c103500 msgr2=0x7f291c109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.531+0000 7f2922600640 1 --2- 172.21.15.150:0/725285528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c103500 0x7f291c109d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2914009ca0 tx=0x7f291402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 -- 172.21.15.150:0/725285528 shutdown_connections 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 --2- 172.21.15.150:0/725285528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c103500 0x7f291c109d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 --2- 172.21.15.150:0/725285528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f291c102b40 0x7f291c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 --2- 172.21.15.150:0/725285528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c101950 0x7f291c101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 -- 172.21.15.150:0/725285528 >> 172.21.15.150:0/725285528 conn(0x7f291c0fd0d0 msgr2=0x7f291c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 -- 172.21.15.150:0/725285528 shutdown_connections 2024-09-15T22:22:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.532+0000 7f2922600640 1 -- 172.21.15.150:0/725285528 wait complete. 2024-09-15T22:22:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 Processor -- start 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 -- start start 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 0x7f291c197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f291c102b40 0x7f291c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c103500 0x7f291c19f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f291c10d600 con 0x7f291c102b40 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f291c10d480 con 0x7f291c101950 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2922600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f291c10d780 con 0x7f291c103500 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2921200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 0x7f291c197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f291be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f291c102b40 0x7f291c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2921200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 0x7f291c197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:58616/0 (socket says 172.21.15.150:58616) 2024-09-15T22:22:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.533+0000 7f2921200640 1 -- 172.21.15.150:0/2721692630 learned_addr learned my addr 172.21.15.150:0/2721692630 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921c00640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c103500 0x7f291c19f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921200640 1 -- 172.21.15.150:0/2721692630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c103500 msgr2=0x7f291c19f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921200640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c103500 0x7f291c19f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921200640 1 -- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f291c102b40 msgr2=0x7f291c198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921200640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f291c102b40 0x7f291c198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921200640 1 -- 172.21.15.150:0/2721692630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c19f860 con 0x7f291c101950 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2921200640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 0x7f291c197c50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f291000e9c0 tx=0x7f291000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2919600640 1 -- 172.21.15.150:0/2721692630 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291000cd80 con 0x7f291c101950 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c19fb50 con 0x7f291c101950 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2919600640 1 -- 172.21.15.150:0/2721692630 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29100035f0 con 0x7f291c101950 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2919600640 1 -- 172.21.15.150:0/2721692630 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910010690 con 0x7f291c101950 2024-09-15T22:22:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.534+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c1a00a0 con 0x7f291c101950 2024-09-15T22:22:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 Processor -- start 2024-09-15T22:22:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 -- start start 2024-09-15T22:22:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d090271660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d090276660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902790f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d0901d6100 con 0x55d090271ba0 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d09017e1b0 con 0x55d090276c30 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.537+0000 7f29269d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d0901d20c0 con 0x55d090271260 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902790f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f2919600640 1 -- 172.21.15.150:0/2721692630 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f29100037a0 con 0x7f291c101950 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902790f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:58628/0 (socket says 172.21.15.150:58628) 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 -- 172.21.15.150:0/2354618961 learned_addr learned my addr 172.21.15.150:0/2354618961 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f2921c00640 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d090271660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 -- 172.21.15.150:0/2354618961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 msgr2=0x55d090271660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d090271660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 -- 172.21.15.150:0/2354618961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 msgr2=0x55d090276660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.543 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f2921200640 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d090276660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d090276660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 -- 172.21.15.150:0/2354618961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08fee9210 con 0x55d090276c30 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f2921200640 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d090276660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.538+0000 7f291be00640 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902790f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2908009cf0 tx=0x7f2908011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04b517b207ad44a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.539+0000 7f290e000640 1 -- 172.21.15.150:0/2354618961 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908004230 con 0x55d090276c30 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.539+0000 7f290e000640 1 -- 172.21.15.150:0/2354618961 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29080043d0 con 0x55d090276c30 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.539+0000 7f290e000640 1 -- 172.21.15.150:0/2354618961 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080198f0 con 0x55d090276c30 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.539+0000 7f2919600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29040a3240 0x7f29040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 -- 172.21.15.150:0/2354618961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 msgr2=0x55d0902790f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902790f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2908009cf0 tx=0x7f2908011810 comp rx=0 tx=0).stop 2024-09-15T22:22:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f2919600640 1 -- 172.21.15.150:0/2721692630 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f29100cfeb0 con 0x7f291c101950 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f2921c00640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29040a3240 0x7f29040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 -- 172.21.15.150:0/2354618961 shutdown_connections 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902790f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d090276660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 --2- 172.21.15.150:0/2354618961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d090271660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 -- 172.21.15.150:0/2354618961 >> 172.21.15.150:0/2354618961 conn(0x55d09026c8d0 msgr2=0x55d09026ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 -- 172.21.15.150:0/2354618961 shutdown_connections 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 -- 172.21.15.150:0/2354618961 wait complete. 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f29269d9740 1 -- start start 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.540+0000 7f2921c00640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29040a3240 0x7f29040a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2914031c10 tx=0x7f2914005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 Processor -- start 2024-09-15T22:22:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d09027b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d09027b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902828e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d090279c00 con 0x55d090271ba0 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d09015f090 con 0x55d090276c30 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d090279d80 con 0x55d090271260 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f29269d9740 10 client.0 _ll_register_callbacks cb 0x55d0901b3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f2921c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902828e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f2921200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d09027b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f2921c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902828e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:58636/0 (socket says 172.21.15.150:58636) 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f2921c00640 1 -- 172.21.15.150:0/2875178991 learned_addr learned my addr 172.21.15.150:0/2875178991 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.541+0000 7f291be00640 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d09027b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2921200640 1 -- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 msgr2=0x55d0902828e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2921200640 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902828e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2921200640 1 -- 172.21.15.150:0/2875178991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 msgr2=0x55d09027b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2921200640 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d09027b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2921200640 1 -- 172.21.15.150:0/2875178991 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08ffb5620 con 0x55d090271260 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2921200640 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d09027b360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55d0902725d0 tx=0x7f291009c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cbc0c8ba8c9c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2902a00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2902a00640 1 -- 172.21.15.150:0/2875178991 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100b4020 con 0x55d090271260 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2902a00640 1 -- 172.21.15.150:0/2875178991 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f291009b890 con 0x55d090271260 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29080043d0 con 0x55d090271260 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f2902a00640 1 -- 172.21.15.150:0/2875178991 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f291009c440 con 0x55d090271260 2024-09-15T22:22:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f29269d9740 10 client.25783 fetch_fsmap learned FSMap version 50 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.542+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55d090285760 con 0x55d090271260 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f2902a00640 1 -- 172.21.15.150:0/2875178991 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29080043d0 con 0x55d090271260 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f2902a00640 1 -- 172.21.15.150:0/2875178991 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7f291009b420 con 0x55d090271260 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f29269d9740 10 client.25783 fetch_fsmap finished waiting for FSMap version 50 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f29269d9740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f29269d9740 20 client.25783 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f29269d9740 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d090286e50 0x55d0902892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f29269d9740 4 client.25783 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0901e3830 con 0x55d090286e50 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.543+0000 7f291be00640 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d090286e50 0x55d0902892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.544+0000 7f291be00640 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d090286e50 0x55d0902892c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa30d7ea30d5478 server_cookie=15c19ef5de502d14 in_seq=0 out_seq=0 2024-09-15T22:22:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.544+0000 7f2902a00640 10 client.25783 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f2902a00640 1 -- 172.21.15.150:0/2875178991 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0901e3830 con 0x55d090286e50 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f2902a00640 10 client.25783 handle_command_reply: tid=0 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 client.25783 shutdown 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 msgr2=0x55d09027b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d09027b360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55d0902725d0 tx=0x7f291009c070 comp rx=0 tx=0).stop 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 shutdown_connections 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d090286e50 0x55d0902892c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d0902828e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271ba0 0x55d09027b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 --2- 172.21.15.150:0/2875178991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271260 0x55d09027b360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f2902a00640 0 client.25783 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 >> 172.21.15.150:0/2875178991 conn(0x55d09026c8d0 msgr2=0x55d09026e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 shutdown_connections 2024-09-15T22:22:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 1 -- 172.21.15.150:0/2875178991 wait complete. 2024-09-15T22:22:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.545+0000 7f29269d9740 20 client.25783 trim_cache size 0 max 16384 2024-09-15T22:22:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.561+0000 7f29269d9740 1 Processor -- start 2024-09-15T22:22:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.561+0000 7f29269d9740 1 -- start start 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f29269d9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d09027b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f29269d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090271ba0 0x55d0902828a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f29269d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090276c30 0x55d09026d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f29269d9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1a8f30 con 0x55d090271260 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f29269d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1aad70 con 0x55d090271ba0 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f29269d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1a96c0 con 0x55d090276c30 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d09027b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f291be00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090271ba0 0x55d0902828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d09027b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60212/0 (socket says 172.21.15.150:60212) 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 -- 172.21.15.150:0/3283214113 learned_addr learned my addr 172.21.15.150:0/3283214113 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921c00640 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090276c30 0x55d09026d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 -- 172.21.15.150:0/3283214113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090276c30 msgr2=0x55d09026d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090276c30 0x55d09026d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 -- 172.21.15.150:0/3283214113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090271ba0 msgr2=0x55d0902828a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090271ba0 0x55d0902828a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 -- 172.21.15.150:0/3283214113 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d090272080 con 0x55d090271260 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921c00640 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090276c30 0x55d09026d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.562+0000 7f2921200640 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d09027b820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2910098d30 tx=0x7f2910003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38cb65827ff26ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f290d600640 1 -- 172.21.15.150:0/3283214113 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100b4030 con 0x55d090271260 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f290d600640 1 -- 172.21.15.150:0/3283214113 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29100a07f0 con 0x55d090271260 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f290d600640 1 -- 172.21.15.150:0/3283214113 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291009b300 con 0x55d090271260 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 -- 172.21.15.150:0/3283214113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 msgr2=0x55d09027b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d09027b820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2910098d30 tx=0x7f2910003d40 comp rx=0 tx=0).stop 2024-09-15T22:22:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 -- 172.21.15.150:0/3283214113 shutdown_connections 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090276c30 0x55d09026d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090271ba0 0x55d0902828a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 --2- 172.21.15.150:0/3283214113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d09027b820 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 -- 172.21.15.150:0/3283214113 >> 172.21.15.150:0/3283214113 conn(0x55d09026c8d0 msgr2=0x55d09027b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 -- 172.21.15.150:0/3283214113 shutdown_connections 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.563+0000 7f29269d9740 1 -- 172.21.15.150:0/3283214113 wait complete. 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 -- start start 2024-09-15T22:22:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 Processor -- start 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d090280020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271ba0 0x55d090280560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d090281570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1aa5e0 con 0x55d090271260 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1a9e50 con 0x55d090276c30 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1a6f10 con 0x55d090271ba0 2024-09-15T22:22:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.564+0000 7f29269d9740 10 client.0 _ll_register_callbacks cb 0x7f2910003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2921200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d090280020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2921200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d090280020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60216/0 (socket says 172.21.15.150:60216) 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2921200640 1 -- 172.21.15.150:0/284739175 learned_addr learned my addr 172.21.15.150:0/284739175 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271ba0 0x55d090280560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2921c00640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d090281570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 -- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 msgr2=0x55d090281570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d090281570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 -- 172.21.15.150:0/284739175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 msgr2=0x55d090280020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d090280020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 -- 172.21.15.150:0/284739175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d090281b80 con 0x55d090271ba0 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f291be00640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271ba0 0x55d090280560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29080058c0 tx=0x7f2908009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f8b4e09c76eb80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2902a00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2902a00640 1 -- 172.21.15.150:0/284739175 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908005450 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29100a07f0 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.565+0000 7f2902a00640 1 -- 172.21.15.150:0/284739175 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f29080055f0 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f2902a00640 1 -- 172.21.15.150:0/284739175 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f290803b050 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 10 client.25789 fetch_fsmap learned FSMap version 50 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55d0902fa420 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f2902a00640 1 -- 172.21.15.150:0/284739175 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29100a07f0 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f2902a00640 1 -- 172.21.15.150:0/284739175 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7f290802b740 con 0x55d090271ba0 2024-09-15T22:22:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 10 client.25789 fetch_fsmap finished waiting for FSMap version 50 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 10 client.25789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 20 client.25789 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d0902fac90 0x55d0902fd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 4 client.25789 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0901ddb80 con 0x55d0902fac90 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.566+0000 7f2921200640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d0902fac90 0x55d0902fd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.567+0000 7f2921200640 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d0902fac90 0x55d0902fd0b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b9c6b7c0655e4b server_cookie=aa934c58aea8173d in_seq=0 out_seq=0 2024-09-15T22:22:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.567+0000 7f2902a00640 10 client.25789 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:42.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f2902a00640 1 -- 172.21.15.150:0/284739175 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0901ddb80 con 0x55d0902fac90 2024-09-15T22:22:42.579 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f2902a00640 10 client.25789 handle_command_reply: tid=0 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 client.25789 shutdown 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271ba0 msgr2=0x55d090280560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271ba0 0x55d090280560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29080058c0 tx=0x7f2908009c60 comp rx=0 tx=0).stop 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 shutdown_connections 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x55d0902fac90 0x55d0902fd0b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d090276c30 0x55d090281570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d090271ba0 0x55d090280560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 --2- 172.21.15.150:0/284739175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d090271260 0x55d090280020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f2902a00640 0 client.25789 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.577+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 >> 172.21.15.150:0/284739175 conn(0x55d09026c8d0 msgr2=0x55d09026b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 shutdown_connections 2024-09-15T22:22:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f29269d9740 1 -- 172.21.15.150:0/284739175 wait complete. 2024-09-15T22:22:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f29269d9740 20 client.25789 trim_cache size 0 max 16384 2024-09-15T22:22:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:22:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:22:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:22:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29040a3240 msgr2=0x7f29040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f2922600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29040a3240 0x7f29040a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2914031c10 tx=0x7f2914005d80 comp rx=0 tx=0).stop 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 msgr2=0x7f291c197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.578+0000 7f2922600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 0x7f291c197c50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f291000e9c0 tx=0x7f291000ee80 comp rx=0 tx=0).stop 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 shutdown_connections 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f291c103500 0x7f291c19f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f29040a3240 0x7f29040a5700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f291c102b40 0x7f291c198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 --2- 172.21.15.150:0/2721692630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c101950 0x7f291c197c50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 >> 172.21.15.150:0/2721692630 conn(0x7f291c0fd0d0 msgr2=0x7f291c105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 shutdown_connections 2024-09-15T22:22:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:42.579+0000 7f2922600640 1 -- 172.21.15.150:0/2721692630 wait complete. 2024-09-15T22:22:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:43 smithi154 ceph-mon[34853]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-09-15T22:22:43.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:43 smithi150 ceph-mon[30886]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-09-15T22:22:43.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:43 smithi169 ceph-mon[35850]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-09-15T22:22:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:45 smithi154 ceph-mon[34853]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 477 op/s 2024-09-15T22:22:45.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:45 smithi150 ceph-mon[30886]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 477 op/s 2024-09-15T22:22:45.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:45 smithi169 ceph-mon[35850]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 477 op/s 2024-09-15T22:22:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:47 smithi154 ceph-mon[34853]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-09-15T22:22:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:47 smithi150 ceph-mon[30886]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-09-15T22:22:47.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:47 smithi169 ceph-mon[35850]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-09-15T22:22:49.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:49 smithi154 ceph-mon[34853]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 437 op/s 2024-09-15T22:22:49.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:49 smithi150 ceph-mon[30886]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 437 op/s 2024-09-15T22:22:49.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:49 smithi169 ceph-mon[35850]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 437 op/s 2024-09-15T22:22:51.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:51 smithi150 ceph-mon[30886]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-09-15T22:22:51.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:51 smithi154 ceph-mon[34853]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-09-15T22:22:51.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:51 smithi169 ceph-mon[35850]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-09-15T22:22:53.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:53 smithi154 ceph-mon[34853]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 383 op/s 2024-09-15T22:22:53.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:53 smithi150 ceph-mon[30886]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 383 op/s 2024-09-15T22:22:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:53 smithi169 ceph-mon[35850]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 383 op/s 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1398870600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 msgr2=0x7f8eac104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1398870600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac104160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009900 tx=0x7f8e9c02a400 comp rx=0 tx=0).stop 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1398870600 shutdown_connections 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1398870600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8eac105910 0x7f8eac10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1398870600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eac104f50 0x7f8eac1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1398870600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac104160 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1398870600 >> 172.21.15.150:0/1398870600 conn(0x7f8eac0ff4e0 msgr2=0x7f8eac101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1398870600 shutdown_connections 2024-09-15T22:22:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.697+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1398870600 wait complete. 2024-09-15T22:22:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 Processor -- start 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 -- start start 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac079fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8eac104f50 0x7f8eac07a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eac105910 0x7f8eac076b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10fa30 con 0x7f8eac105910 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10f8b0 con 0x7f8eac103d60 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8eb0e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10fbb0 con 0x7f8eac104f50 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8ea9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac079fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8ea9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac079fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:51628/0 (socket says 172.21.15.150:51628) 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.698+0000 7f8ea9e00640 1 -- 172.21.15.150:0/1431414094 learned_addr learned my addr 172.21.15.150:0/1431414094 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8eaa800640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eac105910 0x7f8eac076b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8eac104f50 0x7f8eac07a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea9e00640 1 -- 172.21.15.150:0/1431414094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8eac104f50 msgr2=0x7f8eac07a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea9e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8eac104f50 0x7f8eac07a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea9e00640 1 -- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eac105910 msgr2=0x7f8eac076b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea9e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eac105910 0x7f8eac076b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea9e00640 1 -- 172.21.15.150:0/1431414094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac0773d0 con 0x7f8eac103d60 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea9e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac079fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c031440 tx=0x7f8e9c032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea2a00640 1 -- 172.21.15.150:0/1431414094 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c03f030 con 0x7f8eac103d60 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea2a00640 1 -- 172.21.15.150:0/1431414094 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9c003ce0 con 0x7f8eac103d60 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac1a6410 con 0x7f8eac103d60 2024-09-15T22:22:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8ea2a00640 1 -- 172.21.15.150:0/1431414094 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c035070 con 0x7f8eac103d60 2024-09-15T22:22:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.699+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac1a67c0 con 0x7f8eac103d60 2024-09-15T22:22:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.702+0000 7f8ea2a00640 1 -- 172.21.15.150:0/1431414094 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f8e9c042030 con 0x7f8eac103d60 2024-09-15T22:22:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.702+0000 7f8eb3e40740 1 Processor -- start 2024-09-15T22:22:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 -- start start 2024-09-15T22:22:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c91490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712c96490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c96a60 0x560712c98f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560712bf6100 con 0x560712c96a60 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560712b9e1b0 con 0x560712c91090 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560712bf20c0 con 0x560712c919d0 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c91490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c91490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:51636/0 (socket says 172.21.15.150:51636) 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 -- 172.21.15.150:0/414661926 learned_addr learned my addr 172.21.15.150:0/414661926 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c96a60 0x560712c98f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8ea9e00640 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712c96490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 -- 172.21.15.150:0/414661926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 msgr2=0x560712c96490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712c96490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 -- 172.21.15.150:0/414661926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c96a60 msgr2=0x560712c98f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c96a60 0x560712c98f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.703+0000 7f8eaa800640 1 -- 172.21.15.150:0/414661926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560712909210 con 0x560712c91090 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8eaa800640 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c91490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009fc0 tx=0x7f8ea4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2817f78ddac8845 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8e9b400640 1 -- 172.21.15.150:0/414661926 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4003b70 con 0x560712c91090 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8ea2a00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e900a32f0 0x7f8e900a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8e9b400640 1 -- 172.21.15.150:0/414661926 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4003d10 con 0x560712c91090 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8e9b400640 1 -- 172.21.15.150:0/414661926 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011aa0 con 0x560712c91090 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8ea2a00640 1 -- 172.21.15.150:0/1431414094 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f8e9c0efef0 con 0x7f8eac103d60 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.704+0000 7f8ea9e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e900a32f0 0x7f8e900a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 -- 172.21.15.150:0/414661926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 msgr2=0x560712c91490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c91490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009fc0 tx=0x7f8ea4010860 comp rx=0 tx=0).stop 2024-09-15T22:22:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8ea9e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e900a32f0 0x7f8e900a57b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0edd30 tx=0x7f8e9c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 -- 172.21.15.150:0/414661926 shutdown_connections 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c96a60 0x560712c98f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712c96490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/414661926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c91490 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 -- 172.21.15.150:0/414661926 >> 172.21.15.150:0/414661926 conn(0x560712c8c700 msgr2=0x560712c8cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 -- 172.21.15.150:0/414661926 shutdown_connections 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 -- 172.21.15.150:0/414661926 wait complete. 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 -- start start 2024-09-15T22:22:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.705+0000 7f8eb3e40740 1 Processor -- start 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c9b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c9b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c96a60 0x560712ca2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560712c99a30 con 0x560712c919d0 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560712b7f090 con 0x560712c91090 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560712c99bb0 con 0x560712c96a60 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eb3e40740 10 client.0 _ll_register_callbacks cb 0x560712bd3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c9b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c9b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c9b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58744/0 (socket says 172.21.15.150:58744) 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c9b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:51648/0 (socket says 172.21.15.150:51648) 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8ea3e00640 1 -- 172.21.15.150:0/960691794 learned_addr learned my addr 172.21.15.150:0/960691794 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.706+0000 7f8eaa800640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c96a60 0x560712ca2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8ea3e00640 1 -- 172.21.15.150:0/960691794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c96a60 msgr2=0x560712ca2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c96a60 0x560712ca2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8ea3e00640 1 -- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 msgr2=0x560712c9b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c9b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8ea3e00640 1 -- 172.21.15.150:0/960691794 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607129d5620 con 0x560712c919d0 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8eaa800640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c96a60 0x560712ca2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c9b7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8e94005bc0 tx=0x7f8e94013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d5e30a63036f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8e8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8e8fe00640 1 -- 172.21.15.150:0/960691794 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94011dd0 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea4003d10 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8e8fe00640 1 -- 172.21.15.150:0/960691794 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f8e94004020 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.707+0000 7f8e8fe00640 1 -- 172.21.15.150:0/960691794 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8e94004220 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 10 client.15792 fetch_fsmap learned FSMap version 51 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560712ca5730 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8e8fe00640 1 -- 172.21.15.150:0/960691794 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4003d10 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8e8fe00640 1 -- 172.21.15.150:0/960691794 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 51) ==== 8438+0+0 (secure 0 0 0) 0x7f8e9401a030 con 0x560712c919d0 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 10 client.15792 fetch_fsmap finished waiting for FSMap version 51 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 20 client.15792 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:55.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712ca6ee0 0x560712ca9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 4 client.15792 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.708+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560712c03830 con 0x560712ca6ee0 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.709+0000 7f8eaa800640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712ca6ee0 0x560712ca9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.709+0000 7f8eaa800640 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712ca6ee0 0x560712ca9340 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbbfeeb29ca3b895 server_cookie=d52c9e9674104628 in_seq=0 out_seq=0 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.709+0000 7f8e8fe00640 10 client.15792 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8e8fe00640 1 -- 172.21.15.150:0/960691794 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560712c03830 con 0x560712ca6ee0 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8e8fe00640 10 client.15792 handle_command_reply: tid=0 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 client.15792 shutdown 2024-09-15T22:22:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 msgr2=0x560712c9b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c9b7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8e94005bc0 tx=0x7f8e94013b70 comp rx=0 tx=0).stop 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 shutdown_connections 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712ca6ee0 0x560712ca9340 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c96a60 0x560712ca2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c9b7e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/960691794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712c9b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8e8fe00640 0 client.15792 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 >> 172.21.15.150:0/960691794 conn(0x560712c8c700 msgr2=0x560712c8df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 shutdown_connections 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 1 -- 172.21.15.150:0/960691794 wait complete. 2024-09-15T22:22:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.710+0000 7f8eb3e40740 20 client.15792 trim_cache size 0 max 16384 2024-09-15T22:22:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 Processor -- start 2024-09-15T22:22:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 -- start start 2024-09-15T22:22:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c8c700 0x560712c91470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712ca27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c8b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1af600 con 0x560712c919d0 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b1410 con 0x560712c91090 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1afd90 con 0x560712c8c700 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712ca27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c8b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712ca27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:51656/0 (socket says 172.21.15.150:51656) 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8ea3e00640 1 -- 172.21.15.150:0/2580018338 learned_addr learned my addr 172.21.15.150:0/2580018338 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.725+0000 7f8eaa800640 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c8c700 0x560712c91470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8ea3e00640 1 -- 172.21.15.150:0/2580018338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c8c700 msgr2=0x560712c91470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c8c700 0x560712c91470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8ea3e00640 1 -- 172.21.15.150:0/2580018338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 msgr2=0x560712c8b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c8b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8ea3e00640 1 -- 172.21.15.150:0/2580018338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560712c8c520 con 0x560712c91090 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712ca27e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400f660 tx=0x7f8e9400f550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6183240c4b5c3bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8e9aa00640 1 -- 172.21.15.150:0/2580018338 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9402a070 con 0x560712c91090 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8e9aa00640 1 -- 172.21.15.150:0/2580018338 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9400f850 con 0x560712c91090 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.726+0000 7f8e9aa00640 1 -- 172.21.15.150:0/2580018338 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94004680 con 0x560712c91090 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 -- 172.21.15.150:0/2580018338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 msgr2=0x560712ca27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712ca27e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400f660 tx=0x7f8e9400f550 comp rx=0 tx=0).stop 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 -- 172.21.15.150:0/2580018338 shutdown_connections 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c919d0 0x560712c8b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c91090 0x560712ca27e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/2580018338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c8c700 0x560712c91470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 -- 172.21.15.150:0/2580018338 >> 172.21.15.150:0/2580018338 conn(0x560712c965f0 msgr2=0x560712c8b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 -- 172.21.15.150:0/2580018338 shutdown_connections 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 -- 172.21.15.150:0/2580018338 wait complete. 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 -- start start 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.727+0000 7f8eb3e40740 1 Processor -- start 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 0x560712c9f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c91090 0x560712c9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712d0fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b0cb0 con 0x560712c91090 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b0520 con 0x560712c8c700 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1ad5e0 con 0x560712c919d0 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eb3e40740 10 client.0 _ll_register_callbacks cb 0x7f8e940096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 0x560712c9f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eaa800640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 0x560712c9f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:51666/0 (socket says 172.21.15.150:51666) 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c91090 0x560712c9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eaa800640 1 -- 172.21.15.150:0/519531269 learned_addr learned my addr 172.21.15.150:0/519531269 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8eaa800640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712d0fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8ea3e00640 1 -- 172.21.15.150:0/519531269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 msgr2=0x560712d0fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712d0fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.728+0000 7f8ea3e00640 1 -- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 msgr2=0x560712c9f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 0x560712c9f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8ea3e00640 1 -- 172.21.15.150:0/519531269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560712d10200 con 0x560712c91090 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8eaa800640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 0x560712c9f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8ea3e00640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c91090 0x560712c9fd90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x560712c92310 tx=0x7f8e94011fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8d6154edae6ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8e8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8e8fe00640 1 -- 172.21.15.150:0/519531269 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9402a040 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8e8fe00640 1 -- 172.21.15.150:0/519531269 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f8e94026650 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e9400f850 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8e8fe00640 1 -- 172.21.15.150:0/519531269 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8e940117b0 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8eb3e40740 10 client.15798 fetch_fsmap learned FSMap version 51 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.729+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560712d11510 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8e8fe00640 1 -- 172.21.15.150:0/519531269 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9400f850 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8e8fe00640 1 -- 172.21.15.150:0/519531269 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 51) ==== 8438+0+0 (secure 0 0 0) 0x7f8e9401a040 con 0x560712c91090 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eb3e40740 10 client.15798 fetch_fsmap finished waiting for FSMap version 51 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eb3e40740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eb3e40740 20 client.15798 populate_metadata read hostname 'smithi150' 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712c96a60 0x560712d13f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eb3e40740 4 client.15798 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:22:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560712c87d80 con 0x560712c96a60 2024-09-15T22:22:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.730+0000 7f8eaa800640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712c96a60 0x560712d13f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.731+0000 7f8eaa800640 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712c96a60 0x560712d13f70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fce4ee6d4032c9b2 server_cookie=415fb46b5efe3195 in_seq=0 out_seq=0 2024-09-15T22:22:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.731+0000 7f8e8fe00640 10 client.15798 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.742+0000 7f8e8fe00640 1 -- 172.21.15.150:0/519531269 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560712c87d80 con 0x560712c96a60 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.742+0000 7f8e8fe00640 10 client.15798 handle_command_reply: tid=0 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 client.15798 shutdown 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c91090 msgr2=0x560712c9fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c91090 0x560712c9fd90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x560712c92310 tx=0x7f8e94011fa0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 shutdown_connections 2024-09-15T22:22:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x560712c96a60 0x560712d13f70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560712c919d0 0x560712d0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560712c91090 0x560712c9fd90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 --2- 172.21.15.150:0/519531269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560712c8c700 0x560712c9f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8e8fe00640 0 client.15798 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 >> 172.21.15.150:0/519531269 conn(0x560712c965f0 msgr2=0x560712c8b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 shutdown_connections 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 1 -- 172.21.15.150:0/519531269 wait complete. 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.743+0000 7f8eb3e40740 20 client.15798 trim_cache size 0 max 16384 2024-09-15T22:22:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:22:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:22:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:22:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:22:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e900a32f0 msgr2=0x7f8e900a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e900a32f0 0x7f8e900a57b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0edd30 tx=0x7f8e9c009260 comp rx=0 tx=0).stop 2024-09-15T22:22:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 msgr2=0x7f8eac079fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac079fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c031440 tx=0x7f8e9c032ce0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 shutdown_connections 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f8e900a32f0 0x7f8e900a57b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8eac105910 0x7f8eac076b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8eac104f50 0x7f8eac07a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 --2- 172.21.15.150:0/1431414094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eac103d60 0x7f8eac079fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 >> 172.21.15.150:0/1431414094 conn(0x7f8eac0ff4e0 msgr2=0x7f8eac108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 shutdown_connections 2024-09-15T22:22:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:22:55.744+0000 7f8eb0e00640 1 -- 172.21.15.150:0/1431414094 wait complete. 2024-09-15T22:22:55.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:55 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:22:55.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:55 smithi154 ceph-mon[34853]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-15T22:22:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:55 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:22:55.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:55 smithi150 ceph-mon[30886]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-15T22:22:55.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:55 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:22:55.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:55 smithi169 ceph-mon[35850]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-15T22:22:57.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:57 smithi154 ceph-mon[34853]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-15T22:22:57.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:57 smithi150 ceph-mon[30886]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-15T22:22:57.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:57 smithi169 ceph-mon[35850]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-15T22:22:59.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:22:59 smithi154 ceph-mon[34853]: pgmap v682: 97 pgs: 97 active+clean; 1.4 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 430 op/s 2024-09-15T22:22:59.825 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:22:59 smithi150 ceph-mon[30886]: pgmap v682: 97 pgs: 97 active+clean; 1.4 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 430 op/s 2024-09-15T22:22:59.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:22:59 smithi169 ceph-mon[35850]: pgmap v682: 97 pgs: 97 active+clean; 1.4 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 430 op/s 2024-09-15T22:23:01.761 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:01 smithi169 ceph-mon[35850]: pgmap v683: 97 pgs: 97 active+clean; 1.4 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 397 op/s 2024-09-15T22:23:01.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:01 smithi154 ceph-mon[34853]: pgmap v683: 97 pgs: 97 active+clean; 1.4 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 397 op/s 2024-09-15T22:23:01.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:01 smithi150 ceph-mon[30886]: pgmap v683: 97 pgs: 97 active+clean; 1.4 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 397 op/s 2024-09-15T22:23:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:03 smithi154 ceph-mon[34853]: pgmap v684: 97 pgs: 97 active+clean; 1.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-09-15T22:23:03.913 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:03 smithi150 ceph-mon[30886]: pgmap v684: 97 pgs: 97 active+clean; 1.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-09-15T22:23:03.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:03 smithi169 ceph-mon[35850]: pgmap v684: 97 pgs: 97 active+clean; 1.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-09-15T22:23:05.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:05 smithi154 ceph-mon[34853]: pgmap v685: 97 pgs: 97 active+clean; 1.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 474 op/s 2024-09-15T22:23:05.869 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:05 smithi150 ceph-mon[30886]: pgmap v685: 97 pgs: 97 active+clean; 1.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 474 op/s 2024-09-15T22:23:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:05 smithi169 ceph-mon[35850]: pgmap v685: 97 pgs: 97 active+clean; 1.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 474 op/s 2024-09-15T22:23:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:07 smithi154 ceph-mon[34853]: pgmap v686: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 369 op/s 2024-09-15T22:23:07.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:07 smithi150 ceph-mon[30886]: pgmap v686: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 369 op/s 2024-09-15T22:23:07.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:07 smithi169 ceph-mon[35850]: pgmap v686: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 369 op/s 2024-09-15T22:23:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 -- 172.21.15.150:0/1973252786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 msgr2=0x7f7dcc109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/1973252786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc109db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009ca0 tx=0x7f7dc402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 -- 172.21.15.150:0/1973252786 shutdown_connections 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/1973252786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc109db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/1973252786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/1973252786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc103050 0x7f7dcc103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 -- 172.21.15.150:0/1973252786 >> 172.21.15.150:0/1973252786 conn(0x7f7dcc0fd0d0 msgr2=0x7f7dcc0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 -- 172.21.15.150:0/1973252786 shutdown_connections 2024-09-15T22:23:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.866+0000 7f7dd1c00640 1 -- 172.21.15.150:0/1973252786 wait complete. 2024-09-15T22:23:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.867+0000 7f7dd1c00640 1 Processor -- start 2024-09-15T22:23:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.867+0000 7f7dd1c00640 1 -- start start 2024-09-15T22:23:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc103050 0x7f7dcc19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10d740 con 0x7f7dcc103050 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1c00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10d5c0 con 0x7f7dcc101f40 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10d8c0 con 0x7f7dcc101580 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dc3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:45682/0 (socket says 172.21.15.150:45682) 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dcbe00640 1 -- 172.21.15.150:0/3969708777 learned_addr learned my addr 172.21.15.150:0/3969708777 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dd1200640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc103050 0x7f7dcc19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dc3e00640 1 -- 172.21.15.150:0/3969708777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 msgr2=0x7f7dcc197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dc3e00640 1 -- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc103050 msgr2=0x7f7dcc19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc103050 0x7f7dcc19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dc3e00640 1 -- 172.21.15.150:0/3969708777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc19f990 con 0x7f7dcc101f40 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.868+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.869+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc1982b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e9f0 tx=0x7f7db400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.869+0000 7f7dc9600640 1 -- 172.21.15.150:0/3969708777 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400ccc0 con 0x7f7dcc101f40 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.869+0000 7f7dc9600640 1 -- 172.21.15.150:0/3969708777 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db4005020 con 0x7f7dcc101f40 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.869+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc19fc80 con 0x7f7dcc101f40 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.869+0000 7f7dc9600640 1 -- 172.21.15.150:0/3969708777 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db40049e0 con 0x7f7dcc101f40 2024-09-15T22:23:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.869+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1a0180 con 0x7f7dcc101f40 2024-09-15T22:23:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 Processor -- start 2024-09-15T22:23:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 -- start start 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05b7670 0x564bf05b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05bd040 0x564bf05bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x564bf0518100 con 0x564bf05b7670 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564bf04c01b0 con 0x564bf05b7fb0 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564bf05140c0 con 0x564bf05bd040 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.872+0000 7f7dc9600640 1 -- 172.21.15.150:0/3969708777 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f7db4005560 con 0x7f7dcc101f40 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dd1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05b7670 0x564bf05b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05bca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:59976/0 (socket says 172.21.15.150:59976) 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 -- 172.21.15.150:0/3007941823 learned_addr learned my addr 172.21.15.150:0/3007941823 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05bd040 0x564bf05bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 -- 172.21.15.150:0/3007941823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05bd040 msgr2=0x564bf05bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05bd040 0x564bf05bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 -- 172.21.15.150:0/3007941823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05b7670 msgr2=0x564bf05b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05b7670 0x564bf05b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 -- 172.21.15.150:0/3007941823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf022b210 con 0x564bf05b7fb0 2024-09-15T22:23:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.873+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05bca70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0115f0 tx=0x7f7dbc011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab4ce9e5dff846c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dc1600640 1 -- 172.21.15.150:0/3007941823 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00f6f0 con 0x564bf05b7fb0 2024-09-15T22:23:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dc1600640 1 -- 172.21.15.150:0/3007941823 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc00fd70 con 0x564bf05b7fb0 2024-09-15T22:23:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dc1600640 1 -- 172.21.15.150:0/3007941823 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0183b0 con 0x564bf05b7fb0 2024-09-15T22:23:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dc9600640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7db00a3240 0x7f7db00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dd61c3740 1 -- 172.21.15.150:0/3007941823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 msgr2=0x564bf05bca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05bca70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0115f0 tx=0x7f7dbc011ab0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.874+0000 7f7dc9600640 1 -- 172.21.15.150:0/3969708777 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7db40cf8e0 con 0x7f7dcc101f40 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd1200640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7db00a3240 0x7f7db00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 -- 172.21.15.150:0/3007941823 shutdown_connections 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05bd040 0x564bf05bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05bca70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/3007941823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05b7670 0x564bf05b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 -- 172.21.15.150:0/3007941823 >> 172.21.15.150:0/3007941823 conn(0x564bf05b2ce0 msgr2=0x564bf05b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 -- 172.21.15.150:0/3007941823 shutdown_connections 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 -- 172.21.15.150:0/3007941823 wait complete. 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 -- start start 2024-09-15T22:23:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd1200640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7db00a3240 0x7f7db00a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005e30 tx=0x7f7dc4031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.875+0000 7f7dd61c3740 1 Processor -- start 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x564bf05bffb0 con 0x564bf05bd040 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564bf04a1090 con 0x564bf05b7fb0 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564bf05c0130 con 0x564bf05b7670 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd61c3740 10 client.0 _ll_register_callbacks cb 0x564bf04f5f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:59984/0 (socket says 172.21.15.150:59984) 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 -- 172.21.15.150:0/1719318288 learned_addr learned my addr 172.21.15.150:0/1719318288 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dd1200640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 -- 172.21.15.150:0/1719318288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 msgr2=0x564bf05c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 -- 172.21.15.150:0/1719318288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 msgr2=0x564bf05c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.876+0000 7f7dc3e00640 1 -- 172.21.15.150:0/1719318288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf02f7620 con 0x564bf05b7fb0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7db40a45b0 tx=0x7f7db409b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb244249a669d48b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dba000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dba000640 1 -- 172.21.15.150:0/1719318288 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db401c040 con 0x564bf05b7fb0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dbc00fd70 con 0x564bf05b7fb0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dba000640 1 -- 172.21.15.150:0/1719318288 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7db40a4650 con 0x564bf05b7fb0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dba000640 1 -- 172.21.15.150:0/1719318288 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f7db40b8020 con 0x564bf05b7fb0 2024-09-15T22:23:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dd61c3740 10 client.25826 fetch_fsmap learned FSMap version 51 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564bf05cbce0 con 0x564bf05b7fb0 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dba000640 1 -- 172.21.15.150:0/1719318288 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc00fd70 con 0x564bf05b7fb0 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.877+0000 7f7dba000640 1 -- 172.21.15.150:0/1719318288 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 51) ==== 8438+0+0 (secure 0 0 0) 0x7f7db409b2c0 con 0x564bf05b7fb0 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dd61c3740 10 client.25826 fetch_fsmap finished waiting for FSMap version 51 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dd61c3740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dd61c3740 20 client.25826 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf05cd440 0x564bf05cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dd61c3740 4 client.25826 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bf0525830 con 0x564bf05cd440 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf05cd440 0x564bf05cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf05cd440 0x564bf05cf830 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e84c16401564eeea server_cookie=82a9c2ce23c40b1e in_seq=0 out_seq=0 2024-09-15T22:23:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.878+0000 7f7dba000640 10 client.25826 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.879+0000 7f7dba000640 1 -- 172.21.15.150:0/1719318288 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564bf0525830 con 0x564bf05cd440 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.879+0000 7f7dba000640 10 client.25826 handle_command_reply: tid=0 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.879+0000 7f7dd61c3740 1 client.25826 shutdown 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 msgr2=0x564bf05c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7db40a45b0 tx=0x7f7db409b7d0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 shutdown_connections 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf05cd440 0x564bf05cf830 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1719318288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dba000640 0 client.25826 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 >> 172.21.15.150:0/1719318288 conn(0x564bf05b2ce0 msgr2=0x564bf05b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 shutdown_connections 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1719318288 wait complete. 2024-09-15T22:23:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.880+0000 7f7dd61c3740 20 client.25826 trim_cache size 0 max 16384 2024-09-15T22:23:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 Processor -- start 2024-09-15T22:23:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 -- start start 2024-09-15T22:23:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1a6cf0 con 0x564bf05bd040 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1a8b00 con 0x564bf05b7670 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1a7480 con 0x564bf05b7fb0 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:59988/0 (socket says 172.21.15.150:59988) 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dcbe00640 1 -- 172.21.15.150:0/1392416343 learned_addr learned my addr 172.21.15.150:0/1392416343 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.895+0000 7f7dd1200640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dcbe00640 1 -- 172.21.15.150:0/1392416343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7fb0 msgr2=0x564bf05c1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dcbe00640 1 -- 172.21.15.150:0/1392416343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 msgr2=0x564bf05c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dcbe00640 1 -- 172.21.15.150:0/1392416343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf05b8d80 con 0x564bf05b7670 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dd1200640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 0x564bf05c1850 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc01b040 tx=0x7f7dbc005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e6aac63c1252ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dc0c00640 1 -- 172.21.15.150:0/1392416343 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc032070 con 0x564bf05b7670 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dc0c00640 1 -- 172.21.15.150:0/1392416343 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0195d0 con 0x564bf05b7670 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.896+0000 7f7dc0c00640 1 -- 172.21.15.150:0/1392416343 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc004680 con 0x564bf05b7670 2024-09-15T22:23:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1392416343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 msgr2=0x564bf05c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 0x564bf05c1850 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc01b040 tx=0x7f7dbc005c70 comp rx=0 tx=0).stop 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1392416343 shutdown_connections 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7fb0 0x564bf05c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/1392416343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7670 0x564bf05c1850 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1392416343 >> 172.21.15.150:0/1392416343 conn(0x564bf05b2ce0 msgr2=0x564bf05a96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1392416343 shutdown_connections 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 -- 172.21.15.150:0/1392416343 wait complete. 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.897+0000 7f7dd61c3740 1 -- start start 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 Processor -- start 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1a83a0 con 0x564bf05bd040 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1a7c10 con 0x564bf05b7fb0 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1a4cd0 con 0x564bf05b7670 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd61c3740 10 client.0 _ll_register_callbacks cb 0x7f7db409bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dc3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dc3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:60000/0 (socket says 172.21.15.150:60000) 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dc3e00640 1 -- 172.21.15.150:0/2085065445 learned_addr learned my addr 172.21.15.150:0/2085065445 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.898+0000 7f7dd1200640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dc3e00640 1 -- 172.21.15.150:0/2085065445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 msgr2=0x564bf05c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dc3e00640 1 -- 172.21.15.150:0/2085065445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 msgr2=0x564bf05c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dc3e00640 1 -- 172.21.15.150:0/2085065445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf05c7c60 con 0x564bf05b7fb0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dc3e00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c66b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7db4005480 tx=0x7f7db40cfbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e9906c5a6debe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dba000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dba000640 1 -- 172.21.15.150:0/2085065445 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db401c070 con 0x564bf05b7fb0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dba000640 1 -- 172.21.15.150:0/2085065445 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7db4097dc0 con 0x564bf05b7fb0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dbc0195d0 con 0x564bf05b7fb0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dba000640 1 -- 172.21.15.150:0/2085065445 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f7db407f070 con 0x564bf05b7fb0 2024-09-15T22:23:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dd61c3740 10 client.25832 fetch_fsmap learned FSMap version 51 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564bf05c8f70 con 0x564bf05b7fb0 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.899+0000 7f7dba000640 1 -- 172.21.15.150:0/2085065445 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0195d0 con 0x564bf05b7fb0 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dba000640 1 -- 172.21.15.150:0/2085065445 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 51) ==== 8438+0+0 (secure 0 0 0) 0x7f7db407aaa0 con 0x564bf05b7fb0 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dd61c3740 10 client.25832 fetch_fsmap finished waiting for FSMap version 51 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dd61c3740 10 client.25832 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dd61c3740 20 client.25832 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf0638540 0x564bf063a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dd61c3740 4 client.25832 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564bf051fb80 con 0x564bf0638540 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.900+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf0638540 0x564bf063a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.901+0000 7f7dba000640 10 client.25832 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.901+0000 7f7dcbe00640 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf0638540 0x564bf063a960 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ce61bc75af71cc server_cookie=6a2f20afcf5af664 in_seq=0 out_seq=0 2024-09-15T22:23:08.914 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dba000640 1 -- 172.21.15.150:0/2085065445 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564bf051fb80 con 0x564bf0638540 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dba000640 10 client.25832 handle_command_reply: tid=0 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dd61c3740 1 client.25832 shutdown 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 msgr2=0x564bf05c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c66b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7db4005480 tx=0x7f7db40cfbb0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 shutdown_connections 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x564bf0638540 0x564bf063a960 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.912+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564bf05bd040 0x564bf05c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564bf05b7fb0 0x564bf05c66b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd61c3740 1 --2- 172.21.15.150:0/2085065445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564bf05b7670 0x564bf05c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 >> 172.21.15.150:0/2085065445 conn(0x564bf05b2ce0 msgr2=0x564bf05b9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dba000640 0 client.25832 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 shutdown_connections 2024-09-15T22:23:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd61c3740 1 -- 172.21.15.150:0/2085065445 wait complete. 2024-09-15T22:23:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd61c3740 20 client.25832 trim_cache size 0 max 16384 2024-09-15T22:23:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:23:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:23:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:23:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:23:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7db00a3240 msgr2=0x7f7db00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7db00a3240 0x7f7db00a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005e30 tx=0x7f7dc4031bb0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 msgr2=0x7f7dcc1982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.913+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc1982b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e9f0 tx=0x7f7db400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 shutdown_connections 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7db00a3240 0x7f7db00a5700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dcc103050 0x7f7dcc19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc101f40 0x7f7dcc1982b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 --2- 172.21.15.150:0/3969708777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dcc101580 0x7f7dcc197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 >> 172.21.15.150:0/3969708777 conn(0x7f7dcc0fd0d0 msgr2=0x7f7dcc105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 shutdown_connections 2024-09-15T22:23:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:08.914+0000 7f7dd1c00640 1 -- 172.21.15.150:0/3969708777 wait complete. 2024-09-15T22:23:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:10 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:10.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:10 smithi150 ceph-mon[30886]: pgmap v687: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 422 op/s 2024-09-15T22:23:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:10 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:10.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:10 smithi169 ceph-mon[35850]: pgmap v687: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 422 op/s 2024-09-15T22:23:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:10 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:10.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:10 smithi154 ceph-mon[34853]: pgmap v687: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 422 op/s 2024-09-15T22:23:11.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:11 smithi154 ceph-mon[34853]: pgmap v688: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 403 op/s 2024-09-15T22:23:11.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:11 smithi150 ceph-mon[30886]: pgmap v688: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 403 op/s 2024-09-15T22:23:11.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:11 smithi169 ceph-mon[35850]: pgmap v688: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 403 op/s 2024-09-15T22:23:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:12 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.927 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:12 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:12.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:12.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:12 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:13.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:13 smithi154 ceph-mon[34853]: pgmap v689: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-09-15T22:23:13.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:13.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:13.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:13.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:13 smithi150 ceph-mon[30886]: pgmap v689: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-09-15T22:23:13.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:13.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:13.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:23:13.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:13 smithi169 ceph-mon[35850]: pgmap v689: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-09-15T22:23:15.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:15 smithi154 ceph-mon[34853]: pgmap v690: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 466 op/s 2024-09-15T22:23:15.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:15 smithi150 ceph-mon[30886]: pgmap v690: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 466 op/s 2024-09-15T22:23:15.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:15 smithi169 ceph-mon[35850]: pgmap v690: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 466 op/s 2024-09-15T22:23:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:17 smithi154 ceph-mon[34853]: pgmap v691: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-09-15T22:23:17.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:17 smithi150 ceph-mon[30886]: pgmap v691: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-09-15T22:23:17.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:17 smithi169 ceph-mon[35850]: pgmap v691: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-09-15T22:23:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:19 smithi154 ceph-mon[34853]: pgmap v692: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-09-15T22:23:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:19 smithi150 ceph-mon[30886]: pgmap v692: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-09-15T22:23:19.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:19 smithi169 ceph-mon[35850]: pgmap v692: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-09-15T22:23:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:21 smithi154 ceph-mon[34853]: pgmap v693: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 375 op/s 2024-09-15T22:23:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:21 smithi150 ceph-mon[30886]: pgmap v693: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 375 op/s 2024-09-15T22:23:21.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:21 smithi169 ceph-mon[35850]: pgmap v693: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 375 op/s 2024-09-15T22:23:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 -- 172.21.15.150:0/1895841166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4105720 msgr2=0x7f7cb410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/1895841166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4105720 0x7f7cb410bfb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009ca0 tx=0x7f7cac02a8b0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 -- 172.21.15.150:0/1895841166 shutdown_connections 2024-09-15T22:23:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/1895841166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4105720 0x7f7cb410bfb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/1895841166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb4104d60 0x7f7cb41051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/1895841166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4103b70 0x7f7cb4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 -- 172.21.15.150:0/1895841166 >> 172.21.15.150:0/1895841166 conn(0x7f7cb40ff310 msgr2=0x7f7cb4101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 -- 172.21.15.150:0/1895841166 shutdown_connections 2024-09-15T22:23:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.030+0000 7f7cb3e00640 1 -- 172.21.15.150:0/1895841166 wait complete. 2024-09-15T22:23:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 Processor -- start 2024-09-15T22:23:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 -- start start 2024-09-15T22:23:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb4103b70 0x7f7cb4199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 0x7f7cb419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4105720 0x7f7cb41a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb410f840 con 0x7f7cb4105720 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb410f6c0 con 0x7f7cb4104d60 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.031+0000 7f7cb3e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb410f9c0 con 0x7f7cb4103b70 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 0x7f7cb419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 0x7f7cb419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:50108/0 (socket says 172.21.15.150:50108) 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 -- 172.21.15.150:0/3290815844 learned_addr learned my addr 172.21.15.150:0/3290815844 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb3400640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4105720 0x7f7cb41a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb4103b70 0x7f7cb4199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 -- 172.21.15.150:0/3290815844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb4103b70 msgr2=0x7f7cb4199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb4103b70 0x7f7cb4199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 -- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4105720 msgr2=0x7f7cb41a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4105720 0x7f7cb41a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 -- 172.21.15.150:0/3290815844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb41a1a80 con 0x7f7cb4104d60 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb3400640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4105720 0x7f7cb41a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb2000640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 0x7f7cb419a3a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000e9f0 tx=0x7f7ca000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cab400640 1 -- 172.21.15.150:0/3290815844 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000cd80 con 0x7f7cb4104d60 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb41a1d70 con 0x7f7cb4104d60 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.032+0000 7f7cab400640 1 -- 172.21.15.150:0/3290815844 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca0005500 con 0x7f7cb4104d60 2024-09-15T22:23:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.033+0000 7f7cab400640 1 -- 172.21.15.150:0/3290815844 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0010690 con 0x7f7cb4104d60 2024-09-15T22:23:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.033+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb41a2210 con 0x7f7cb4104d60 2024-09-15T22:23:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 Processor -- start 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 -- start start 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 0x56363f653660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653ba0 0x56363f658660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f658c30 0x56363f65b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56363f5b8100 con 0x56363f653ba0 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56363f5601b0 con 0x56363f653260 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cbc853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56363f5b40c0 con 0x56363f658c30 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cb3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 0x56363f653660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653ba0 0x56363f658660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.041 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cb3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 0x56363f653660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:50110/0 (socket says 172.21.15.150:50110) 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cb3400640 1 -- 172.21.15.150:0/3453387336 learned_addr learned my addr 172.21.15.150:0/3453387336 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.036+0000 7f7cab400640 1 -- 172.21.15.150:0/3290815844 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f7ca00046c0 con 0x7f7cb4104d60 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7cb3400640 1 -- 172.21.15.150:0/3453387336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f658c30 msgr2=0x56363f65b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7cb3400640 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f658c30 0x56363f65b0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7cb3400640 1 -- 172.21.15.150:0/3453387336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653ba0 msgr2=0x56363f658660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7cb3400640 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653ba0 0x56363f658660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7cb3400640 1 -- 172.21.15.150:0/3453387336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363f2cb210 con 0x56363f653260 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7cb3400640 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 0x56363f653660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7cac005e30 tx=0x7f7cac009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a5edd4ecad30f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7c9fe00640 1 -- 172.21.15.150:0/3453387336 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac030a30 con 0x56363f653260 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7c9fe00640 1 -- 172.21.15.150:0/3453387336 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cac036040 con 0x56363f653260 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.037+0000 7f7c9fe00640 1 -- 172.21.15.150:0/3453387336 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac004480 con 0x56363f653260 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cab400640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7c980a3240 0x7f7c980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 -- 172.21.15.150:0/3453387336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 msgr2=0x56363f653660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 0x56363f653660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7cac005e30 tx=0x7f7cac009a20 comp rx=0 tx=0).stop 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 -- 172.21.15.150:0/3453387336 shutdown_connections 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f658c30 0x56363f65b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653ba0 0x56363f658660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3453387336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653260 0x56363f653660 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 -- 172.21.15.150:0/3453387336 >> 172.21.15.150:0/3453387336 conn(0x56363f64e8d0 msgr2=0x56363f64ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cab400640 1 -- 172.21.15.150:0/3290815844 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7ca00cfe10 con 0x7f7cb4104d60 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 -- 172.21.15.150:0/3453387336 shutdown_connections 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7c980a3240 0x7f7c980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.038+0000 7f7cbc853740 1 -- 172.21.15.150:0/3453387336 wait complete. 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 -- start start 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7c980a3240 0x7f7c980a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56363f64f750 tx=0x7f7ca4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 Processor -- start 2024-09-15T22:23:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f65d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f65d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f664960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x56363f65bba0 con 0x56363f653260 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56363f541090 con 0x56363f658c30 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56363f65bd20 con 0x56363f653ba0 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cbc853740 10 client.0 _ll_register_callbacks cb 0x56363f595f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.039+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f65d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f65d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb3400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f664960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f65d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39384/0 (socket says 172.21.15.150:39384) 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2a00640 1 -- 172.21.15.150:0/2992067964 learned_addr learned my addr 172.21.15.150:0/2992067964 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 -- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 msgr2=0x56363f664960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f664960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 -- 172.21.15.150:0/2992067964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 msgr2=0x56363f65d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f65d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 -- 172.21.15.150:0/2992067964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363f397620 con 0x56363f653ba0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cb2000640 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f65d920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ca009c100 tx=0x7f7ca009c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0192234c3c8cabd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7c9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7c9cc00640 1 -- 172.21.15.150:0/2992067964 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00b4020 con 0x56363f653ba0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cac036040 con 0x56363f653ba0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7c9cc00640 1 -- 172.21.15.150:0/2992067964 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7ca00a4be0 con 0x56363f653ba0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7c9cc00640 1 -- 172.21.15.150:0/2992067964 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f7ca009c400 con 0x56363f653ba0 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cbc853740 10 client.25834 fetch_fsmap learned FSMap version 52 2024-09-15T22:23:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.040+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56363f667870 con 0x56363f653ba0 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7c9cc00640 1 -- 172.21.15.150:0/2992067964 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cac036040 con 0x56363f653ba0 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7c9cc00640 1 -- 172.21.15.150:0/2992067964 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 52) ==== 8442+0+0 (secure 0 0 0) 0x7f7ca009b850 con 0x56363f653ba0 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cbc853740 10 client.25834 fetch_fsmap finished waiting for FSMap version 52 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cbc853740 10 client.25834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cbc853740 20 client.25834 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cbc853740 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f668fb0 0x56363f66b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cbc853740 4 client.25834 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56363f5c5830 con 0x56363f668fb0 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.041+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f668fb0 0x56363f66b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.042+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f668fb0 0x56363f66b3d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51cf41db349d74d1 server_cookie=db6406251a1268df in_seq=0 out_seq=0 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.042+0000 7f7c9cc00640 10 client.25834 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.042+0000 7f7c9cc00640 1 -- 172.21.15.150:0/2992067964 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56363f5c5830 con 0x56363f668fb0 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.042+0000 7f7c9cc00640 10 client.25834 handle_command_reply: tid=0 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.042+0000 7f7cbc853740 1 client.25834 shutdown 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 msgr2=0x56363f65d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f65d920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ca009c100 tx=0x7f7ca009c290 comp rx=0 tx=0).stop 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 shutdown_connections 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f668fb0 0x56363f66b3d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f664960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f65d920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7c9cc00640 0 client.25834 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 --2- 172.21.15.150:0/2992067964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f65d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 >> 172.21.15.150:0/2992067964 conn(0x56363f64e8d0 msgr2=0x56363f6500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 shutdown_connections 2024-09-15T22:23:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 1 -- 172.21.15.150:0/2992067964 wait complete. 2024-09-15T22:23:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.043+0000 7f7cbc853740 20 client.25834 trim_cache size 0 max 16384 2024-09-15T22:23:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 Processor -- start 2024-09-15T22:23:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 -- start start 2024-09-15T22:23:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653260 0x56363f654de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 0x56363f655320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f658c30 0x56363f664920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41aaff0 con 0x56363f658c30 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41ace30 con 0x56363f653ba0 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cbc853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41ab780 con 0x56363f653260 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cb2000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 0x56363f655320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cb2000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 0x56363f655320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:50122/0 (socket says 172.21.15.150:50122) 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cb3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f658c30 0x56363f664920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cb2000640 1 -- 172.21.15.150:0/3508080429 learned_addr learned my addr 172.21.15.150:0/3508080429 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.058+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653260 0x56363f654de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2000640 1 -- 172.21.15.150:0/3508080429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653260 msgr2=0x56363f654de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2000640 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653260 0x56363f654de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2000640 1 -- 172.21.15.150:0/3508080429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f658c30 msgr2=0x56363f664920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2000640 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f658c30 0x56363f664920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2000640 1 -- 172.21.15.150:0/3508080429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363f654080 con 0x56363f653ba0 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653260 0x56363f654de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7cb2000640 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 0x56363f655320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ca009c390 tx=0x7f7ca009a910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8377073ce91e5f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7c9f400640 1 -- 172.21.15.150:0/3508080429 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00b4070 con 0x56363f653ba0 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7c9f400640 1 -- 172.21.15.150:0/3508080429 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca00a07b0 con 0x56363f653ba0 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.059+0000 7f7c9f400640 1 -- 172.21.15.150:0/3508080429 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00a4be0 con 0x56363f653ba0 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 -- 172.21.15.150:0/3508080429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 msgr2=0x56363f655320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 0x56363f655320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ca009c390 tx=0x7f7ca009a910 comp rx=0 tx=0).stop 2024-09-15T22:23:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 -- 172.21.15.150:0/3508080429 shutdown_connections 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f658c30 0x56363f664920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f653ba0 0x56363f655320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 --2- 172.21.15.150:0/3508080429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653260 0x56363f654de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 -- 172.21.15.150:0/3508080429 >> 172.21.15.150:0/3508080429 conn(0x56363f64e8d0 msgr2=0x56363f65d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 -- 172.21.15.150:0/3508080429 shutdown_connections 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 -- 172.21.15.150:0/3508080429 wait complete. 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 -- start start 2024-09-15T22:23:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.060+0000 7f7cbc853740 1 Processor -- start 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f661b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f662040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f663050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41ac6a0 con 0x56363f653260 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41abf10 con 0x56363f658c30 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41a8fd0 con 0x56363f653ba0 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cbc853740 10 client.0 _ll_register_callbacks cb 0x7f7ca000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f661b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f661b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39402/0 (socket says 172.21.15.150:39402) 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb2a00640 1 -- 172.21.15.150:0/1184118477 learned_addr learned my addr 172.21.15.150:0/1184118477 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb3400640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f663050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb2000640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f662040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb3400640 1 -- 172.21.15.150:0/1184118477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 msgr2=0x56363f662040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb3400640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f662040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb3400640 1 -- 172.21.15.150:0/1184118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 msgr2=0x56363f661b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb3400640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f661b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb3400640 1 -- 172.21.15.150:0/1184118477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363f663660 con 0x56363f658c30 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.061+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f661b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7cb3400640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f663050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cac004af0 tx=0x7f7cac030600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e9b1715f5d7b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7c9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7c9cc00640 1 -- 172.21.15.150:0/1184118477 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac053020 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca00a07b0 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7c9cc00640 1 -- 172.21.15.150:0/1184118477 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f7cac030af0 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7c9cc00640 1 -- 172.21.15.150:0/1184118477 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f7cac030cf0 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7cbc853740 10 client.25850 fetch_fsmap learned FSMap version 52 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56363f6649c0 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.062+0000 7f7c9cc00640 1 -- 172.21.15.150:0/1184118477 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca00a07b0 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7c9cc00640 1 -- 172.21.15.150:0/1184118477 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 52) ==== 8442+0+0 (secure 0 0 0) 0x7f7cac004510 con 0x56363f658c30 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cbc853740 10 client.25850 fetch_fsmap finished waiting for FSMap version 52 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cbc853740 10 client.25850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cbc853740 20 client.25850 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cbc853740 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f6d3dc0 0x56363f6d61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cbc853740 4 client.25850 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:23:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56363f5bfb80 con 0x56363f6d3dc0 2024-09-15T22:23:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f6d3dc0 0x56363f6d61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7cb2a00640 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f6d3dc0 0x56363f6d61b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1195e952cbf5f83 server_cookie=aa151de57869d07e in_seq=0 out_seq=0 2024-09-15T22:23:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.063+0000 7f7c9cc00640 10 client.25850 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.074+0000 7f7c9cc00640 1 -- 172.21.15.150:0/1184118477 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56363f5bfb80 con 0x56363f6d3dc0 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.074+0000 7f7c9cc00640 10 client.25850 handle_command_reply: tid=0 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 client.25850 shutdown 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 msgr2=0x56363f663050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f663050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cac004af0 tx=0x7f7cac030600 comp rx=0 tx=0).stop 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 shutdown_connections 2024-09-15T22:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x56363f6d3dc0 0x56363f6d61b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56363f658c30 0x56363f663050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56363f653ba0 0x56363f662040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7c9cc00640 0 client.25850 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 --2- 172.21.15.150:0/1184118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56363f653260 0x56363f661b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 >> 172.21.15.150:0/1184118477 conn(0x56363f64e8d0 msgr2=0x56363f65d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 shutdown_connections 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 1 -- 172.21.15.150:0/1184118477 wait complete. 2024-09-15T22:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.075+0000 7f7cbc853740 20 client.25850 trim_cache size 0 max 16384 2024-09-15T22:23:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:23:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:23:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:23:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7c980a3240 msgr2=0x7f7c980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7c980a3240 0x7f7c980a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56363f64f750 tx=0x7f7ca4005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 msgr2=0x7f7cb419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 0x7f7cb419a3a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000e9f0 tx=0x7f7ca000edf0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 shutdown_connections 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f7c980a3240 0x7f7c980a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cb4105720 0x7f7cb41a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb4104d60 0x7f7cb419a3a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 --2- 172.21.15.150:0/3290815844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb4103b70 0x7f7cb4199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 >> 172.21.15.150:0/3290815844 conn(0x7f7cb40ff310 msgr2=0x7f7cb41080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 shutdown_connections 2024-09-15T22:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:22.076+0000 7f7cb3e00640 1 -- 172.21.15.150:0/3290815844 wait complete. 2024-09-15T22:23:23.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:23 smithi154 ceph-mon[34853]: pgmap v694: 97 pgs: 97 active+clean; 1.3 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 349 op/s 2024-09-15T22:23:23.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:23 smithi150 ceph-mon[30886]: pgmap v694: 97 pgs: 97 active+clean; 1.3 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 349 op/s 2024-09-15T22:23:23.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:23 smithi169 ceph-mon[35850]: pgmap v694: 97 pgs: 97 active+clean; 1.3 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 349 op/s 2024-09-15T22:23:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:25 smithi154 ceph-mon[34853]: pgmap v695: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 441 op/s 2024-09-15T22:23:25.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:25 smithi150 ceph-mon[30886]: pgmap v695: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 441 op/s 2024-09-15T22:23:25.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:25 smithi169 ceph-mon[35850]: pgmap v695: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 441 op/s 2024-09-15T22:23:27.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:27 smithi154 ceph-mon[34853]: pgmap v696: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-09-15T22:23:27.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:27 smithi150 ceph-mon[30886]: pgmap v696: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-09-15T22:23:27.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:27 smithi169 ceph-mon[35850]: pgmap v696: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-09-15T22:23:30.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:29 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:30.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:29 smithi150 ceph-mon[30886]: pgmap v697: 97 pgs: 97 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:23:30.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:29 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:30.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:29 smithi169 ceph-mon[35850]: pgmap v697: 97 pgs: 97 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:23:30.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:29 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:30.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:29 smithi154 ceph-mon[34853]: pgmap v697: 97 pgs: 97 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:23:31.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:31 smithi154 ceph-mon[34853]: pgmap v698: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-09-15T22:23:31.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:31 smithi150 ceph-mon[30886]: pgmap v698: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-09-15T22:23:31.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:31 smithi169 ceph-mon[35850]: pgmap v698: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-09-15T22:23:33.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:33 smithi154 ceph-mon[34853]: pgmap v699: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 378 op/s 2024-09-15T22:23:33.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:33 smithi150 ceph-mon[30886]: pgmap v699: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 378 op/s 2024-09-15T22:23:33.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:33 smithi169 ceph-mon[35850]: pgmap v699: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 378 op/s 2024-09-15T22:23:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 -- 172.21.15.150:0/506925915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88103050 msgr2=0x7f1d88103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 --2- 172.21.15.150:0/506925915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88103050 0x7f1d88103450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009900 tx=0x7f1d7802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 -- 172.21.15.150:0/506925915 shutdown_connections 2024-09-15T22:23:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 --2- 172.21.15.150:0/506925915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d88101f40 0x7f1d88109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 --2- 172.21.15.150:0/506925915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101580 0x7f1d88101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 --2- 172.21.15.150:0/506925915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88103050 0x7f1d88103450 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 -- 172.21.15.150:0/506925915 >> 172.21.15.150:0/506925915 conn(0x7f1d880fd0d0 msgr2=0x7f1d880ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 -- 172.21.15.150:0/506925915 shutdown_connections 2024-09-15T22:23:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.192+0000 7f1d8da00640 1 -- 172.21.15.150:0/506925915 wait complete. 2024-09-15T22:23:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 Processor -- start 2024-09-15T22:23:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 -- start start 2024-09-15T22:23:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 0x7f1d8819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101f40 0x7f1d8819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d88103050 0x7f1d881a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8810d740 con 0x7f1d88103050 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8810d5c0 con 0x7f1d88101580 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d8da00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8810d8c0 con 0x7f1d88101f40 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 0x7f1d8819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 0x7f1d8819a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:33322/0 (socket says 172.21.15.150:33322) 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d87e00640 1 -- 172.21.15.150:0/1094610729 learned_addr learned my addr 172.21.15.150:0/1094610729 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.193+0000 7f1d87400640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101f40 0x7f1d8819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d8d000640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d88103050 0x7f1d881a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87e00640 1 -- 172.21.15.150:0/1094610729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101f40 msgr2=0x7f1d8819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87e00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101f40 0x7f1d8819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87e00640 1 -- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d88103050 msgr2=0x7f1d881a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87e00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d88103050 0x7f1d881a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87e00640 1 -- 172.21.15.150:0/1094610729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d881a1c60 con 0x7f1d88101580 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87400640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101f40 0x7f1d8819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d87e00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 0x7f1d8819a040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d78031440 tx=0x7f1d78032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d84c00640 1 -- 172.21.15.150:0/1094610729 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7803f030 con 0x7f1d88101580 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d84c00640 1 -- 172.21.15.150:0/1094610729 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d78003ce0 con 0x7f1d88101580 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.194+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d881a1ef0 con 0x7f1d88101580 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.195+0000 7f1d84c00640 1 -- 172.21.15.150:0/1094610729 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78035070 con 0x7f1d88101580 2024-09-15T22:23:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.195+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d881a2300 con 0x7f1d88101580 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.197+0000 7f1d92021740 1 Processor -- start 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.197+0000 7f1d92021740 1 -- start start 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d84c00640 1 -- 172.21.15.150:0/1094610729 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f1d78042030 con 0x7f1d88101580 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d92021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09260 0x559aaba09660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d92021740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09ba0 0x559aaba0e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d92021740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d92021740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559aab96e100 con 0x559aaba09ba0 2024-09-15T22:23:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d92021740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559aab9161b0 con 0x559aaba0ec30 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d92021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559aab96a0c0 con 0x559aaba09260 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09ba0 0x559aaba0e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:33324/0 (socket says 172.21.15.150:33324) 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09ba0 0x559aaba0e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40952/0 (socket says 172.21.15.150:40952) 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d8d000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09260 0x559aaba09660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 -- 172.21.15.150:0/2783763855 learned_addr learned my addr 172.21.15.150:0/2783763855 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 -- 172.21.15.150:0/2783763855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09260 msgr2=0x559aaba09660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09260 0x559aaba09660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 -- 172.21.15.150:0/2783763855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09ba0 msgr2=0x559aaba0e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09ba0 0x559aaba0e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d87400640 1 -- 172.21.15.150:0/2783763855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aab681210 con 0x559aaba0ec30 2024-09-15T22:23:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.198+0000 7f1d8d000640 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09260 0x559aaba09660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.199+0000 7f1d87400640 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba110f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d740114f0 tx=0x7f1d740119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8233c2e61fb7af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.199+0000 7f1d7d600640 1 -- 172.21.15.150:0/2783763855 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74004020 con 0x559aaba0ec30 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.199+0000 7f1d7d600640 1 -- 172.21.15.150:0/2783763855 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d740041c0 con 0x559aaba0ec30 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.199+0000 7f1d7d600640 1 -- 172.21.15.150:0/2783763855 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400f950 con 0x559aaba0ec30 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.199+0000 7f1d84c00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1d6c0a3240 0x7f1d6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.199+0000 7f1d84c00640 1 -- 172.21.15.150:0/1094610729 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f1d780f0180 con 0x7f1d88101580 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d8d000640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1d6c0a3240 0x7f1d6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 -- 172.21.15.150:0/2783763855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 msgr2=0x559aaba110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba110f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d740114f0 tx=0x7f1d740119b0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 -- 172.21.15.150:0/2783763855 shutdown_connections 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba110f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09ba0 0x559aaba0e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 --2- 172.21.15.150:0/2783763855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09260 0x559aaba09660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 -- 172.21.15.150:0/2783763855 >> 172.21.15.150:0/2783763855 conn(0x559aaba048d0 msgr2=0x559aaba04cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 -- 172.21.15.150:0/2783763855 shutdown_connections 2024-09-15T22:23:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 -- 172.21.15.150:0/2783763855 wait complete. 2024-09-15T22:23:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d8d000640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1d6c0a3240 0x7f1d6c0a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009d50 tx=0x7f1d80009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.200+0000 7f1d92021740 1 -- start start 2024-09-15T22:23:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 Processor -- start 2024-09-15T22:23:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 0x559aaba133c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba13900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba0ec30 0x559aaba1a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559aaba11c00 con 0x559aaba0ec30 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559aab8f7090 con 0x559aaba09260 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559aaba11d80 con 0x559aaba09ba0 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d92021740 10 client.0 _ll_register_callbacks cb 0x559aab94bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 0x559aaba133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 0x559aaba133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:33336/0 (socket says 172.21.15.150:33336) 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d87e00640 1 -- 172.21.15.150:0/2182078619 learned_addr learned my addr 172.21.15.150:0/2182078619 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d8d000640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba0ec30 0x559aaba1a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.201+0000 7f1d87400640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba13900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d87e00640 1 -- 172.21.15.150:0/2182078619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 msgr2=0x559aaba13900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d87e00640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba13900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d87e00640 1 -- 172.21.15.150:0/2182078619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba0ec30 msgr2=0x559aaba1a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d87e00640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba0ec30 0x559aaba1a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d87e00640 1 -- 172.21.15.150:0/2182078619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aab74d620 con 0x559aaba09260 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d87e00640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 0x559aaba133c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d780b90e0 tx=0x7f1d78005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=630b3eaee25517c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d72000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d72000640 1 -- 172.21.15.150:0/2182078619 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78049070 con 0x559aaba09260 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d72000640 1 -- 172.21.15.150:0/2182078619 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f1d7803b460 con 0x559aaba09260 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d740041c0 con 0x559aaba09260 2024-09-15T22:23:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d72000640 1 -- 172.21.15.150:0/2182078619 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f1d780b89b0 con 0x559aaba09260 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d92021740 10 client.25862 fetch_fsmap learned FSMap version 53 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x559aaba1d730 con 0x559aaba09260 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.202+0000 7f1d72000640 1 -- 172.21.15.150:0/2182078619 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d740041c0 con 0x559aaba09260 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d72000640 1 -- 172.21.15.150:0/2182078619 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 53) ==== 8438+0+0 (secure 0 0 0) 0x7f1d780b8d80 con 0x559aaba09260 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d92021740 10 client.25862 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d92021740 10 client.25862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d92021740 20 client.25862 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d92021740 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba1ef90 0x559aaba21410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d92021740 4 client.25862 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aab97b830 con 0x559aaba1ef90 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.203+0000 7f1d87400640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba1ef90 0x559aaba21410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d87400640 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba1ef90 0x559aaba21410 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba92f6eb22ef81e server_cookie=4e6da338c6386ee0 in_seq=0 out_seq=0 2024-09-15T22:23:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d72000640 10 client.25862 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d72000640 1 -- 172.21.15.150:0/2182078619 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559aab97b830 con 0x559aaba1ef90 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d72000640 10 client.25862 handle_command_reply: tid=0 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d92021740 1 client.25862 shutdown 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 msgr2=0x559aaba133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.204+0000 7f1d92021740 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 0x559aaba133c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d780b90e0 tx=0x7f1d78005d50 comp rx=0 tx=0).stop 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 shutdown_connections 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba1ef90 0x559aaba21410 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba0ec30 0x559aaba1a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d72000640 0 client.25862 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba13900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 --2- 172.21.15.150:0/2182078619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09260 0x559aaba133c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 >> 172.21.15.150:0/2182078619 conn(0x559aaba048d0 msgr2=0x559aaba060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 shutdown_connections 2024-09-15T22:23:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 1 -- 172.21.15.150:0/2182078619 wait complete. 2024-09-15T22:23:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.205+0000 7f1d92021740 20 client.25862 trim_cache size 0 max 16384 2024-09-15T22:23:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 Processor -- start 2024-09-15T22:23:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 -- start start 2024-09-15T22:23:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba05780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba1a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba05cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881aaf70 con 0x559aaba09260 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881acd80 con 0x559aaba0ec30 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d92021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881ab700 con 0x559aaba09ba0 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba05cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba05cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:33350/0 (socket says 172.21.15.150:33350) 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 -- 172.21.15.150:0/925041952 learned_addr learned my addr 172.21.15.150:0/925041952 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d87e00640 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba05780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d87400640 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba1a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 -- 172.21.15.150:0/925041952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 msgr2=0x559aaba1a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba1a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 -- 172.21.15.150:0/925041952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 msgr2=0x559aaba05780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.220+0000 7f1d8d000640 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba05780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.221+0000 7f1d8d000640 1 -- 172.21.15.150:0/925041952 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aaba08de0 con 0x559aaba0ec30 2024-09-15T22:23:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.221+0000 7f1d8d000640 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba05cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d80004070 tx=0x7f1d8001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a9dfc526a04b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.221+0000 7f1d7cc00640 1 -- 172.21.15.150:0/925041952 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000f640 con 0x559aaba0ec30 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.221+0000 7f1d7cc00640 1 -- 172.21.15.150:0/925041952 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d8000fcc0 con 0x559aaba0ec30 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.221+0000 7f1d7cc00640 1 -- 172.21.15.150:0/925041952 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8002ae20 con 0x559aaba0ec30 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 -- 172.21.15.150:0/925041952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 msgr2=0x559aaba05cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba05cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d80004070 tx=0x7f1d8001b000 comp rx=0 tx=0).stop 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 -- 172.21.15.150:0/925041952 shutdown_connections 2024-09-15T22:23:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba0ec30 0x559aaba05cc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba09ba0 0x559aaba1a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 --2- 172.21.15.150:0/925041952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba05780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 -- 172.21.15.150:0/925041952 >> 172.21.15.150:0/925041952 conn(0x559aaba048d0 msgr2=0x559aaba137c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 -- 172.21.15.150:0/925041952 shutdown_connections 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 -- 172.21.15.150:0/925041952 wait complete. 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 -- start start 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.222+0000 7f1d92021740 1 Processor -- start 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba17cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 0x559aaba18200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba0ec30 0x559aaba191c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881ac5f0 con 0x559aaba09260 2024-09-15T22:23:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881abe60 con 0x559aaba09ba0 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881a8f50 con 0x559aaba0ec30 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d92021740 10 client.0 _ll_register_callbacks cb 0x7f1d780f38b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba17cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 0x559aaba18200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 0x559aaba18200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:33356/0 (socket says 172.21.15.150:33356) 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 -- 172.21.15.150:0/1302251159 learned_addr learned my addr 172.21.15.150:0/1302251159 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d8d000640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba0ec30 0x559aaba191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 -- 172.21.15.150:0/1302251159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba0ec30 msgr2=0x559aaba191c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba0ec30 0x559aaba191c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 -- 172.21.15.150:0/1302251159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 msgr2=0x559aaba17cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba17cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 -- 172.21.15.150:0/1302251159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aaba197d0 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87e00640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba17cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d87400640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 0x559aaba18200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d74014040 tx=0x7f1d74005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9f08aafb69cc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.223+0000 7f1d72000640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d72000640 1 -- 172.21.15.150:0/1302251159 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d740043f0 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d72000640 1 -- 172.21.15.150:0/1302251159 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f1d74016040 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d8000fcc0 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d72000640 1 -- 172.21.15.150:0/1302251159 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f1d74011260 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 10 client.25868 fetch_fsmap learned FSMap version 53 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x559aaba1aae0 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d72000640 1 -- 172.21.15.150:0/1302251159 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d8000fcc0 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d72000640 1 -- 172.21.15.150:0/1302251159 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 53) ==== 8438+0+0 (secure 0 0 0) 0x7f1d74003a60 con 0x559aaba09ba0 2024-09-15T22:23:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 10 client.25868 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 10 client.25868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 20 client.25868 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba8a260 0x559aaba8c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 4 client.25868 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.224+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559aab975b80 con 0x559aaba8a260 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.225+0000 7f1d87e00640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba8a260 0x559aaba8c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.225+0000 7f1d87e00640 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba8a260 0x559aaba8c680 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26181b18d8d608f4 server_cookie=7eaeefa6a3358577 in_seq=0 out_seq=0 2024-09-15T22:23:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.225+0000 7f1d72000640 10 client.25868 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d72000640 1 -- 172.21.15.150:0/1302251159 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559aab975b80 con 0x559aaba8a260 2024-09-15T22:23:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d72000640 10 client.25868 handle_command_reply: tid=0 2024-09-15T22:23:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 client.25868 shutdown 2024-09-15T22:23:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 msgr2=0x559aaba18200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 0x559aaba18200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d74014040 tx=0x7f1d74005da0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 shutdown_connections 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559aaba8a260 0x559aaba8c680 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aaba0ec30 0x559aaba191c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d72000640 0 client.25868 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559aaba09ba0 0x559aaba18200 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 --2- 172.21.15.150:0/1302251159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559aaba09260 0x559aaba17cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 >> 172.21.15.150:0/1302251159 conn(0x559aaba048d0 msgr2=0x559aaba031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 shutdown_connections 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 1 -- 172.21.15.150:0/1302251159 wait complete. 2024-09-15T22:23:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.237+0000 7f1d92021740 20 client.25868 trim_cache size 0 max 16384 2024-09-15T22:23:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:23:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:23:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:23:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:23:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1d6c0a3240 msgr2=0x7f1d6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1d6c0a3240 0x7f1d6c0a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009d50 tx=0x7f1d80009500 comp rx=0 tx=0).stop 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 msgr2=0x7f1d8819a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 0x7f1d8819a040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d78031440 tx=0x7f1d78032ce0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 shutdown_connections 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f1d6c0a3240 0x7f1d6c0a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d88103050 0x7f1d881a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d88101f40 0x7f1d8819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 --2- 172.21.15.150:0/1094610729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d88101580 0x7f1d8819a040 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 >> 172.21.15.150:0/1094610729 conn(0x7f1d880fd0d0 msgr2=0x7f1d88108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 shutdown_connections 2024-09-15T22:23:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:35.238+0000 7f1d8da00640 1 -- 172.21.15.150:0/1094610729 wait complete. 2024-09-15T22:23:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:35 smithi154 ceph-mon[34853]: pgmap v700: 97 pgs: 97 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 466 op/s 2024-09-15T22:23:35.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:35 smithi150 ceph-mon[30886]: pgmap v700: 97 pgs: 97 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 466 op/s 2024-09-15T22:23:35.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:35 smithi169 ceph-mon[35850]: pgmap v700: 97 pgs: 97 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 466 op/s 2024-09-15T22:23:37.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:37 smithi154 ceph-mon[34853]: pgmap v701: 97 pgs: 97 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 374 op/s 2024-09-15T22:23:37.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:37 smithi150 ceph-mon[30886]: pgmap v701: 97 pgs: 97 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 374 op/s 2024-09-15T22:23:37.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:37 smithi169 ceph-mon[35850]: pgmap v701: 97 pgs: 97 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 374 op/s 2024-09-15T22:23:40.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:39 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:40.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:39 smithi150 ceph-mon[30886]: pgmap v702: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-15T22:23:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:39 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:39 smithi169 ceph-mon[35850]: pgmap v702: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-15T22:23:40.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:39 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:23:40.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:39 smithi154 ceph-mon[34853]: pgmap v702: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 444 op/s 2024-09-15T22:23:41.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:41 smithi154 ceph-mon[34853]: pgmap v703: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-09-15T22:23:41.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:41 smithi150 ceph-mon[30886]: pgmap v703: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-09-15T22:23:41.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:41 smithi169 ceph-mon[35850]: pgmap v703: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-09-15T22:23:43.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:43 smithi154 ceph-mon[34853]: pgmap v704: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 387 op/s 2024-09-15T22:23:43.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:43 smithi150 ceph-mon[30886]: pgmap v704: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 387 op/s 2024-09-15T22:23:43.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:43 smithi169 ceph-mon[35850]: pgmap v704: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 387 op/s 2024-09-15T22:23:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:45 smithi154 ceph-mon[34853]: pgmap v705: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 481 op/s 2024-09-15T22:23:45.929 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:45 smithi150 ceph-mon[30886]: pgmap v705: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 481 op/s 2024-09-15T22:23:45.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:45 smithi169 ceph-mon[35850]: pgmap v705: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 481 op/s 2024-09-15T22:23:47.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:47 smithi154 ceph-mon[34853]: pgmap v706: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 390 op/s 2024-09-15T22:23:47.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:47 smithi150 ceph-mon[30886]: pgmap v706: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 390 op/s 2024-09-15T22:23:47.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:47 smithi169 ceph-mon[35850]: pgmap v706: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 390 op/s 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 -- 172.21.15.150:0/4154570561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 msgr2=0x7fea24074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 --2- 172.21.15.150:0/4154570561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 0x7fea24074680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea18009900 tx=0x7fea1802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 -- 172.21.15.150:0/4154570561 shutdown_connections 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 --2- 172.21.15.150:0/4154570561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea241099d0 0x7fea2410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 --2- 172.21.15.150:0/4154570561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea24074c50 0x7fea240750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 --2- 172.21.15.150:0/4154570561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 0x7fea24074680 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 -- 172.21.15.150:0/4154570561 >> 172.21.15.150:0/4154570561 conn(0x7fea240fd2e0 msgr2=0x7fea240ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 -- 172.21.15.150:0/4154570561 shutdown_connections 2024-09-15T22:23:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.366+0000 7fea2bc00640 1 -- 172.21.15.150:0/4154570561 wait complete. 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 Processor -- start 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 -- start start 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 0x7fea24199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 0x7fea2419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 0x7fea241a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410fa20 con 0x7fea241099d0 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410f8a0 con 0x7fea24076230 2024-09-15T22:23:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.367+0000 7fea2bc00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410fba0 con 0x7fea24074c50 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 0x7fea24199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 0x7fea241a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 0x7fea24199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:44682/0 (socket says 172.21.15.150:44682) 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 0x7fea241a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40702/0 (socket says 172.21.15.150:40702) 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 -- 172.21.15.150:0/2227300662 learned_addr learned my addr 172.21.15.150:0/2227300662 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea23e00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 0x7fea2419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 -- 172.21.15.150:0/2227300662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 msgr2=0x7fea2419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 0x7fea2419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 -- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 msgr2=0x7fea241a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 0x7fea241a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29200640 1 -- 172.21.15.150:0/2227300662 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea241a1bd0 con 0x7fea24074c50 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.368+0000 7fea29c00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 0x7fea241a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.369+0000 7fea29200640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 0x7fea24199fb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea18031440 tx=0x7fea18032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.369+0000 7fea21600640 1 -- 172.21.15.150:0/2227300662 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1803f030 con 0x7fea24074c50 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.369+0000 7fea21600640 1 -- 172.21.15.150:0/2227300662 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea18003ce0 con 0x7fea24074c50 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.369+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea241a1e60 con 0x7fea24074c50 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.369+0000 7fea21600640 1 -- 172.21.15.150:0/2227300662 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18035070 con 0x7fea24074c50 2024-09-15T22:23:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.369+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea241a22c0 con 0x7fea24074c50 2024-09-15T22:23:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 Processor -- start 2024-09-15T22:23:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 -- start start 2024-09-15T22:23:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad346490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad34b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad34df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5570ad2ab100 con 0x5570ad346090 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5570ad2531b0 con 0x5570ad3469d0 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.372+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570ad2a70c0 con 0x5570ad34ba60 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad346490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea23e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad34df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad346490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40718/0 (socket says 172.21.15.150:40718) 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 -- 172.21.15.150:0/1892930042 learned_addr learned my addr 172.21.15.150:0/1892930042 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 -- 172.21.15.150:0/1892930042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 msgr2=0x5570ad34df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad34df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 -- 172.21.15.150:0/1892930042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 msgr2=0x5570ad34b490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad34b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea29c00640 1 -- 172.21.15.150:0/1892930042 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570acfbe210 con 0x5570ad346090 2024-09-15T22:23:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea21600640 1 -- 172.21.15.150:0/2227300662 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fea18042030 con 0x7fea24074c50 2024-09-15T22:23:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.373+0000 7fea23e00640 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad34df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.374+0000 7fea29c00640 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad346490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0117e0 tx=0x7fea1c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b917942891d554 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.374+0000 7fea16000640 1 -- 172.21.15.150:0/1892930042 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c011310 con 0x5570ad346090 2024-09-15T22:23:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.374+0000 7fea16000640 1 -- 172.21.15.150:0/1892930042 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea1c003e50 con 0x5570ad346090 2024-09-15T22:23:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 -- 172.21.15.150:0/1892930042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 msgr2=0x5570ad346490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad346490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0117e0 tx=0x7fea1c011ca0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 -- 172.21.15.150:0/1892930042 shutdown_connections 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad34df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad34b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/1892930042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad346490 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 -- 172.21.15.150:0/1892930042 >> 172.21.15.150:0/1892930042 conn(0x5570ad341700 msgr2=0x5570ad341b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.375+0000 7fea2ea4b740 1 -- 172.21.15.150:0/1892930042 shutdown_connections 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.376+0000 7fea2ea4b740 1 -- 172.21.15.150:0/1892930042 wait complete. 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.376+0000 7fea21600640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fea0c0a3230 0x7fea0c0a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.376+0000 7fea21600640 1 -- 172.21.15.150:0/2227300662 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fea180efd90 con 0x7fea24074c50 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.376+0000 7fea2ea4b740 1 -- start start 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.376+0000 7fea23e00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fea0c0a3230 0x7fea0c0a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.376+0000 7fea2ea4b740 1 Processor -- start 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad346090 0x5570ad350290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad3507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad34ba60 0x5570ad357810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5570ad34ea80 con 0x5570ad34ba60 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5570ad234090 con 0x5570ad3469d0 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570ad34ec00 con 0x5570ad346090 2024-09-15T22:23:48.382 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea2ea4b740 10 client.0 _ll_register_callbacks cb 0x5570ad288f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea23e00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fea0c0a3230 0x7fea0c0a56f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5570ad342580 tx=0x7fea10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea29c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad34ba60 0x5570ad357810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad3507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea29200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad346090 0x5570ad350290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea29c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad34ba60 0x5570ad357810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40722/0 (socket says 172.21.15.150:40722) 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea23e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad3507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37598/0 (socket says 172.21.15.150:37598) 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.377+0000 7fea29c00640 1 -- 172.21.15.150:0/4270981029 learned_addr learned my addr 172.21.15.150:0/4270981029 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea23e00640 1 -- 172.21.15.150:0/4270981029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad346090 msgr2=0x5570ad350290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea23e00640 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad346090 0x5570ad350290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea23e00640 1 -- 172.21.15.150:0/4270981029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad34ba60 msgr2=0x5570ad357810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea23e00640 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad34ba60 0x5570ad357810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea23e00640 1 -- 172.21.15.150:0/4270981029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ad08a620 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea23e00640 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad3507d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea10009fd0 tx=0x7fea10004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74824c1c5a9e557e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea0aa00640 1 -- 172.21.15.150:0/4270981029 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10029440 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea0aa00640 1 -- 172.21.15.150:0/4270981029 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fea100295e0 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.378+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea1c003e50 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea0aa00640 1 -- 172.21.15.150:0/4270981029 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fea100297e0 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 10 client.25877 fetch_fsmap learned FSMap version 54 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5570ad35a720 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea0aa00640 1 -- 172.21.15.150:0/4270981029 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea1c003e50 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea0aa00640 1 -- 172.21.15.150:0/4270981029 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 8434+0+0 (secure 0 0 0) 0x7fea10032070 con 0x5570ad3469d0 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 10 client.25877 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:23:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 10 client.25877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 20 client.25877 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad35be60 0x5570ad35e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 4 client.25877 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.379+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570ad2b8830 con 0x5570ad35be60 2024-09-15T22:23:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.380+0000 7fea29200640 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad35be60 0x5570ad35e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.380+0000 7fea29200640 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad35be60 0x5570ad35e280 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ba8ee40b0d45fa server_cookie=ad3285946af85946 in_seq=0 out_seq=0 2024-09-15T22:23:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.380+0000 7fea0aa00640 10 client.25877 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:48.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea0aa00640 1 -- 172.21.15.150:0/4270981029 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570ad2b8830 con 0x5570ad35be60 2024-09-15T22:23:48.389 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea0aa00640 10 client.25877 handle_command_reply: tid=0 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 client.25877 shutdown 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 msgr2=0x5570ad3507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad3507d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea10009fd0 tx=0x7fea10004730 comp rx=0 tx=0).stop 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 shutdown_connections 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad35be60 0x5570ad35e280 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad34ba60 0x5570ad357810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad3469d0 0x5570ad3507d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea0aa00640 0 client.25877 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/4270981029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad346090 0x5570ad350290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.381+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 >> 172.21.15.150:0/4270981029 conn(0x5570ad341700 msgr2=0x5570ad342f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.382+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 shutdown_connections 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.382+0000 7fea2ea4b740 1 -- 172.21.15.150:0/4270981029 wait complete. 2024-09-15T22:23:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.382+0000 7fea2ea4b740 20 client.25877 trim_cache size 0 max 16384 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 Processor -- start 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 -- start start 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad347c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad3469d0 0x5570ad348150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 0x5570ad3577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea241ab1a0 con 0x5570ad346090 2024-09-15T22:23:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fea241acf80 con 0x5570ad34ba60 2024-09-15T22:23:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea241ab930 con 0x5570ad3469d0 2024-09-15T22:23:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea29200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad347c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea29c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 0x5570ad3577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea29c00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 0x5570ad3577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37604/0 (socket says 172.21.15.150:37604) 2024-09-15T22:23:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea29c00640 1 -- 172.21.15.150:0/488600185 learned_addr learned my addr 172.21.15.150:0/488600185 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.397+0000 7fea23e00640 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad3469d0 0x5570ad348150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea23e00640 1 -- 172.21.15.150:0/488600185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 msgr2=0x5570ad3577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea23e00640 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 0x5570ad3577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea23e00640 1 -- 172.21.15.150:0/488600185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 msgr2=0x5570ad347c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea23e00640 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad347c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea23e00640 1 -- 172.21.15.150:0/488600185 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ad342390 con 0x5570ad3469d0 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea29c00640 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 0x5570ad3577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.398+0000 7fea23e00640 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad3469d0 0x5570ad348150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea10019040 tx=0x7fea100040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80da9c1a1d14bd3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea15600640 1 -- 172.21.15.150:0/488600185 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10038020 con 0x5570ad3469d0 2024-09-15T22:23:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea15600640 1 -- 172.21.15.150:0/488600185 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea1002f070 con 0x5570ad3469d0 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea15600640 1 -- 172.21.15.150:0/488600185 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1001d700 con 0x5570ad3469d0 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 -- 172.21.15.150:0/488600185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad3469d0 msgr2=0x5570ad348150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad3469d0 0x5570ad348150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea10019040 tx=0x7fea100040d0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 -- 172.21.15.150:0/488600185 shutdown_connections 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad34ba60 0x5570ad3577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad3469d0 0x5570ad348150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/488600185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad346090 0x5570ad347c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.399+0000 7fea2ea4b740 1 -- 172.21.15.150:0/488600185 >> 172.21.15.150:0/488600185 conn(0x5570ad341700 msgr2=0x5570ad33c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.400+0000 7fea2ea4b740 1 -- 172.21.15.150:0/488600185 shutdown_connections 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.400+0000 7fea2ea4b740 1 -- 172.21.15.150:0/488600185 wait complete. 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.400+0000 7fea2ea4b740 1 -- start start 2024-09-15T22:23:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.400+0000 7fea2ea4b740 1 Processor -- start 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 0x5570ad354920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad3469d0 0x5570ad354e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad355e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fea241ac7f0 con 0x5570ad3469d0 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fea241ac060 con 0x5570ad346090 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea241a9180 con 0x5570ad34ba60 2024-09-15T22:23:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea2ea4b740 10 client.0 _ll_register_callbacks cb 0x7fea10012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 0x5570ad354920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 0x5570ad354920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37612/0 (socket says 172.21.15.150:37612) 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 -- 172.21.15.150:0/3651296008 learned_addr learned my addr 172.21.15.150:0/3651296008 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea23e00640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad3469d0 0x5570ad354e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29c00640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad355e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 -- 172.21.15.150:0/3651296008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 msgr2=0x5570ad355e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad355e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 -- 172.21.15.150:0/3651296008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad3469d0 msgr2=0x5570ad354e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad3469d0 0x5570ad354e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea29200640 1 -- 172.21.15.150:0/3651296008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ad356480 con 0x5570ad346090 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.401+0000 7fea23e00640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad3469d0 0x5570ad354e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea29200640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 0x5570ad354920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea18000c00 tx=0x7fea180dc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1063a561ba6f0525 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea0aa00640 1 -- 172.21.15.150:0/3651296008 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18049040 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea0aa00640 1 -- 172.21.15.150:0/3651296008 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fea1803bcd0 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea1002f070 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea0aa00640 1 -- 172.21.15.150:0/3651296008 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fea180bc3d0 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea2ea4b740 10 client.25883 fetch_fsmap learned FSMap version 54 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5570ad357860 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.402+0000 7fea0aa00640 1 -- 172.21.15.150:0/3651296008 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea1002f070 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea0aa00640 1 -- 172.21.15.150:0/3651296008 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 8434+0+0 (secure 0 0 0) 0x7fea180d5170 con 0x5570ad346090 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea2ea4b740 10 client.25883 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea2ea4b740 10 client.25883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea2ea4b740 20 client.25883 populate_metadata read hostname 'smithi150' 2024-09-15T22:23:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad3c70c0 0x5570ad3c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea2ea4b740 4 client.25883 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:23:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570ad2b2b80 con 0x5570ad3c70c0 2024-09-15T22:23:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.403+0000 7fea23e00640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad3c70c0 0x5570ad3c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.404+0000 7fea0aa00640 10 client.25883 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.404+0000 7fea23e00640 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad3c70c0 0x5570ad3c94e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e07c46f27c43730 server_cookie=3477a092e1c05c9c in_seq=0 out_seq=0 2024-09-15T22:23:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea0aa00640 1 -- 172.21.15.150:0/3651296008 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570ad2b2b80 con 0x5570ad3c70c0 2024-09-15T22:23:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea0aa00640 10 client.25883 handle_command_reply: tid=0 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 client.25883 shutdown 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 msgr2=0x5570ad354920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 0x5570ad354920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea18000c00 tx=0x7fea180dc040 comp rx=0 tx=0).stop 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 shutdown_connections 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5570ad3c70c0 0x5570ad3c94e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ad34ba60 0x5570ad355e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5570ad3469d0 0x5570ad354e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 --2- 172.21.15.150:0/3651296008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570ad346090 0x5570ad354920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea0aa00640 0 client.25883 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.416+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 >> 172.21.15.150:0/3651296008 conn(0x5570ad341700 msgr2=0x5570ad347c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 shutdown_connections 2024-09-15T22:23:48.419 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2ea4b740 1 -- 172.21.15.150:0/3651296008 wait complete. 2024-09-15T22:23:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2ea4b740 20 client.25883 trim_cache size 0 max 16384 2024-09-15T22:23:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:23:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:23:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:23:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fea0c0a3230 msgr2=0x7fea0c0a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2bc00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fea0c0a3230 0x7fea0c0a56f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5570ad342580 tx=0x7fea10005f90 comp rx=0 tx=0).stop 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 msgr2=0x7fea24199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.417+0000 7fea2bc00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 0x7fea24199fb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea18031440 tx=0x7fea18032ce0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 shutdown_connections 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fea0c0a3230 0x7fea0c0a56f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea241099d0 0x7fea241a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea24076230 0x7fea2419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 --2- 172.21.15.150:0/2227300662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea24074c50 0x7fea24199fb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 >> 172.21.15.150:0/2227300662 conn(0x7fea240fd2e0 msgr2=0x7fea24105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 shutdown_connections 2024-09-15T22:23:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:23:48.418+0000 7fea2bc00640 1 -- 172.21.15.150:0/2227300662 wait complete. 2024-09-15T22:23:49.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:49 smithi154 ceph-mon[34853]: pgmap v707: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 447 op/s 2024-09-15T22:23:49.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:49 smithi150 ceph-mon[30886]: pgmap v707: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 447 op/s 2024-09-15T22:23:49.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:49 smithi169 ceph-mon[35850]: pgmap v707: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 447 op/s 2024-09-15T22:23:51.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:51 smithi154 ceph-mon[34853]: pgmap v708: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-09-15T22:23:51.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:51 smithi150 ceph-mon[30886]: pgmap v708: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-09-15T22:23:51.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:51 smithi169 ceph-mon[35850]: pgmap v708: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 395 op/s 2024-09-15T22:23:53.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:53 smithi150 ceph-mon[30886]: pgmap v709: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 385 op/s 2024-09-15T22:23:53.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:53 smithi154 ceph-mon[34853]: pgmap v709: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 385 op/s 2024-09-15T22:23:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:53 smithi169 ceph-mon[35850]: pgmap v709: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 385 op/s 2024-09-15T22:23:55.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:55 smithi150 ceph-mon[30886]: pgmap v710: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 487 op/s 2024-09-15T22:23:55.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:55 smithi154 ceph-mon[34853]: pgmap v710: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 487 op/s 2024-09-15T22:23:55.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:55 smithi169 ceph-mon[35850]: pgmap v710: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 487 op/s 2024-09-15T22:23:57.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:57 smithi154 ceph-mon[34853]: pgmap v711: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 380 op/s 2024-09-15T22:23:57.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:57 smithi150 ceph-mon[30886]: pgmap v711: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 380 op/s 2024-09-15T22:23:57.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:57 smithi169 ceph-mon[35850]: pgmap v711: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 380 op/s 2024-09-15T22:24:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:59 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:00.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:23:59 smithi150 ceph-mon[30886]: pgmap v712: 97 pgs: 97 active+clean; 1012 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 454 op/s 2024-09-15T22:24:00.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:59 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:00.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:23:59 smithi169 ceph-mon[35850]: pgmap v712: 97 pgs: 97 active+clean; 1012 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 454 op/s 2024-09-15T22:24:00.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:59 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:00.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:23:59 smithi154 ceph-mon[34853]: pgmap v712: 97 pgs: 97 active+clean; 1012 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 454 op/s 2024-09-15T22:24:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 -- 172.21.15.150:0/1518312871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c101580 msgr2=0x7f996c101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 --2- 172.21.15.150:0/1518312871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c101580 0x7f996c101a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9958009860 tx=0x7f995802a340 comp rx=0 tx=0).stop 2024-09-15T22:24:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 -- 172.21.15.150:0/1518312871 shutdown_connections 2024-09-15T22:24:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 --2- 172.21.15.150:0/1518312871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 0x7f996c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 --2- 172.21.15.150:0/1518312871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c101580 0x7f996c101a00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 --2- 172.21.15.150:0/1518312871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c103050 0x7f996c103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 -- 172.21.15.150:0/1518312871 >> 172.21.15.150:0/1518312871 conn(0x7f996c0fd0d0 msgr2=0x7f996c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 -- 172.21.15.150:0/1518312871 shutdown_connections 2024-09-15T22:24:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.534+0000 7f9970e00640 1 -- 172.21.15.150:0/1518312871 wait complete. 2024-09-15T22:24:01.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 Processor -- start 2024-09-15T22:24:01.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 -- start start 2024-09-15T22:24:01.539 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 0x7f996c19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 0x7f996c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 0x7f996c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10d6d0 con 0x7f996c103050 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10d550 con 0x7f996c101f40 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.535+0000 7f9970e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10d850 con 0x7f996c101580 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 0x7f996c19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 0x7f996c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 0x7f996c19a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60516/0 (socket says 172.21.15.150:60516) 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 0x7f996c1a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:38994/0 (socket says 172.21.15.150:38994) 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996b400640 1 -- 172.21.15.150:0/454638510 learned_addr learned my addr 172.21.15.150:0/454638510 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996aa00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 0x7f996c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 -- 172.21.15.150:0/454638510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 msgr2=0x7f996c19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 0x7f996c19a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 -- 172.21.15.150:0/454638510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 msgr2=0x7f996c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 0x7f996c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 -- 172.21.15.150:0/454638510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c1a1c20 con 0x7f996c103050 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996b400640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 0x7f996c19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996aa00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 0x7f996c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.536+0000 7f996be00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 0x7f996c1a15b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9964009fd0 tx=0x7f996400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.537+0000 7f9963e00640 1 -- 172.21.15.150:0/454638510 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996400ce20 con 0x7f996c103050 2024-09-15T22:24:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.537+0000 7f9963e00640 1 -- 172.21.15.150:0/454638510 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9964005020 con 0x7f996c103050 2024-09-15T22:24:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.537+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c1a1f10 con 0x7f996c103050 2024-09-15T22:24:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.537+0000 7f9963e00640 1 -- 172.21.15.150:0/454638510 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964010720 con 0x7f996c103050 2024-09-15T22:24:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.537+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c1a23d0 con 0x7f996c103050 2024-09-15T22:24:01.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f9963e00640 1 -- 172.21.15.150:0/454638510 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f9964005540 con 0x7f996c103050 2024-09-15T22:24:01.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 Processor -- start 2024-09-15T22:24:01.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 -- start start 2024-09-15T22:24:01.550 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x558981626660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x5589816290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558981586100 con 0x558981626c30 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55898152e1b0 con 0x558981621260 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.540+0000 7f99751f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5589815820c0 con 0x558981621ba0 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x5589816290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x558981626660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x5589816290f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39002/0 (socket says 172.21.15.150:39002) 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996aa00640 1 -- 172.21.15.150:0/2374745221 learned_addr learned my addr 172.21.15.150:0/2374745221 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996aa00640 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 -- 172.21.15.150:0/2374745221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 msgr2=0x558981621660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 -- 172.21.15.150:0/2374745221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 msgr2=0x5589816290f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x5589816290f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 -- 172.21.15.150:0/2374745221 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558981299210 con 0x558981621ba0 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996aa00640 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x5589816290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.541+0000 7f996b400640 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x558981626660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f995c0114f0 tx=0x7f995c0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8318c5d29266385d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.542+0000 7f9963e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f99500a32c0 0x7f99500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.542+0000 7f9960c00640 1 -- 172.21.15.150:0/2374745221 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c011250 con 0x558981621ba0 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.542+0000 7f9960c00640 1 -- 172.21.15.150:0/2374745221 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995c005020 con 0x558981621ba0 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.542+0000 7f9960c00640 1 -- 172.21.15.150:0/2374745221 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c004ce0 con 0x558981621ba0 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.542+0000 7f9963e00640 1 -- 172.21.15.150:0/454638510 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f99640cffe0 con 0x7f996c103050 2024-09-15T22:24:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.542+0000 7f996aa00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f99500a32c0 0x7f99500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 -- 172.21.15.150:0/2374745221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 msgr2=0x558981626660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x558981626660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f995c0114f0 tx=0x7f995c0119b0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f996aa00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f99500a32c0 0x7f99500a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9958005e00 tx=0x7f99580056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 -- 172.21.15.150:0/2374745221 shutdown_connections 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x5589816290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x558981626660 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 --2- 172.21.15.150:0/2374745221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 -- 172.21.15.150:0/2374745221 >> 172.21.15.150:0/2374745221 conn(0x55898161c8d0 msgr2=0x55898161ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 -- 172.21.15.150:0/2374745221 shutdown_connections 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 -- 172.21.15.150:0/2374745221 wait complete. 2024-09-15T22:24:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 -- start start 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.543+0000 7f99751f1740 1 Processor -- start 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 0x55898162b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x55898162b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x558981632970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558981629c00 con 0x558981626c30 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55898150f090 con 0x558981621ba0 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558981629d80 con 0x558981621260 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f99751f1740 10 client.0 _ll_register_callbacks cb 0x558981563f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 0x55898162b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 0x55898162b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60526/0 (socket says 172.21.15.150:60526) 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 -- 172.21.15.150:0/716421480 learned_addr learned my addr 172.21.15.150:0/716421480 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996aa00640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x55898162b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996be00640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x558981632970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 -- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 msgr2=0x55898162b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x55898162b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 -- 172.21.15.150:0/716421480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 msgr2=0x558981632970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.544+0000 7f996b400640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x558981632970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f996b400640 1 -- 172.21.15.150:0/716421480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558981365620 con 0x558981621260 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f996aa00640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x55898162b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f996be00640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x558981632970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f996b400640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 0x55898162b3f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f995c000c00 tx=0x7f995c005400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8b3bb1d5cc076b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f9955600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f9955600640 1 -- 172.21.15.150:0/716421480 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c028020 con 0x558981621260 2024-09-15T22:24:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f9955600640 1 -- 172.21.15.150:0/716421480 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f995c004df0 con 0x558981621260 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f995c005020 con 0x558981621260 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f9955600640 1 -- 172.21.15.150:0/716421480 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f995c033050 con 0x558981621260 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f99751f1740 10 client.25888 fetch_fsmap learned FSMap version 55 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.545+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x558981635760 con 0x558981621260 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f9955600640 1 -- 172.21.15.150:0/716421480 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995c005020 con 0x558981621260 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f9955600640 1 -- 172.21.15.150:0/716421480 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 55) ==== 8438+0+0 (secure 0 0 0) 0x7f995c018070 con 0x558981621260 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f99751f1740 10 client.25888 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f99751f1740 10 client.25888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f99751f1740 20 client.25888 populate_metadata read hostname 'smithi150' 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f99751f1740 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x558981636ca0 0x558981639100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f99751f1740 4 client.25888 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558981593830 con 0x558981636ca0 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.546+0000 7f996aa00640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x558981636ca0 0x558981639100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.547+0000 7f996aa00640 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x558981636ca0 0x558981639100 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2b48a054ade1f0 server_cookie=abb8fc414c92751 in_seq=0 out_seq=0 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.547+0000 7f9955600640 10 client.25888 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f9955600640 1 -- 172.21.15.150:0/716421480 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558981593830 con 0x558981636ca0 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f9955600640 10 client.25888 handle_command_reply: tid=0 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 client.25888 shutdown 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 msgr2=0x55898162b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 0x55898162b3f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f995c000c00 tx=0x7f995c005400 comp rx=0 tx=0).stop 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 shutdown_connections 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x558981636ca0 0x558981639100 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x558981632970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x55898162b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 --2- 172.21.15.150:0/716421480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621260 0x55898162b3f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 >> 172.21.15.150:0/716421480 conn(0x55898161c8d0 msgr2=0x55898161e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f9955600640 0 client.25888 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 shutdown_connections 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 1 -- 172.21.15.150:0/716421480 wait complete. 2024-09-15T22:24:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.548+0000 7f99751f1740 20 client.25888 trim_cache size 0 max 16384 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 Processor -- start 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 -- start start 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x5589816328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x55898162b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1ab150 con 0x558981626c30 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1acf60 con 0x558981621260 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f99751f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1ab8e0 con 0x558981621ba0 2024-09-15T22:24:01.566 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f996be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x55898162b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f996aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x5589816328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f996be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x55898162b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39014/0 (socket says 172.21.15.150:39014) 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f996be00640 1 -- 172.21.15.150:0/1908603411 learned_addr learned my addr 172.21.15.150:0/1908603411 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.563+0000 7f996aa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x5589816328c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:60534/0 (socket says 172.21.15.150:60534) 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996b400640 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996aa00640 1 -- 172.21.15.150:0/1908603411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 msgr2=0x558981621640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996aa00640 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996aa00640 1 -- 172.21.15.150:0/1908603411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 msgr2=0x55898162b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996aa00640 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x55898162b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996aa00640 1 -- 172.21.15.150:0/1908603411 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558981626080 con 0x558981621ba0 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996be00640 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x55898162b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f996aa00640 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x5589816328c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9958005760 tx=0x7f9958005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597dc6bd3b0fcdac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:01.567 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f9957e00640 1 -- 172.21.15.150:0/1908603411 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958037040 con 0x558981621ba0 2024-09-15T22:24:01.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f9957e00640 1 -- 172.21.15.150:0/1908603411 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9958045040 con 0x558981621ba0 2024-09-15T22:24:01.568 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.564+0000 7f9957e00640 1 -- 172.21.15.150:0/1908603411 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995804c6a0 con 0x558981621ba0 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 -- 172.21.15.150:0/1908603411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 msgr2=0x5589816328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x5589816328c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9958005760 tx=0x7f9958005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 -- 172.21.15.150:0/1908603411 shutdown_connections 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981626c30 0x55898162b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981621ba0 0x5589816328c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 --2- 172.21.15.150:0/1908603411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621260 0x558981621640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 -- 172.21.15.150:0/1908603411 >> 172.21.15.150:0/1908603411 conn(0x55898161c8d0 msgr2=0x558981626400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 -- 172.21.15.150:0/1908603411 shutdown_connections 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 -- 172.21.15.150:0/1908603411 wait complete. 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.565+0000 7f99751f1740 1 -- start start 2024-09-15T22:24:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 Processor -- start 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 0x558981632300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x558981632840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981626c30 0x55898162eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1ac7d0 con 0x558981621260 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1ac040 con 0x558981621ba0 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1a9130 con 0x558981626c30 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f99751f1740 10 client.0 _ll_register_callbacks cb 0x7f99640093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f996b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 0x558981632300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f996b400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 0x558981632300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:39018/0 (socket says 172.21.15.150:39018) 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f996b400640 1 -- 172.21.15.150:0/2242785674 learned_addr learned my addr 172.21.15.150:0/2242785674 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.566+0000 7f996aa00640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x558981632840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996be00640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981626c30 0x55898162eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996b400640 1 -- 172.21.15.150:0/2242785674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981626c30 msgr2=0x55898162eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996b400640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981626c30 0x55898162eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996b400640 1 -- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 msgr2=0x558981632840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996b400640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x558981632840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996b400640 1 -- 172.21.15.150:0/2242785674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55898162f710 con 0x558981621260 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996be00640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981626c30 0x55898162eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f996b400640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 0x558981632300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f995c010490 tx=0x7f995c010790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb32b6f4904acd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.567+0000 7f9955600640 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f9955600640 1 -- 172.21.15.150:0/2242785674 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c028030 con 0x558981621260 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9958045040 con 0x558981621260 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f9955600640 1 -- 172.21.15.150:0/2242785674 <== mon.0 v2:172.21.15.150:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f995c010ba0 con 0x558981621260 2024-09-15T22:24:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f9955600640 1 -- 172.21.15.150:0/2242785674 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f995c005df0 con 0x558981621260 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f99751f1740 10 client.15888 fetch_fsmap learned FSMap version 55 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5589816a0800 con 0x558981621260 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.568+0000 7f9955600640 1 -- 172.21.15.150:0/2242785674 <== mon.0 v2:172.21.15.150:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9958045040 con 0x558981621260 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f9955600640 1 -- 172.21.15.150:0/2242785674 <== mon.0 v2:172.21.15.150:3300/0 5 ==== fsmap(e 55) ==== 8438+0+0 (secure 0 0 0) 0x7f995c018040 con 0x558981621260 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f99751f1740 10 client.15888 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f99751f1740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f99751f1740 20 client.15888 populate_metadata read hostname 'smithi150' 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f99751f1740 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5589816a12a0 0x5589816a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f99751f1740 4 client.15888 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55898158db80 con 0x5589816a12a0 2024-09-15T22:24:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.569+0000 7f996aa00640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5589816a12a0 0x5589816a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.570+0000 7f996aa00640 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5589816a12a0 0x5589816a36c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d61105b29a23d1 server_cookie=5b2876070e191720 in_seq=0 out_seq=0 2024-09-15T22:24:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.570+0000 7f9955600640 10 client.15888 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f9955600640 1 -- 172.21.15.150:0/2242785674 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55898158db80 con 0x5589816a12a0 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f9955600640 10 client.15888 handle_command_reply: tid=0 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 client.15888 shutdown 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 msgr2=0x558981632300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 0x558981632300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f995c010490 tx=0x7f995c010790 comp rx=0 tx=0).stop 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 shutdown_connections 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x5589816a12a0 0x5589816a36c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558981626c30 0x55898162eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558981621ba0 0x558981632840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.588+0000 7f99751f1740 1 --2- 172.21.15.150:0/2242785674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558981621260 0x558981632300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.589+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 >> 172.21.15.150:0/2242785674 conn(0x55898161c8d0 msgr2=0x55898162afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.589+0000 7f9955600640 0 client.15888 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.589+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 shutdown_connections 2024-09-15T22:24:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.589+0000 7f99751f1740 1 -- 172.21.15.150:0/2242785674 wait complete. 2024-09-15T22:24:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.589+0000 7f99751f1740 20 client.15888 trim_cache size 0 max 16384 2024-09-15T22:24:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:24:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:24:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:24:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f99500a32c0 msgr2=0x7f99500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f99500a32c0 0x7f99500a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9958005e00 tx=0x7f99580056d0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 msgr2=0x7f996c1a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 0x7f996c1a15b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9964009fd0 tx=0x7f996400ef10 comp rx=0 tx=0).stop 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 shutdown_connections 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f99500a32c0 0x7f99500a5780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f996c103050 0x7f996c1a15b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f996c101f40 0x7f996c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 --2- 172.21.15.150:0/454638510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f996c101580 0x7f996c19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 >> 172.21.15.150:0/454638510 conn(0x7f996c0fd0d0 msgr2=0x7f996c108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 shutdown_connections 2024-09-15T22:24:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:01.590+0000 7f9970e00640 1 -- 172.21.15.150:0/454638510 wait complete. 2024-09-15T22:24:01.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:01 smithi150 ceph-mon[30886]: pgmap v713: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 417 op/s 2024-09-15T22:24:01.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:01 smithi154 ceph-mon[34853]: pgmap v713: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 417 op/s 2024-09-15T22:24:01.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:01 smithi169 ceph-mon[35850]: pgmap v713: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 417 op/s 2024-09-15T22:24:03.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:03 smithi150 ceph-mon[30886]: pgmap v714: 97 pgs: 97 active+clean; 997 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-09-15T22:24:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:03 smithi154 ceph-mon[34853]: pgmap v714: 97 pgs: 97 active+clean; 997 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-09-15T22:24:03.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:03 smithi169 ceph-mon[35850]: pgmap v714: 97 pgs: 97 active+clean; 997 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-09-15T22:24:05.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:05 smithi150 ceph-mon[30886]: pgmap v715: 97 pgs: 97 active+clean; 972 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 506 op/s 2024-09-15T22:24:05.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:05 smithi154 ceph-mon[34853]: pgmap v715: 97 pgs: 97 active+clean; 972 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 506 op/s 2024-09-15T22:24:05.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:05 smithi169 ceph-mon[35850]: pgmap v715: 97 pgs: 97 active+clean; 972 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 506 op/s 2024-09-15T22:24:07.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:07 smithi150 ceph-mon[30886]: pgmap v716: 97 pgs: 97 active+clean; 965 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 394 op/s 2024-09-15T22:24:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:07 smithi154 ceph-mon[34853]: pgmap v716: 97 pgs: 97 active+clean; 965 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 394 op/s 2024-09-15T22:24:07.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:07 smithi169 ceph-mon[35850]: pgmap v716: 97 pgs: 97 active+clean; 965 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 394 op/s 2024-09-15T22:24:09.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:09 smithi154 ceph-mon[34853]: pgmap v717: 97 pgs: 97 active+clean; 953 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 466 op/s 2024-09-15T22:24:09.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:09 smithi150 ceph-mon[30886]: pgmap v717: 97 pgs: 97 active+clean; 953 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 466 op/s 2024-09-15T22:24:09.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:09 smithi169 ceph-mon[35850]: pgmap v717: 97 pgs: 97 active+clean; 953 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 466 op/s 2024-09-15T22:24:11.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:11 smithi154 ceph-mon[34853]: pgmap v718: 97 pgs: 97 active+clean; 943 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 405 op/s 2024-09-15T22:24:11.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:11 smithi150 ceph-mon[30886]: pgmap v718: 97 pgs: 97 active+clean; 943 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 405 op/s 2024-09-15T22:24:11.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:11 smithi169 ceph-mon[35850]: pgmap v718: 97 pgs: 97 active+clean; 943 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 405 op/s 2024-09-15T22:24:13.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:13 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:13.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:13 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:13.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:13 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:14 smithi150 ceph-mon[30886]: pgmap v719: 97 pgs: 97 active+clean; 934 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 388 op/s 2024-09-15T22:24:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:14.428 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:14 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:24:14.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:14 smithi169 ceph-mon[35850]: pgmap v719: 97 pgs: 97 active+clean; 934 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 388 op/s 2024-09-15T22:24:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:14.460 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:14 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:24:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:14 smithi154 ceph-mon[34853]: pgmap v719: 97 pgs: 97 active+clean; 934 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 388 op/s 2024-09-15T22:24:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:14.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:14 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' 2024-09-15T22:24:14.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 -- 172.21.15.150:0/29764845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100b50 msgr2=0x7f3708100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.715 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 --2- 172.21.15.150:0/29764845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100b50 0x7f3708100fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009900 tx=0x7f36f402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 -- 172.21.15.150:0/29764845 shutdown_connections 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 --2- 172.21.15.150:0/29764845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37081014f0 0x7f37081019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 --2- 172.21.15.150:0/29764845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100b50 0x7f3708100fb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 --2- 172.21.15.150:0/29764845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3708100210 0x7f3708100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 -- 172.21.15.150:0/29764845 >> 172.21.15.150:0/29764845 conn(0x7f37080fbfa0 msgr2=0x7f37080fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 -- 172.21.15.150:0/29764845 shutdown_connections 2024-09-15T22:24:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.713+0000 7f370ce00640 1 -- 172.21.15.150:0/29764845 wait complete. 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.714+0000 7f370ce00640 1 Processor -- start 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.714+0000 7f370ce00640 1 -- start start 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f370ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 0x7f3708199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f370ce00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3708100b50 0x7f370819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f370ce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37081014f0 0x7f37081a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f370ce00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f370810f730 con 0x7f37081014f0 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f370ce00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f370810f5b0 con 0x7f3708100b50 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f370ce00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f370810f8b0 con 0x7f3708100210 2024-09-15T22:24:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 0x7f3708199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 0x7f3708199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:56206/0 (socket says 172.21.15.150:56206) 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 -- 172.21.15.150:0/1589689816 learned_addr learned my addr 172.21.15.150:0/1589689816 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707e00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37081014f0 0x7f37081a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3706a00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3708100b50 0x7f370819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 -- 172.21.15.150:0/1589689816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3708100b50 msgr2=0x7f370819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3708100b50 0x7f370819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 -- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37081014f0 msgr2=0x7f37081a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37081014f0 0x7f37081a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.715+0000 7f3707400640 1 -- 172.21.15.150:0/1589689816 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37081a1aa0 con 0x7f3708100210 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.716+0000 7f3707400640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 0x7f3708199e80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f36f800d950 tx=0x7f36f800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.716+0000 7f36ffe00640 1 -- 172.21.15.150:0/1589689816 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8017030 con 0x7f3708100210 2024-09-15T22:24:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.716+0000 7f36ffe00640 1 -- 172.21.15.150:0/1589689816 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f8004020 con 0x7f3708100210 2024-09-15T22:24:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.716+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37081a1d90 con 0x7f3708100210 2024-09-15T22:24:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.716+0000 7f36ffe00640 1 -- 172.21.15.150:0/1589689816 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80047a0 con 0x7f3708100210 2024-09-15T22:24:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.716+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37081a21f0 con 0x7f3708100210 2024-09-15T22:24:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.719+0000 7f3711275740 1 Processor -- start 2024-09-15T22:24:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.719+0000 7f3711275740 1 -- start start 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.719+0000 7f36ffe00640 1 -- 172.21.15.150:0/1589689816 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f36f80041d0 con 0x7f3708100210 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.719+0000 7f3711275740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.719+0000 7f3711275740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b24660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3711275740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b270f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3711275740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559fc8a84100 con 0x559fc8b1fba0 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3711275740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559fc8a2c1b0 con 0x559fc8b1f260 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3711275740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559fc8a800c0 con 0x559fc8b24c30 2024-09-15T22:24:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3707400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b24660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3707e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b270f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:56222/0 (socket says 172.21.15.150:56222) 2024-09-15T22:24:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 -- 172.21.15.150:0/1636233398 learned_addr learned my addr 172.21.15.150:0/1636233398 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 -- 172.21.15.150:0/1636233398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 msgr2=0x559fc8b1f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 -- 172.21.15.150:0/1636233398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 msgr2=0x559fc8b24660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b24660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.720+0000 7f3706a00640 1 -- 172.21.15.150:0/1636233398 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc8797210 con 0x559fc8b24c30 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f3706a00640 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b270f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f36f402a910 tx=0x7f36f4032cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca6b3d80e37c2a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f36fcc00640 1 -- 172.21.15.150:0/1636233398 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f403f070 con 0x559fc8b24c30 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f36fcc00640 1 -- 172.21.15.150:0/1636233398 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f40318b0 con 0x559fc8b24c30 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f36fcc00640 1 -- 172.21.15.150:0/1636233398 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4035070 con 0x559fc8b24c30 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f36ffe00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f36ec0a3240 0x7f36ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f36ffe00640 1 -- 172.21.15.150:0/1589689816 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f36f80cf400 con 0x7f3708100210 2024-09-15T22:24:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f3707e00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f36ec0a3240 0x7f36ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f3711275740 1 -- 172.21.15.150:0/1636233398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 msgr2=0x559fc8b270f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.721+0000 7f3711275740 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b270f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f36f402a910 tx=0x7f36f4032cb0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 -- 172.21.15.150:0/1636233398 shutdown_connections 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b270f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b24660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 --2- 172.21.15.150:0/1636233398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 -- 172.21.15.150:0/1636233398 >> 172.21.15.150:0/1636233398 conn(0x559fc8b1a8d0 msgr2=0x559fc8b1acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 -- 172.21.15.150:0/1636233398 shutdown_connections 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 -- 172.21.15.150:0/1636233398 wait complete. 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3707e00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f36ec0a3240 0x7f36ec0a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3700005fd0 tx=0x7f3700009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 -- start start 2024-09-15T22:24:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.722+0000 7f3711275740 1 Processor -- start 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 0x559fc8b29440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b29980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b24c30 0x559fc8b309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559fc8b27c00 con 0x559fc8b1f260 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559fc8a0d090 con 0x559fc8b24c30 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559fc8b27d80 con 0x559fc8b1fba0 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3711275740 10 client.0 _ll_register_callbacks cb 0x559fc8a61f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3707400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 0x559fc8b29440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3706a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b29980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3707400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 0x559fc8b29440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54236/0 (socket says 172.21.15.150:54236) 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3707400640 1 -- 172.21.15.150:0/748252253 learned_addr learned my addr 172.21.15.150:0/748252253 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.723+0000 7f3707e00640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b24c30 0x559fc8b309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3706a00640 1 -- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b24c30 msgr2=0x559fc8b309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3706a00640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b24c30 0x559fc8b309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3706a00640 1 -- 172.21.15.150:0/748252253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 msgr2=0x559fc8b29440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3706a00640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 0x559fc8b29440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3706a00640 1 -- 172.21.15.150:0/748252253 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc8863620 con 0x559fc8b1fba0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3707400640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 0x559fc8b29440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3706a00640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b29980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006010 tx=0x7f36f4009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d901ecf4ba9fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f36f1600640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f36f1600640 1 -- 172.21.15.150:0/748252253 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f404a020 con 0x559fc8b1fba0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f40318b0 con 0x559fc8b1fba0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f36f1600640 1 -- 172.21.15.150:0/748252253 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f36f40035f0 con 0x559fc8b1fba0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f36f1600640 1 -- 172.21.15.150:0/748252253 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f36f4055050 con 0x559fc8b1fba0 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3711275740 10 client.25906 fetch_fsmap learned FSMap version 55 2024-09-15T22:24:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.724+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x559fc8b27c00 con 0x559fc8b1fba0 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f36f1600640 1 -- 172.21.15.150:0/748252253 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f40318b0 con 0x559fc8b1fba0 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f36f1600640 1 -- 172.21.15.150:0/748252253 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 55) ==== 8438+0+0 (secure 0 0 0) 0x7f36f403b990 con 0x559fc8b1fba0 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3711275740 10 client.25906 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3711275740 10 client.25906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3711275740 20 client.25906 populate_metadata read hostname 'smithi150' 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3711275740 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b349f0 0x559fc8b36e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3711275740 4 client.25906 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fc8a91830 con 0x559fc8b349f0 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.725+0000 7f3707400640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b349f0 0x559fc8b36e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.726+0000 7f3707400640 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b349f0 0x559fc8b36e30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fdb54f5b1e135e9 server_cookie=39ea41181d07194a in_seq=0 out_seq=0 2024-09-15T22:24:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.726+0000 7f36f1600640 10 client.25906 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f36f1600640 1 -- 172.21.15.150:0/748252253 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fc8a91830 con 0x559fc8b349f0 2024-09-15T22:24:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f36f1600640 10 client.25906 handle_command_reply: tid=0 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 client.25906 shutdown 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 msgr2=0x559fc8b29980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b29980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006010 tx=0x7f36f4009560 comp rx=0 tx=0).stop 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 shutdown_connections 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b349f0 0x559fc8b36e30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b24c30 0x559fc8b309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f36f1600640 0 client.25906 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b29980 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 --2- 172.21.15.150:0/748252253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1f260 0x559fc8b29440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 >> 172.21.15.150:0/748252253 conn(0x559fc8b1a8d0 msgr2=0x559fc8b1c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 shutdown_connections 2024-09-15T22:24:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 1 -- 172.21.15.150:0/748252253 wait complete. 2024-09-15T22:24:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.727+0000 7f3711275740 20 client.25906 trim_cache size 0 max 16384 2024-09-15T22:24:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 Processor -- start 2024-09-15T22:24:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 -- start start 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b1c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ab150 con 0x559fc8b1fba0 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37081acf60 con 0x559fc8b1f260 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.742+0000 7f3711275740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ab8e0 con 0x559fc8b24c30 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b1c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b1c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:56236/0 (socket says 172.21.15.150:56236) 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3706a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 -- 172.21.15.150:0/2480711473 learned_addr learned my addr 172.21.15.150:0/2480711473 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707400640 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 -- 172.21.15.150:0/2480711473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 msgr2=0x559fc8b1bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 -- 172.21.15.150:0/2480711473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 msgr2=0x559fc8b30980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b30980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 -- 172.21.15.150:0/2480711473 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc8b27460 con 0x559fc8b24c30 2024-09-15T22:24:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3706a00640 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b30980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f3707e00640 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b1c200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3700003e50 tx=0x7f370001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99bbbe1f82940d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.743+0000 7f36f3e00640 1 -- 172.21.15.150:0/2480711473 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700029480 con 0x559fc8b24c30 2024-09-15T22:24:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f36f3e00640 1 -- 172.21.15.150:0/2480711473 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3700029b00 con 0x559fc8b24c30 2024-09-15T22:24:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f36f3e00640 1 -- 172.21.15.150:0/2480711473 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370000fd40 con 0x559fc8b24c30 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 -- 172.21.15.150:0/2480711473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 msgr2=0x559fc8b1c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b1c200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3700003e50 tx=0x7f370001a000 comp rx=0 tx=0).stop 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 -- 172.21.15.150:0/2480711473 shutdown_connections 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b24c30 0x559fc8b1c200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b1fba0 0x559fc8b30980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 --2- 172.21.15.150:0/2480711473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b1bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 -- 172.21.15.150:0/2480711473 >> 172.21.15.150:0/2480711473 conn(0x559fc8b1a8d0 msgr2=0x559fc8b19a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 -- 172.21.15.150:0/2480711473 shutdown_connections 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.744+0000 7f3711275740 1 -- 172.21.15.150:0/2480711473 wait complete. 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 -- start start 2024-09-15T22:24:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 Processor -- start 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b2d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b2dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b24c30 0x559fc8b9d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ac7d0 con 0x559fc8b24c30 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ac040 con 0x559fc8b1f260 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37081a9130 con 0x559fc8b1fba0 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3711275740 10 client.0 _ll_register_callbacks cb 0x7f36f80d2d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.745+0000 7f3706a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b2dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b2d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3706a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b2dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:56248/0 (socket says 172.21.15.150:56248) 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3706a00640 1 -- 172.21.15.150:0/968020250 learned_addr learned my addr 172.21.15.150:0/968020250 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707e00640 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b24c30 0x559fc8b9d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 -- 172.21.15.150:0/968020250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 msgr2=0x559fc8b2dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b2dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 -- 172.21.15.150:0/968020250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b24c30 msgr2=0x559fc8b9d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b24c30 0x559fc8b9d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 -- 172.21.15.150:0/968020250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc8b9dc00 con 0x559fc8b1f260 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3707400640 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b2d800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009fd0 tx=0x7f36f80d2e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916456fcdf86fcd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f36f1600640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f36f1600640 1 -- 172.21.15.150:0/968020250 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f809b2f0 con 0x559fc8b1f260 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3700029b00 con 0x559fc8b1f260 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.746+0000 7f36f1600640 1 -- 172.21.15.150:0/968020250 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f36f80860b0 con 0x559fc8b1f260 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f36f1600640 1 -- 172.21.15.150:0/968020250 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f36f809c090 con 0x559fc8b1f260 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 10 client.25919 fetch_fsmap learned FSMap version 55 2024-09-15T22:24:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x559fc8b9ef60 con 0x559fc8b1f260 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f36f1600640 1 -- 172.21.15.150:0/968020250 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3700029b00 con 0x559fc8b1f260 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f36f1600640 1 -- 172.21.15.150:0/968020250 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 8438+0+0 (secure 0 0 0) 0x7f36f8084ce0 con 0x559fc8b1f260 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 10 client.25919 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 10 client.25919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 20 client.25919 populate_metadata read hostname 'smithi150' 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b9f950 0x559fc8ba1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 4 client.25919 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 --> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559fc8a8bb80 con 0x559fc8b9f950 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.747+0000 7f3706a00640 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b9f950 0x559fc8ba1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.748+0000 7f3706a00640 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b9f950 0x559fc8ba1d70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abe02ded66508ca5 server_cookie=804b9c8ac6f86ead in_seq=0 out_seq=0 2024-09-15T22:24:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.748+0000 7f36f1600640 10 client.25919 ms_handle_connect on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.760+0000 7f36f1600640 1 -- 172.21.15.150:0/968020250 <== mds.0 v2:172.21.15.154:6838/2093141507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559fc8a8bb80 con 0x559fc8b9f950 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.760+0000 7f36f1600640 10 client.25919 handle_command_reply: tid=0 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.760+0000 7f3711275740 1 client.25919 shutdown 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 msgr2=0x559fc8b2d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b2d800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009fd0 tx=0x7f36f80d2e40 comp rx=0 tx=0).stop 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 shutdown_connections 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:6838/2093141507,v1:172.21.15.154:6839/2093141507] conn(0x559fc8b9f950 0x559fc8ba1d70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fc8b24c30 0x559fc8b9d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fc8b1fba0 0x559fc8b2dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 --2- 172.21.15.150:0/968020250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559fc8b1f260 0x559fc8b2d800 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f36f1600640 0 client.25919 ms_handle_reset on v2:172.21.15.154:6838/2093141507 2024-09-15T22:24:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 >> 172.21.15.150:0/968020250 conn(0x559fc8b1a8d0 msgr2=0x559fc8b19a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 shutdown_connections 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 1 -- 172.21.15.150:0/968020250 wait complete. 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.761+0000 7f3711275740 20 client.25919 trim_cache size 0 max 16384 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:{ 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "message": "", 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout: "return_code": 0 2024-09-15T22:24:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stdout:} 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f36ec0a3240 msgr2=0x7f36ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f36ec0a3240 0x7f36ec0a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3700005fd0 tx=0x7f3700009500 comp rx=0 tx=0).stop 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 msgr2=0x7f3708199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 0x7f3708199e80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f36f800d950 tx=0x7f36f800de10 comp rx=0 tx=0).stop 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 shutdown_connections 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f36ec0a3240 0x7f36ec0a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37081014f0 0x7f37081a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3708100b50 0x7f370819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 --2- 172.21.15.150:0/1589689816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708100210 0x7f3708199e80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 >> 172.21.15.150:0/1589689816 conn(0x7f37080fbfa0 msgr2=0x7f37080fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 shutdown_connections 2024-09-15T22:24:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi150.front.sepia.ceph.com.smithi150.stderr:2024-09-15T22:24:14.762+0000 7f370ce00640 1 -- 172.21.15.150:0/1589689816 wait complete. 2024-09-15T22:24:15.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:15 smithi154 ceph-mon[34853]: pgmap v720: 97 pgs: 97 active+clean; 913 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2024-09-15T22:24:15.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:15 smithi150 ceph-mon[30886]: pgmap v720: 97 pgs: 97 active+clean; 913 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2024-09-15T22:24:15.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:15 smithi169 ceph-mon[35850]: pgmap v720: 97 pgs: 97 active+clean; 913 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 479 op/s 2024-09-15T22:24:17.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:17 smithi150 ceph-mon[30886]: pgmap v721: 97 pgs: 97 active+clean; 907 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 380 op/s 2024-09-15T22:24:17.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:17 smithi154 ceph-mon[34853]: pgmap v721: 97 pgs: 97 active+clean; 907 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 380 op/s 2024-09-15T22:24:17.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:17 smithi169 ceph-mon[35850]: pgmap v721: 97 pgs: 97 active+clean; 907 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 380 op/s 2024-09-15T22:24:19.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:19 smithi154 ceph-mon[34853]: pgmap v722: 97 pgs: 97 active+clean; 894 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 446 op/s 2024-09-15T22:24:19.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:19 smithi150 ceph-mon[30886]: pgmap v722: 97 pgs: 97 active+clean; 894 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 446 op/s 2024-09-15T22:24:19.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:19 smithi169 ceph-mon[35850]: pgmap v722: 97 pgs: 97 active+clean; 894 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 446 op/s 2024-09-15T22:24:21.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:21 smithi154 ceph-mon[34853]: pgmap v723: 97 pgs: 97 active+clean; 886 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 390 op/s 2024-09-15T22:24:21.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:21 smithi150 ceph-mon[30886]: pgmap v723: 97 pgs: 97 active+clean; 886 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 390 op/s 2024-09-15T22:24:21.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:21 smithi169 ceph-mon[35850]: pgmap v723: 97 pgs: 97 active+clean; 886 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 390 op/s 2024-09-15T22:24:23.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:23 smithi150 ceph-mon[30886]: pgmap v724: 97 pgs: 97 active+clean; 877 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 383 op/s 2024-09-15T22:24:23.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:23 smithi154 ceph-mon[34853]: pgmap v724: 97 pgs: 97 active+clean; 877 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 383 op/s 2024-09-15T22:24:23.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:23 smithi169 ceph-mon[35850]: pgmap v724: 97 pgs: 97 active+clean; 877 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 383 op/s 2024-09-15T22:24:25.227 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-15T22:24:25.227 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T22:24:25.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:25 smithi150 ceph-mon[30886]: pgmap v725: 97 pgs: 97 active+clean; 853 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 491 op/s 2024-09-15T22:24:25.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:25 smithi154 ceph-mon[34853]: pgmap v725: 97 pgs: 97 active+clean; 853 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 491 op/s 2024-09-15T22:24:25.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:25 smithi169 ceph-mon[35850]: pgmap v725: 97 pgs: 97 active+clean; 853 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 491 op/s 2024-09-15T22:24:26.408 DEBUG:teuthology.parallel:result is None 2024-09-15T22:24:26.409 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:24:26.472 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:24:26.472 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-15T22:24:26.483 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:24:26.494 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T22:24:26.525 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 -- 172.21.15.150:0/2480705165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8103d30 msgr2=0x7fc0f8104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2480705165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8103d30 0x7fc0f8104130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009860 tx=0x7fc0e802a340 comp rx=0 tx=0).stop 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 -- 172.21.15.150:0/2480705165 shutdown_connections 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2480705165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f81058e0 0x7fc0f810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2480705165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8104f20 0x7fc0f81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2480705165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8103d30 0x7fc0f8104130 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.691+0000 7fc0fde00640 1 -- 172.21.15.150:0/2480705165 >> 172.21.15.150:0/2480705165 conn(0x7fc0f80ff4b0 msgr2=0x7fc0f81018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.692+0000 7fc0fde00640 1 -- 172.21.15.150:0/2480705165 shutdown_connections 2024-09-15T22:24:26.694 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.692+0000 7fc0fde00640 1 -- 172.21.15.150:0/2480705165 wait complete. 2024-09-15T22:24:26.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 Processor -- start 2024-09-15T22:24:26.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 -- start start 2024-09-15T22:24:26.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 0x7fc0f819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:26.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8104f20 0x7fc0f819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f81058e0 0x7fc0f81a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f810f9b0 con 0x7fc0f81058e0 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f810f830 con 0x7fc0f8104f20 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0fde00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f810fb30 con 0x7fc0f8103d30 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0f7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f81058e0 0x7fc0f81a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0f6000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8104f20 0x7fc0f819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0f6a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 0x7fc0f819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0f6a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 0x7fc0f819a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:56278/0 (socket says 172.21.15.150:56278) 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.693+0000 7fc0f6a00640 1 -- 172.21.15.150:0/2060505032 learned_addr learned my addr 172.21.15.150:0/2060505032 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0f6a00640 1 -- 172.21.15.150:0/2060505032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8104f20 msgr2=0x7fc0f819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0f6a00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8104f20 0x7fc0f819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0f6a00640 1 -- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f81058e0 msgr2=0x7fc0f81a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0f6a00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f81058e0 0x7fc0f81a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0f6a00640 1 -- 172.21.15.150:0/2060505032 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f81a1cb0 con 0x7fc0f8103d30 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0f6a00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 0x7fc0f819a090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8035040 tx=0x7fc0e8033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8037040 con 0x7fc0f8103d30 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0e8030850 con 0x7fc0f8103d30 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f81a1f40 con 0x7fc0f8103d30 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8004920 con 0x7fc0f8103d30 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.694+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f81a2350 con 0x7fc0f8103d30 2024-09-15T22:24:26.698 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.695+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f810b170 con 0x7fc0f8103d30 2024-09-15T22:24:26.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.697+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fc0e8004050 con 0x7fc0f8103d30 2024-09-15T22:24:26.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.698+0000 7fc0fca00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0dc0a3250 0x7fc0dc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:26.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.699+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fc0e80ef7b0 con 0x7fc0f8103d30 2024-09-15T22:24:26.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.699+0000 7fc0f6000640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0dc0a3250 0x7fc0dc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:26.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.699+0000 7fc0f6000640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0dc0a3250 0x7fc0dc0a5710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc0f819b5a0 tx=0x7fc0e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:26.704 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.701+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0e80bc4d0 con 0x7fc0f8103d30 2024-09-15T22:24:26.881 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.880+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0f802da10 con 0x7fc0f8103d30 2024-09-15T22:24:26.883 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.882+0000 7fc0fca00640 1 -- 172.21.15.150:0/2060505032 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22912 (secure 0 0 0) 0x7fc0e80bbdd0 con 0x7fc0f8103d30 2024-09-15T22:24:26.884 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:24:26.884 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":84,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:11:44.269746+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8},{"from":3,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:24:26.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0dc0a3250 msgr2=0x7fc0dc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:26.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0dc0a3250 0x7fc0dc0a5710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc0f819b5a0 tx=0x7fc0e4005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:26.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 msgr2=0x7fc0f819a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:26.886 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 0x7fc0f819a090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8035040 tx=0x7fc0e8033d90 comp rx=0 tx=0).stop 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 shutdown_connections 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fc0dc0a3250 0x7fc0dc0a5710 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0f81058e0 0x7fc0f81a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f8104f20 0x7fc0f819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 --2- 172.21.15.150:0/2060505032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0f8103d30 0x7fc0f819a090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 >> 172.21.15.150:0/2060505032 conn(0x7fc0f80ff4b0 msgr2=0x7fc0f8108340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 shutdown_connections 2024-09-15T22:24:26.887 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:26.884+0000 7fc0fde00640 1 -- 172.21.15.150:0/2060505032 wait complete. 2024-09-15T22:24:26.903 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:05:05.654013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:09:52.845421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:09:55.664798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:24:26.904 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.062+0000 7fe7bbe00640 1 -- 172.21.15.150:0/3275350923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4103d20 msgr2=0x7fe7b4104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.062+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/3275350923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4103d20 0x7fe7b4104120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009900 tx=0x7fe7a802a400 comp rx=0 tx=0).stop 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 -- 172.21.15.150:0/3275350923 shutdown_connections 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/3275350923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b41058d0 0x7fe7b410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/3275350923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4104f10 0x7fe7b4105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/3275350923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4103d20 0x7fe7b4104120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 -- 172.21.15.150:0/3275350923 >> 172.21.15.150:0/3275350923 conn(0x7fe7b40ff4a0 msgr2=0x7fe7b41018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.065 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 -- 172.21.15.150:0/3275350923 shutdown_connections 2024-09-15T22:24:27.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.063+0000 7fe7bbe00640 1 -- 172.21.15.150:0/3275350923 wait complete. 2024-09-15T22:24:27.067 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 Processor -- start 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 -- start start 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4103d20 0x7fe7b419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 0x7fe7b419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b41058d0 0x7fe7b41a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b410f9f0 con 0x7fe7b41058d0 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b410f870 con 0x7fe7b4104f10 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b410fb70 con 0x7fe7b4103d20 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7b9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4103d20 0x7fe7b419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7b8a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 0x7fe7b419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7b9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b41058d0 0x7fe7b41a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.068 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7b8a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 0x7fe7b419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:42712/0 (socket says 172.21.15.150:42712) 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7b9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4103d20 0x7fe7b419a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.150:56288/0 (socket says 172.21.15.150:56288) 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.064+0000 7fe7b8a00640 1 -- 172.21.15.150:0/2070182458 learned_addr learned my addr 172.21.15.150:0/2070182458 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b8a00640 1 -- 172.21.15.150:0/2070182458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4103d20 msgr2=0x7fe7b419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b8a00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4103d20 0x7fe7b419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b8a00640 1 -- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b41058d0 msgr2=0x7fe7b41a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b8a00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b41058d0 0x7fe7b41a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b8a00640 1 -- 172.21.15.150:0/2070182458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b41a1cc0 con 0x7fe7b4104f10 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b8a00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 0x7fe7b419a5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000e9f0 tx=0x7fe7a000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000ccc0 con 0x7fe7b4104f10 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7a000ce60 con 0x7fe7b4104f10 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b41a1fb0 con 0x7fe7b4104f10 2024-09-15T22:24:27.069 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0010690 con 0x7fe7b4104f10 2024-09-15T22:24:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.065+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b41a2420 con 0x7fe7b4104f10 2024-09-15T22:24:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.066+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b410b110 con 0x7fe7b4104f10 2024-09-15T22:24:27.070 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.068+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fe7a00046c0 con 0x7fe7b4104f10 2024-09-15T22:24:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.070+0000 7fe7b2000640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe79c0a3250 0x7fe79c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.070+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fe7a00cfd70 con 0x7fe7b4104f10 2024-09-15T22:24:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.070+0000 7fe7b9400640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe79c0a3250 0x7fe79c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.072 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.071+0000 7fe7b9400640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe79c0a3250 0x7fe79c0a5710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe7a802a9f0 tx=0x7fe7a80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.075 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.074+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7a009ca00 con 0x7fe7b4104f10 2024-09-15T22:24:27.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:26 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2060505032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:27.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:26 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2060505032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:27.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.251+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe7b4062e90 con 0x7fe7b4104f10 2024-09-15T22:24:27.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:26 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2060505032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:27.316 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.315+0000 7fe7b2000640 1 -- 172.21.15.150:0/2070182458 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fe7a009c300 con 0x7fe7b4104f10 2024-09-15T22:24:27.317 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe79c0a3250 msgr2=0x7fe79c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe79c0a3250 0x7fe79c0a5710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe7a802a9f0 tx=0x7fe7a80315b0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 msgr2=0x7fe7b419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 0x7fe7b419a5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000e9f0 tx=0x7fe7a000edf0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 shutdown_connections 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fe79c0a3250 0x7fe79c0a5710 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.319 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b41058d0 0x7fe7b41a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4104f10 0x7fe7b419a5e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 --2- 172.21.15.150:0/2070182458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b4103d20 0x7fe7b419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 >> 172.21.15.150:0/2070182458 conn(0x7fe7b40ff4a0 msgr2=0x7fe7b41082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 shutdown_connections 2024-09-15T22:24:27.320 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.317+0000 7fe7bbe00640 1 -- 172.21.15.150:0/2070182458 wait complete. 2024-09-15T22:24:27.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.491+0000 7f742e200640 1 -- 172.21.15.150:0/4245230094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74281058d0 msgr2=0x7f742810c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.491+0000 7f742e200640 1 --2- 172.21.15.150:0/4245230094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74281058d0 0x7f742810c160 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7420009ca0 tx=0x7f742002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 -- 172.21.15.150:0/4245230094 shutdown_connections 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 --2- 172.21.15.150:0/4245230094 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74281058d0 0x7f742810c160 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 --2- 172.21.15.150:0/4245230094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7428104f10 0x7f7428105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 --2- 172.21.15.150:0/4245230094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7428103d20 0x7f7428104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 -- 172.21.15.150:0/4245230094 >> 172.21.15.150:0/4245230094 conn(0x7f74280ff4a0 msgr2=0x7f74281018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 -- 172.21.15.150:0/4245230094 shutdown_connections 2024-09-15T22:24:27.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 -- 172.21.15.150:0/4245230094 wait complete. 2024-09-15T22:24:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.492+0000 7f742e200640 1 Processor -- start 2024-09-15T22:24:27.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 -- start start 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7428103d20 0x7f742819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 0x7f742819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74281058d0 0x7f74281a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f742810f9a0 con 0x7f7428104f10 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f742810f820 con 0x7f74281058d0 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f742e200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f742810fb20 con 0x7f7428103d20 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f741ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 0x7f742819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f741ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 0x7f742819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48800/0 (socket says 172.21.15.150:48800) 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f741ea00640 1 -- 172.21.15.150:0/1936294372 learned_addr learned my addr 172.21.15.150:0/1936294372 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f7427e00640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74281058d0 0x7f74281a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.493+0000 7f7427400640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7428103d20 0x7f742819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f741ea00640 1 -- 172.21.15.150:0/1936294372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7428103d20 msgr2=0x7f742819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f741ea00640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7428103d20 0x7f742819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f741ea00640 1 -- 172.21.15.150:0/1936294372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74281058d0 msgr2=0x7f74281a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f741ea00640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74281058d0 0x7f74281a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f741ea00640 1 -- 172.21.15.150:0/1936294372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74281a1c40 con 0x7f7428104f10 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f741ea00640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 0x7f742819a560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f741000d950 tx=0x7f741000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410017030 con 0x7f7428104f10 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7410004020 con 0x7f7428104f10 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74281a1f30 con 0x7f7428104f10 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74100047a0 con 0x7f7428104f10 2024-09-15T22:24:27.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.494+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74281a23f0 con 0x7f7428104f10 2024-09-15T22:24:27.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.495+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742810b0e0 con 0x7f7428104f10 2024-09-15T22:24:27.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.497+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f74100041d0 con 0x7f7428104f10 2024-09-15T22:24:27.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.498+0000 7f7424c00640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f740c0a3250 0x7f740c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.499+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f74100cf950 con 0x7f7428104f10 2024-09-15T22:24:27.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.499+0000 7f7427400640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f740c0a3250 0x7f740c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.499+0000 7f7427400640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f740c0a3250 0x7f740c0a5710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7428104d70 tx=0x7f7418005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.503 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.501+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f741009c5e0 con 0x7f7428104f10 2024-09-15T22:24:27.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.675+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f742802da10 con 0x7f7428104f10 2024-09-15T22:24:27.677 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.675+0000 7f7424c00640 1 -- 172.21.15.150:0/1936294372 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f741009bee0 con 0x7f7428104f10 2024-09-15T22:24:27.677 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2024-09-15T22:24:27.679 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f740c0a3250 msgr2=0x7f740c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f740c0a3250 0x7f740c0a5710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7428104d70 tx=0x7f7418005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 msgr2=0x7f742819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 0x7f742819a560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f741000d950 tx=0x7f741000de10 comp rx=0 tx=0).stop 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 shutdown_connections 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74281058d0 0x7f74281a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f740c0a3250 0x7f740c0a5710 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428104f10 0x7f742819a560 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 --2- 172.21.15.150:0/1936294372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7428103d20 0x7f742819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 >> 172.21.15.150:0/1936294372 conn(0x7f74280ff4a0 msgr2=0x7f74281082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 shutdown_connections 2024-09-15T22:24:27.680 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.678+0000 7f742e200640 1 -- 172.21.15.150:0/1936294372 wait complete. 2024-09-15T22:24:27.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.854+0000 7f6315400640 1 -- 172.21.15.150:0/4007386257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63101058e0 msgr2=0x7f631010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.854+0000 7f6315400640 1 --2- 172.21.15.150:0/4007386257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63101058e0 0x7f631010c170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6308009ca0 tx=0x7f630802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 -- 172.21.15.150:0/4007386257 shutdown_connections 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 --2- 172.21.15.150:0/4007386257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63101058e0 0x7f631010c170 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 --2- 172.21.15.150:0/4007386257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6310104f20 0x7f63101053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 --2- 172.21.15.150:0/4007386257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6310103d30 0x7f6310104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 -- 172.21.15.150:0/4007386257 >> 172.21.15.150:0/4007386257 conn(0x7f63100ff470 msgr2=0x7f63101018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 -- 172.21.15.150:0/4007386257 shutdown_connections 2024-09-15T22:24:27.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 -- 172.21.15.150:0/4007386257 wait complete. 2024-09-15T22:24:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.855+0000 7f6315400640 1 Processor -- start 2024-09-15T22:24:27.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 -- start start 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6310103d30 0x7f631019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 0x7f631019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63101058e0 0x7f63101a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f631010fa00 con 0x7f6310104f20 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f631010f880 con 0x7f63101058e0 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f6315400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f631010fb80 con 0x7f6310103d30 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f630de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 0x7f631019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f630de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 0x7f631019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48810/0 (socket says 172.21.15.150:48810) 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f630de00640 1 -- 172.21.15.150:0/1221434340 learned_addr learned my addr 172.21.15.150:0/1221434340 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f630e800640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6310103d30 0x7f631019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.856+0000 7f630f200640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63101058e0 0x7f63101a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f630de00640 1 -- 172.21.15.150:0/1221434340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6310103d30 msgr2=0x7f631019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f630de00640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6310103d30 0x7f631019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f630de00640 1 -- 172.21.15.150:0/1221434340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63101058e0 msgr2=0x7f63101a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f630de00640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63101058e0 0x7f63101a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f630de00640 1 -- 172.21.15.150:0/1221434340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63101a1c20 con 0x7f6310104f20 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f630de00640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 0x7f631019a540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00e9f0 tx=0x7f62fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00cd80 con 0x7f6310104f20 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62fc010910 con 0x7f6310104f20 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc018990 con 0x7f6310104f20 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101a1f10 con 0x7f6310104f20 2024-09-15T22:24:27.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.857+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101a2420 con 0x7f6310104f20 2024-09-15T22:24:27.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.858+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631010b050 con 0x7f6310104f20 2024-09-15T22:24:27.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.861+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f62fc010ac0 con 0x7f6310104f20 2024-09-15T22:24:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.862+0000 7f6307400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f62f40a32d0 0x7f62f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.862+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f62fc0cfcb0 con 0x7f6310104f20 2024-09-15T22:24:27.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.862+0000 7f630e800640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f62f40a32d0 0x7f62f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:27.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.863+0000 7f630e800640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f62f40a32d0 0x7f62f40a5790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6310104d80 tx=0x7f6300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:27.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:27.866+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62fc09c940 con 0x7f6310104f20 2024-09-15T22:24:28.044 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.043+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6310062df0 con 0x7f6310104f20 2024-09-15T22:24:28.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.043+0000 7f6307400640 1 -- 172.21.15.150:0/1221434340 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f62fc09c240 con 0x7f6310104f20 2024-09-15T22:24:28.045 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 64 2024-09-15T22:24:28.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f62f40a32d0 msgr2=0x7f62f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f62f40a32d0 0x7f62f40a5790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6310104d80 tx=0x7f6300005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 msgr2=0x7f631019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 0x7f631019a540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00e9f0 tx=0x7f62fc00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 shutdown_connections 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63101058e0 0x7f63101a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f62f40a32d0 0x7f62f40a5790 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6310104f20 0x7f631019a540 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 --2- 172.21.15.150:0/1221434340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6310103d30 0x7f631019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 >> 172.21.15.150:0/1221434340 conn(0x7f63100ff470 msgr2=0x7f6310108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 shutdown_connections 2024-09-15T22:24:28.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.046+0000 7f6315400640 1 -- 172.21.15.150:0/1221434340 wait complete. 2024-09-15T22:24:28.062 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:27 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2070182458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:24:28.062 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:27 smithi150 ceph-mon[30886]: pgmap v726: 97 pgs: 97 active+clean; 848 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 373 op/s 2024-09-15T22:24:28.062 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:27 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1936294372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:24:28.064 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T22:24:28.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:27 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2070182458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:24:28.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:27 smithi169 ceph-mon[35850]: pgmap v726: 97 pgs: 97 active+clean; 848 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 373 op/s 2024-09-15T22:24:28.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:27 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1936294372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 -- 172.21.15.150:0/4237120650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640105720 msgr2=0x7f964010bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 --2- 172.21.15.150:0/4237120650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640105720 0x7f964010bfb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9638009ca0 tx=0x7f963802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 -- 172.21.15.150:0/4237120650 shutdown_connections 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 --2- 172.21.15.150:0/4237120650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640105720 0x7f964010bfb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 --2- 172.21.15.150:0/4237120650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9640104d60 0x7f96401051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 --2- 172.21.15.150:0/4237120650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640103b70 0x7f9640103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 -- 172.21.15.150:0/4237120650 >> 172.21.15.150:0/4237120650 conn(0x7f96400ff2f0 msgr2=0x7f9640101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 -- 172.21.15.150:0/4237120650 shutdown_connections 2024-09-15T22:24:28.221 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.219+0000 7f9646a00640 1 -- 172.21.15.150:0/4237120650 wait complete. 2024-09-15T22:24:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 Processor -- start 2024-09-15T22:24:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 -- start start 2024-09-15T22:24:28.223 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 0x7f9640199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9640104d60 0x7f964019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640105720 0x7f96401a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f964010f820 con 0x7f9640103b70 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f964010f6a0 con 0x7f9640105720 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f964010f9a0 con 0x7f9640104d60 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9645600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 0x7f9640199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9645600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 0x7f9640199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48822/0 (socket says 172.21.15.150:48822) 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9645600640 1 -- 172.21.15.150:0/3507359121 learned_addr learned my addr 172.21.15.150:0/3507359121 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.220+0000 7f9646000640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640105720 0x7f96401a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9644c00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9640104d60 0x7f964019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9645600640 1 -- 172.21.15.150:0/3507359121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9640104d60 msgr2=0x7f964019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:28.224 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9645600640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9640104d60 0x7f964019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9645600640 1 -- 172.21.15.150:0/3507359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640105720 msgr2=0x7f96401a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9645600640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640105720 0x7f96401a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9645600640 1 -- 172.21.15.150:0/3507359121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96401a1a40 con 0x7f9640103b70 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9646000640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640105720 0x7f96401a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9645600640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 0x7f9640199e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f963400e9c0 tx=0x7f963400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963400cde0 con 0x7f9640103b70 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9634010910 con 0x7f9640103b70 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634018a00 con 0x7f9640103b70 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96401a1d30 con 0x7f9640103b70 2024-09-15T22:24:28.225 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.221+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96401a21d0 con 0x7f9640103b70 2024-09-15T22:24:28.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.222+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964010ae90 con 0x7f9640103b70 2024-09-15T22:24:28.226 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.224+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f963401f020 con 0x7f9640103b70 2024-09-15T22:24:28.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.226+0000 7f963e000640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f96280a32d0 0x7f96280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:28.227 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.226+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f96340cfb10 con 0x7f9640103b70 2024-09-15T22:24:28.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.226+0000 7f9644c00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f96280a32d0 0x7f96280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:28.228 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.227+0000 7f9644c00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f96280a32d0 0x7f96280a5790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f962c0095f0 tx=0x7f962c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:28.231 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.229+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f963409c7a0 con 0x7f9640103b70 2024-09-15T22:24:28.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:27 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2070182458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:24:28.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:27 smithi154 ceph-mon[34853]: pgmap v726: 97 pgs: 97 active+clean; 848 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 373 op/s 2024-09-15T22:24:28.272 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:27 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1936294372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:24:28.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.452+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9640062f30 con 0x7f9640103b70 2024-09-15T22:24:28.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.462+0000 7f963e000640 1 -- 172.21.15.150:0/3507359121 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742349 (secure 0 0 0) 0x7f963409c0a0 con 0x7f9640103b70 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: "epoch": 18, 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: "active_gid": 14150, 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: "active_name": "x", 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: "active_addrs": { 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2024-09-15T22:24:28.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6800", 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 1242932536 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:6801", 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 1242932536 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.475 INFO:teuthology.orchestra.run.smithi150.stdout: "active_addr": "172.21.15.150:6801/1242932536", 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "active_change": "2024-09-15T22:02:43.046745+0000", 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "available": true, 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "standbys": [ 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 24109, 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "z", 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "available_modules": [ 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "alerts", 2024-09-15T22:24:28.476 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.478 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.479 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.480 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.481 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.483 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_destination": { 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_destination", 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.484 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_from_name": { 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_from_name", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "Ceph", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.485 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Email From: name", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_host": { 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_host", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.486 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP server", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_password": { 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_password", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.487 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Password to authenticate with", 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_port": { 2024-09-15T22:24:28.488 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_port", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "465", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP port", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.489 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_sender": { 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_sender", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.490 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_ssl": { 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_ssl", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:24:28.491 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_user": { 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_user", 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.492 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "User to authenticate as", 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "balancer", 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.493 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "active": { 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "active", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.494 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "begin_time": { 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "begin_time", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0000", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:24:28.495 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "begin_weekday": { 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "begin_weekday", 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0", 2024-09-15T22:24:28.496 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "6", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_max_iterations": { 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "25", 2024-09-15T22:24:28.497 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "250", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_metrics": { 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_metrics", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.498 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_step": { 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_step", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.499 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0.5", 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0.001", 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "0.999", 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "end_time": { 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "end_time", 2024-09-15T22:24:28.500 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "2359", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "end_weekday": { 2024-09-15T22:24:28.501 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "end_weekday", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "6", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.502 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.503 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.504 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.505 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.506 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.507 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "min_score": { 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "min_score", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.508 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "mode": { 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mode", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.509 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "upmap", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "crush-compat", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "none", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "read", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap-read" 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Balancer mode", 2024-09-15T22:24:28.510 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "pool_ids": { 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pool_ids", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.511 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.512 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap_max_deviation": { 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "upmap_max_deviation", 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap_max_optimizations": { 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.514 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.515 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephadm", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_down_multiplier": { 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_down_multiplier", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3.0", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.516 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_refresh_rate": { 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_refresh_rate", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "20", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.517 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_starting_port": { 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_starting_port", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "4721", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.518 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_ptrace": { 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_ptrace", 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.519 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "autotune_interval": { 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "autotune_interval", 2024-09-15T22:24:28.520 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi150.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0.7", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm_log_destination": { 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephadm_log_destination", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "file", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "file,syslog", 2024-09-15T22:24:28.523 INFO:teuthology.orchestra.run.smithi150.stdout: "syslog" 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "cgroups_split": { 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cgroups_split", 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.524 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "config_checks_enabled": { 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_checks_enabled", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.525 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "config_dashboard": { 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_dashboard", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.526 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_alertmanager": { 2024-09-15T22:24:28.527 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_alertmanager", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.528 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_base": { 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_base", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_elasticsearch": { 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "elasticsearch container image", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.530 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_grafana": { 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_grafana", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:28.531 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_haproxy": { 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_haproxy", 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.532 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "HAproxy container image", 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_agent": { 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.533 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_collector": { 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.534 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_query": { 2024-09-15T22:24:28.535 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger query container image", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_keepalived": { 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_keepalived", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Keepalived container image", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.537 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_loki": { 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_loki", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Loki container image", 2024-09-15T22:24:28.538 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_node_exporter": { 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_node_exporter", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.539 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_nvmeof": { 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_nvmeof", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.540 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Nvme-of container image", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_prometheus": { 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_prometheus", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:24:28.541 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.542 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.542 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.542 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:28.542 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.542 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.542 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_promtail": { 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_promtail", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Promtail container image", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.543 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_samba": { 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_samba", 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.544 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_snmp_gateway": { 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.545 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "container_init": { 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_init", 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.546 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "daemon_cache_timeout": { 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.547 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.548 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "900", 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "default_registry": { 2024-09-15T22:24:28.549 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "default_registry", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "device_cache_timeout": { 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_cache_timeout", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1800", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "device_enhanced_scan": { 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_enhanced_scan", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.552 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "facts_cache_timeout": { 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "facts_cache_timeout", 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.553 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "grafana_dashboards_path": { 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.554 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "host_check_interval": { 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "host_check_interval", 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:28.555 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "hw_monitoring": { 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "hw_monitoring", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.556 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "inventory_list_all": { 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "inventory_list_all", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.557 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.558 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.560 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.560 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.560 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.560 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.561 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "log_refresh_metadata": { 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_refresh_metadata", 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.562 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.563 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.564 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.565 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.566 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.567 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.568 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "*", 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "max_count_per_host": { 2024-09-15T22:24:28.569 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_count_per_host", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.570 INFO:teuthology.orchestra.run.smithi150.stdout: "max_osd_draining_count": { 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_osd_draining_count", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.571 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "migration_current": { 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "migration_current", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "internal - do not modify", 2024-09-15T22:24:28.572 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "mode": { 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mode", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "root", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.573 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm-package", 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "root" 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "oob_default_addr": { 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "oob_default_addr", 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.574 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "169.254.1.1", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "prometheus_alerts_path": { 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.575 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_insecure": { 2024-09-15T22:24:28.576 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_insecure", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_password": { 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_password", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.578 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_url": { 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_url", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.579 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_username": { 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_username", 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.580 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "secure_monitoring_stack": { 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.581 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "service_discovery_port": { 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "service_discovery_port", 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8765", 2024-09-15T22:24:28.582 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "ssh_config_file": { 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssh_config_file", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.583 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "use_agent": { 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "use_agent", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.584 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "use_repo_digest": { 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "use_repo_digest", 2024-09-15T22:24:28.585 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_failed_host_check": { 2024-09-15T22:24:28.586 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.587 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_stray_daemons": { 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_stray_hosts": { 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.589 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crash", 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.590 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.591 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.592 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.593 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "retain_interval": { 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "retain_interval", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "31536000", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.596 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_recent_interval": { 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_recent_interval", 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1209600", 2024-09-15T22:24:28.597 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "dashboard", 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.598 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.599 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.600 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.601 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.602 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:24:28.605 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.606 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.607 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.608 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.609 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.610 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.611 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.612 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.613 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:24:28.614 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.615 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_URL": { 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.617 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.618 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.619 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.620 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.621 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.622 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.623 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:24:28.624 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:24:28.625 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.626 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.628 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.629 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.630 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.631 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.632 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.633 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.634 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:24:28.635 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.636 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.637 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "45", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.638 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.639 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.640 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.641 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:24:28.642 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.644 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.645 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.646 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "cross_origin_url": { 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cross_origin_url", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.647 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "crt_file": { 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crt_file", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.648 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "debug": { 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "debug", 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.649 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "jwt_token_ttl": { 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "jwt_token_ttl", 2024-09-15T22:24:28.650 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "28800", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.651 INFO:teuthology.orchestra.run.smithi150.stdout: "key_file": { 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "key_file", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.653 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.654 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.655 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.656 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.657 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "motd": { 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "motd", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.658 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "The message of the day", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.659 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "::", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.661 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8080", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.662 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl": { 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.663 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl_server_port": { 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl_server_port", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8443", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.664 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_behaviour": { 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_behaviour", 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.665 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "redirect", 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "redirect" 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.666 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_error_status_code": { 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_error_status_code", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "500", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "400", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "599", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.667 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "url_prefix": { 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "url_prefix", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.668 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "devicehealth", 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "enable_monitoring": { 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enable_monitoring", 2024-09-15T22:24:28.669 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "monitor device health metrics", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.670 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.671 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.672 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.673 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.674 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.675 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "mark_out_threshold": { 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mark_out_threshold", 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "2419200", 2024-09-15T22:24:28.676 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "pool_name": { 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pool_name", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.677 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "device_health_metrics", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "retention_period": { 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "retention_period", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.678 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15552000", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "scrape_frequency": { 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "scrape_frequency", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.679 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "86400", 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "self_heal": { 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "self_heal", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.681 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:24:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_threshold": { 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_threshold", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "7257600", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.683 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "diskprediction_local", 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.684 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.685 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.686 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.687 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.688 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.689 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "predict_interval": { 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "predict_interval", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "86400", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.690 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "predictor_model": { 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "predictor_model", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "prophetstor", 2024-09-15T22:24:28.691 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.692 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "influx", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": false, 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "batch_size": { 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "batch_size", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5000", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.694 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "database": { 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "database", 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.695 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "ceph", 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": { 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "hostname", 2024-09-15T22:24:28.696 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.697 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "30", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "5", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.699 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.700 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.701 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.702 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.703 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "password": { 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "password", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "port": { 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "port", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.705 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8086", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB server port", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl": { 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.706 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "false", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "threads": { 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "threads", 2024-09-15T22:24:28.707 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "32", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.708 INFO:teuthology.orchestra.run.smithi150.stdout: "username": { 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "username", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "verify_ssl": { 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "verify_ssl", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "true", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:24:28.710 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "insights", 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.711 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.712 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.713 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.714 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.715 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.716 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "iostat", 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.717 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.718 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.719 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.720 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.721 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.722 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "k8sevents", 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.723 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_event_retention_days": { 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "7", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "config_check_secs": { 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_check_secs", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "10", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:24:28.725 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.726 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.727 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.728 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.729 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.730 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "localpool", 2024-09-15T22:24:28.731 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "failure_domain": { 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "failure_domain", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "host", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.732 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.733 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.734 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.735 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.736 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.737 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "min_size": { 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "min_size", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.738 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "num_rep": { 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "num_rep", 2024-09-15T22:24:28.739 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.740 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_num": { 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pg_num", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "128", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.741 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "prefix": { 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prefix", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:24:28.742 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "subtree": { 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subtree", 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.743 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "rack", 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mds_autoscaler", 2024-09-15T22:24:28.744 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.745 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.746 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.747 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.748 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.749 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.750 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mirroring", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.751 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.752 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.753 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.754 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.755 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.756 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "nfs", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.757 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.758 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.759 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.760 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.761 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.762 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "orchestrator", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "fail_fs": { 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "fail_fs", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.763 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.764 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.765 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.768 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.768 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.768 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.768 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.768 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.768 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.769 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.770 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.771 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator": { 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "orchestrator", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.772 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm", 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "rook", 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "test_orchestrator" 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Orchestrator backend", 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.773 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "osd_perf_query", 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.774 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.775 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.776 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.777 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.778 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.779 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "osd_support", 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.780 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.781 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.782 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.783 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.784 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.785 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pg_autoscaler", 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.786 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.787 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.788 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.789 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.790 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.791 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.792 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "threshold": { 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "threshold", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3.0", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1.0", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.793 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "scaling threshold", 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "progress", 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.794 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_pg_recovery_event": { 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.795 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "enabled": { 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enabled", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.796 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.797 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.798 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.799 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.800 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.801 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "max_completed_events": { 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_completed_events", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.802 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "50", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.803 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.804 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prometheus", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "cache": { 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cache", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.805 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "exclude_perf_counters": { 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "exclude_perf_counters", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.806 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.807 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.808 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.809 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.810 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.811 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.812 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_stats_pools": { 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_stats_pools", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.813 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "300", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.814 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "scrape_interval": { 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "scrape_interval", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15.0", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.815 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.816 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "::", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.817 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "9283", 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "stale_cache_strategy": { 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "stale_cache_strategy", 2024-09-15T22:24:28.818 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "log", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_behaviour": { 2024-09-15T22:24:28.819 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_behaviour", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "default", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "default", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "error" 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.820 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_error_status_code": { 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_error_status_code", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "500", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "400", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "599", 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.821 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_support", 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.822 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.823 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.824 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.825 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.826 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.827 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "max_concurrent_snap_create": { 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.828 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.829 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "trash_purge_schedule": { 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "trash_purge_schedule", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.830 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "restful", 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.831 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "enable_auth": { 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enable_auth", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.832 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "key_file": { 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "key_file", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.833 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.834 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.835 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.836 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.837 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.838 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.839 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.840 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.841 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rgw", 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.842 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.843 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.844 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.845 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.846 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.847 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.848 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.849 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rook", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.850 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.851 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.852 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.853 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.854 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "storage_class": { 2024-09-15T22:24:28.855 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "storage_class", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "local", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.856 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "selftest", 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.857 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.858 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.859 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.860 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.861 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "roption1": { 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "roption1", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.863 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "roption2": { 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "roption2", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "xyz", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.864 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption1": { 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption1", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.865 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption2": { 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption2", 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.866 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption3": { 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption3", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.867 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption4": { 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption4", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.868 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption5": { 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption5", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.869 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption6": { 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption6", 2024-09-15T22:24:28.870 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption7": { 2024-09-15T22:24:28.871 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption7", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "42", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.872 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "testkey": { 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testkey", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.873 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "testlkey": { 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testlkey", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.874 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "testnewline": { 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testnewline", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.875 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snap_schedule", 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_m_granularity": { 2024-09-15T22:24:28.876 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_m_granularity", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.877 INFO:teuthology.orchestra.run.smithi150.stdout: "dump_on_update": { 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "dump_on_update", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.879 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.880 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.881 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.882 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.883 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.884 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "stats", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.885 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.887 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.888 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.889 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.890 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "status", 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.891 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.892 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.893 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.894 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.895 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.896 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "telegraf", 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "address": { 2024-09-15T22:24:28.897 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "address", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.898 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.900 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.901 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.902 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.903 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.904 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "telemetry", 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.905 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_basic": { 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_basic", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.906 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_crash": { 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_crash", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:24:28.907 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_device": { 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_device", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.908 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_ident": { 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_ident", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.909 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_perf": { 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_perf", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.910 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "contact": { 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "contact", 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.911 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "description": { 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "description", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.912 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "device_url": { 2024-09-15T22:24:28.913 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_url", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.914 INFO:teuthology.orchestra.run.smithi150.stdout: "enabled": { 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enabled", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "24", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "8", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.916 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "last_opt_revision": { 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "last_opt_revision", 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1", 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.917 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "leaderboard": { 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "leaderboard", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.918 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "leaderboard_description": { 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "leaderboard_description", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.919 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.920 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.921 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.922 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.923 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.924 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.925 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "organization": { 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "organization", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.926 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "proxy": { 2024-09-15T22:24:28.927 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "proxy", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.928 INFO:teuthology.orchestra.run.smithi150.stdout: "url": { 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "url", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "test_orchestrator", 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.930 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.931 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.932 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.933 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.934 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.935 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "volumes", 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.936 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.937 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.939 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.940 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "max_concurrent_clones": { 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_concurrent_clones", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "4", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:24:28.942 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "periodic_async_work": { 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "periodic_async_work", 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.943 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Periodically check for async work", 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot_clone_delay": { 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.944 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:24:28.945 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.946 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix", 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "discovery_interval": { 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "discovery_interval", 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.947 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "100", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "identifier": { 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "identifier", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.948 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:28.949 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.950 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.951 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.952 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.953 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.954 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.955 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_host": { 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_host", 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.956 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_port": { 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_port", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10051", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.957 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_sender": { 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_sender", 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:28.958 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:28.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "gid": 24116, 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "y", 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "available_modules": [ 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "alerts", 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:28.960 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.962 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.963 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.964 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.965 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.966 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_destination": { 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_destination", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.967 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_from_name": { 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_from_name", 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.968 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "Ceph", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Email From: name", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_host": { 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_host", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.969 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP server", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_password": { 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_password", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.970 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Password to authenticate with", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_port": { 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_port", 2024-09-15T22:24:28.971 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "465", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP port", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_sender": { 2024-09-15T22:24:28.972 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_sender", 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.973 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_ssl": { 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_ssl", 2024-09-15T22:24:28.976 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_user": { 2024-09-15T22:24:28.977 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_user", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "User to authenticate as", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.978 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "balancer", 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "active": { 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "active", 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.979 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "begin_time": { 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "begin_time", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.980 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0000", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "begin_weekday": { 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "begin_weekday", 2024-09-15T22:24:28.981 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "6", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.982 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_max_iterations": { 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "25", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "250", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.983 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_metrics": { 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_metrics", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.984 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_step": { 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_step", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0.5", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0.001", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "0.999", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:24:28.985 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "end_time": { 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "end_time", 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "2359", 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.986 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "end_weekday": { 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "end_weekday", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "6", 2024-09-15T22:24:28.987 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.988 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.990 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:28.991 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:28.992 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.993 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "min_score": { 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "min_score", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.994 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "mode": { 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mode", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "upmap", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "crush-compat", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "none", 2024-09-15T22:24:28.995 INFO:teuthology.orchestra.run.smithi150.stdout: "read", 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap", 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap-read" 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Balancer mode", 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "pool_ids": { 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pool_ids", 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:28.996 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:28.997 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:28.998 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap_max_deviation": { 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "upmap_max_deviation", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:28.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap_max_optimizations": { 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.000 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephadm", 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_down_multiplier": { 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_down_multiplier", 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.001 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3.0", 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_refresh_rate": { 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_refresh_rate", 2024-09-15T22:24:29.002 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "20", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_starting_port": { 2024-09-15T22:24:29.003 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_starting_port", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "4721", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_ptrace": { 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_ptrace", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:24:29.005 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "autotune_interval": { 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "autotune_interval", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:24:29.006 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0.7", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:24:29.007 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm_log_destination": { 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephadm_log_destination", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.008 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "file", 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "file,syslog", 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "syslog" 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "cgroups_split": { 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cgroups_split", 2024-09-15T22:24:29.009 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "config_checks_enabled": { 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_checks_enabled", 2024-09-15T22:24:29.010 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.011 INFO:teuthology.orchestra.run.smithi150.stdout: "config_dashboard": { 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_dashboard", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_alertmanager": { 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_alertmanager", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.013 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_base": { 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_base", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.014 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_elasticsearch": { 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.015 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "elasticsearch container image", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_grafana": { 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_grafana", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.016 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_haproxy": { 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_haproxy", 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:24:29.017 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "HAproxy container image", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_agent": { 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.018 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_collector": { 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.019 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_query": { 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:24:29.020 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger query container image", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_keepalived": { 2024-09-15T22:24:29.021 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_keepalived", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Keepalived container image", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_loki": { 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_loki", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Loki container image", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.023 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_node_exporter": { 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_node_exporter", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.024 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_nvmeof": { 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_nvmeof", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.025 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Nvme-of container image", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_prometheus": { 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_prometheus", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.026 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_promtail": { 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_promtail", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.027 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Promtail container image", 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_samba": { 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_samba", 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.028 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_snmp_gateway": { 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.029 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "container_init": { 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_init", 2024-09-15T22:24:29.030 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.031 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "daemon_cache_timeout": { 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.032 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "900", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:24:29.033 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "default_registry": { 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "default_registry", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.034 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "device_cache_timeout": { 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_cache_timeout", 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1800", 2024-09-15T22:24:29.035 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "device_enhanced_scan": { 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_enhanced_scan", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.036 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "facts_cache_timeout": { 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "facts_cache_timeout", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.037 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "grafana_dashboards_path": { 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:24:29.038 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.039 INFO:teuthology.orchestra.run.smithi150.stdout: "host_check_interval": { 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "host_check_interval", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "hw_monitoring": { 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "hw_monitoring", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.041 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "inventory_list_all": { 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "inventory_list_all", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.042 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.043 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.044 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "log_refresh_metadata": { 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_refresh_metadata", 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.045 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.046 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.047 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.048 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.049 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.050 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.051 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "*", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "max_count_per_host": { 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_count_per_host", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.052 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "max_osd_draining_count": { 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_osd_draining_count", 2024-09-15T22:24:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "migration_current": { 2024-09-15T22:24:29.054 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "migration_current", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "internal - do not modify", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.055 INFO:teuthology.orchestra.run.smithi150.stdout: "mode": { 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mode", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "root", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm-package", 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "root" 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.056 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "oob_default_addr": { 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "oob_default_addr", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "169.254.1.1", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.057 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "prometheus_alerts_path": { 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:24:29.058 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_insecure": { 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_insecure", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.059 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_password": { 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_password", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.060 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_url": { 2024-09-15T22:24:29.061 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_url", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.062 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_username": { 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_username", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.063 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "secure_monitoring_stack": { 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.064 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "service_discovery_port": { 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "service_discovery_port", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8765", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:24:29.065 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "ssh_config_file": { 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssh_config_file", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.066 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "use_agent": { 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "use_agent", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.067 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "use_repo_digest": { 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "use_repo_digest", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.068 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_failed_host_check": { 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.069 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_stray_daemons": { 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.070 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_stray_hosts": { 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.071 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.072 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crash", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.073 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.074 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.075 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.076 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.077 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "retain_interval": { 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "retain_interval", 2024-09-15T22:24:29.078 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "31536000", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_recent_interval": { 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_recent_interval", 2024-09-15T22:24:29.079 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1209600", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.080 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "dashboard", 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.081 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.082 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.083 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:24:29.084 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.085 INFO:teuthology.orchestra.run.smithi150.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.086 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.087 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.088 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.089 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.090 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.091 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.092 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:24:29.093 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.094 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.095 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.096 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.097 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.098 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_URL": { 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.099 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.100 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.101 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:24:29.102 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.103 INFO:teuthology.orchestra.run.smithi150.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.104 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.105 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.106 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.107 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.108 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.109 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.110 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.111 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.112 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.113 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.114 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:24:29.116 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.119 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "45", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.120 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.121 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.122 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.123 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.124 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.125 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.126 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.127 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "cross_origin_url": { 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cross_origin_url", 2024-09-15T22:24:29.128 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "crt_file": { 2024-09-15T22:24:29.129 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crt_file", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "debug": { 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "debug", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.131 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "jwt_token_ttl": { 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "jwt_token_ttl", 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "28800", 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.132 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "key_file": { 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "key_file", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.133 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.134 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.135 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.136 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.137 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.138 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.139 INFO:teuthology.orchestra.run.smithi150.stdout: "motd": { 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "motd", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "The message of the day", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.140 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.141 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "::", 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.142 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8080", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.143 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl": { 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl", 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.144 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl_server_port": { 2024-09-15T22:24:29.145 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl_server_port", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8443", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_behaviour": { 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_behaviour", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "redirect", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "redirect" 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.147 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_error_status_code": { 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_error_status_code", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "500", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "400", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "599", 2024-09-15T22:24:29.148 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "url_prefix": { 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "url_prefix", 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.149 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "devicehealth", 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.150 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "enable_monitoring": { 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enable_monitoring", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "monitor device health metrics", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.151 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.153 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.154 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.155 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.156 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "mark_out_threshold": { 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mark_out_threshold", 2024-09-15T22:24:29.157 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "2419200", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "pool_name": { 2024-09-15T22:24:29.158 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pool_name", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "device_health_metrics", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "retention_period": { 2024-09-15T22:24:29.159 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "retention_period", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15552000", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "scrape_frequency": { 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "scrape_frequency", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "86400", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:24:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "self_heal": { 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "self_heal", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.162 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.163 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_threshold": { 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_threshold", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "7257600", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.164 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "diskprediction_local", 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.165 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.166 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.167 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.168 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.169 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "predict_interval": { 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "predict_interval", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "86400", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "predictor_model": { 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "predictor_model", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "prophetstor", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.173 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "influx", 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": false, 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "batch_size": { 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "batch_size", 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5000", 2024-09-15T22:24:29.174 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "database": { 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "database", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "ceph", 2024-09-15T22:24:29.175 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": { 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "hostname", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.176 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.177 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.177 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.177 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.177 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:24:29.177 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.180 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "30", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "5", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.181 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.182 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.183 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.184 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.185 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.186 INFO:teuthology.orchestra.run.smithi150.stdout: "password": { 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "password", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "port": { 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "port", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8086", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB server port", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.188 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl": { 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "false", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:24:29.189 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "threads": { 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "threads", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "32", 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.190 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "username": { 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "username", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:24:29.191 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "verify_ssl": { 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "verify_ssl", 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "true", 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.192 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "insights", 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.193 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.194 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.195 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.196 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.197 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.198 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "iostat", 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.199 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.200 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.201 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.202 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.203 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.204 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "k8sevents", 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_event_retention_days": { 2024-09-15T22:24:29.205 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "7", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.206 INFO:teuthology.orchestra.run.smithi150.stdout: "config_check_secs": { 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_check_secs", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "10", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.207 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.208 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.209 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.210 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.211 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.212 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "localpool", 2024-09-15T22:24:29.213 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "failure_domain": { 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "failure_domain", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "host", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:24:29.214 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.215 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.216 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.217 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.218 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.219 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "min_size": { 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "min_size", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.220 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "num_rep": { 2024-09-15T22:24:29.221 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "num_rep", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:24:29.222 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_num": { 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pg_num", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "128", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.223 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "prefix": { 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prefix", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.224 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "subtree": { 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subtree", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "rack", 2024-09-15T22:24:29.225 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mds_autoscaler", 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.226 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.227 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.228 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.229 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.230 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.231 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.232 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mirroring", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.233 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.234 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.235 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.236 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.237 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.238 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "nfs", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.239 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.240 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.241 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.242 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.243 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.244 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "orchestrator", 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "fail_fs": { 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "fail_fs", 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.245 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.246 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.247 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.248 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.249 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.250 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator": { 2024-09-15T22:24:29.251 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "orchestrator", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "rook", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "test_orchestrator" 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Orchestrator backend", 2024-09-15T22:24:29.252 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "osd_perf_query", 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.253 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.254 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.255 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.256 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.257 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.258 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "osd_support", 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.259 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.260 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.261 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.262 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.263 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.264 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pg_autoscaler", 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.265 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.266 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.267 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.268 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.269 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.270 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.271 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "threshold": { 2024-09-15T22:24:29.272 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "threshold", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3.0", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1.0", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "scaling threshold", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.273 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "progress", 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_pg_recovery_event": { 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.274 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "enabled": { 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enabled", 2024-09-15T22:24:29.275 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.276 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.277 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.278 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.279 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.280 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.281 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "max_completed_events": { 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_completed_events", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "50", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.282 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.283 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prometheus", 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "cache": { 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cache", 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.284 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "exclude_perf_counters": { 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "exclude_perf_counters", 2024-09-15T22:24:29.285 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.286 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.287 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.288 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.289 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.290 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.291 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_stats_pools": { 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_stats_pools", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.292 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.293 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "300", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "scrape_interval": { 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "scrape_interval", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.294 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15.0", 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:29.295 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "::", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.296 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "9283", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.297 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "stale_cache_strategy": { 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "stale_cache_strategy", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "log", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.298 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_behaviour": { 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_behaviour", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "default", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.299 INFO:teuthology.orchestra.run.smithi150.stdout: "default", 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "error" 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_error_status_code": { 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_error_status_code", 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.300 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "500", 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "400", 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "599", 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.301 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_support", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.302 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.303 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.304 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.305 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "max_concurrent_snap_create": { 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:24:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "trash_purge_schedule": { 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "trash_purge_schedule", 2024-09-15T22:24:29.309 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "restful", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "enable_auth": { 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enable_auth", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.311 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "key_file": { 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "key_file", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.312 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.313 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.314 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.315 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.316 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.317 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:29.318 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:29.319 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rgw", 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.321 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.322 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.323 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.324 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.327 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rook", 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.328 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.329 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.330 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.331 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.332 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "storage_class": { 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "storage_class", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "local", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "selftest", 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.338 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.339 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.340 INFO:teuthology.orchestra.run.smithi150.stdout: "roption1": { 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "roption1", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "roption2": { 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "roption2", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "xyz", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption1": { 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption1", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.343 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption2": { 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption2", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.344 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption3": { 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption3", 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.345 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption4": { 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption4", 2024-09-15T22:24:29.346 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption5": { 2024-09-15T22:24:29.347 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption5", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption6": { 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption6", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.349 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption7": { 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption7", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "42", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.350 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "testkey": { 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testkey", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.351 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "testlkey": { 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testlkey", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.352 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "testnewline": { 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testnewline", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.353 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snap_schedule", 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.354 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_m_granularity": { 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_m_granularity", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.355 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "dump_on_update": { 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "dump_on_update", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:24:29.356 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.357 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.359 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.360 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.361 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.362 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "stats", 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.363 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.365 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.366 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.367 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.368 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "status", 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.369 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.370 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.371 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.372 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.373 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.374 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "telegraf", 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "address": { 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "address", 2024-09-15T22:24:29.375 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.376 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.377 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.378 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.379 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.380 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.382 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.383 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.383 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.383 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "telemetry", 2024-09-15T22:24:29.383 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_basic": { 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_basic", 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.384 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_crash": { 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_crash", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.385 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_device": { 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_device", 2024-09-15T22:24:29.386 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_ident": { 2024-09-15T22:24:29.387 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_ident", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_perf": { 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_perf", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.389 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "contact": { 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "contact", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.390 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "description": { 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "description", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.391 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "device_url": { 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_url", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.392 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "enabled": { 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enabled", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.393 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.394 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "24", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "8", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "last_opt_revision": { 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "last_opt_revision", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "leaderboard": { 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "leaderboard", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.396 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "leaderboard_description": { 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "leaderboard_description", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.397 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.398 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.399 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.400 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.401 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.402 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "organization": { 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "organization", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.403 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "proxy": { 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "proxy", 2024-09-15T22:24:29.404 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "url": { 2024-09-15T22:24:29.405 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "url", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "test_orchestrator", 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.407 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.409 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.410 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.411 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "volumes", 2024-09-15T22:24:29.412 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.413 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.414 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.415 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.416 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.417 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "max_concurrent_clones": { 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_concurrent_clones", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.418 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "4", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "periodic_async_work": { 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "periodic_async_work", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.419 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Periodically check for async work", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot_clone_delay": { 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.420 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.421 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.422 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "discovery_interval": { 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "discovery_interval", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "100", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.423 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "identifier": { 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "identifier", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.424 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.425 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.426 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.427 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.428 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.429 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.431 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_host": { 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_host", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.432 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_port": { 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_port", 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10051", 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.433 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_sender": { 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_sender", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.434 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.435 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "modules": [ 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm", 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "dashboard", 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "iostat", 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "nfs", 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "restful" 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "available_modules": [ 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "alerts", 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.436 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.437 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.438 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.440 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.441 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.442 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_destination": { 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_destination", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.443 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_from_name": { 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_from_name", 2024-09-15T22:24:29.444 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "Ceph", 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Email From: name", 2024-09-15T22:24:29.445 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_host": { 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_host", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.446 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP server", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_password": { 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_password", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.447 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Password to authenticate with", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_port": { 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_port", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "465", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.448 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP port", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_sender": { 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_sender", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.449 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_ssl": { 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_ssl", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.450 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "smtp_user": { 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "smtp_user", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.451 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "User to authenticate as", 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "balancer", 2024-09-15T22:24:29.452 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "active": { 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "active", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:24:29.453 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "begin_time": { 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "begin_time", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0000", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:24:29.454 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "begin_weekday": { 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "begin_weekday", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "6", 2024-09-15T22:24:29.455 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_max_iterations": { 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "25", 2024-09-15T22:24:29.456 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "250", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_metrics": { 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_metrics", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.457 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "crush_compat_step": { 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crush_compat_step", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.458 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0.5", 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0.001", 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "0.999", 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "end_time": { 2024-09-15T22:24:29.459 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "end_time", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "2359", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "end_weekday": { 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "end_weekday", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "0", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "6", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:24:29.461 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.462 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.465 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.466 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "min_score": { 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "min_score", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.467 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "mode": { 2024-09-15T22:24:29.468 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mode", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "upmap", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "crush-compat", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "none", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "read", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap", 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap-read" 2024-09-15T22:24:29.469 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Balancer mode", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "pool_ids": { 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pool_ids", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.470 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.471 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap_max_deviation": { 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "upmap_max_deviation", 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.472 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "upmap_max_optimizations": { 2024-09-15T22:24:29.473 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.474 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephadm", 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_down_multiplier": { 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_down_multiplier", 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3.0", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_refresh_rate": { 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_refresh_rate", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "20", 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "agent_starting_port": { 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "agent_starting_port", 2024-09-15T22:24:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "4721", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_ptrace": { 2024-09-15T22:24:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_ptrace", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "autotune_interval": { 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "autotune_interval", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0.7", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm_log_destination": { 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cephadm_log_destination", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "file", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "file,syslog", 2024-09-15T22:24:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "syslog" 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "cgroups_split": { 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cgroups_split", 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "config_checks_enabled": { 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_checks_enabled", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "config_dashboard": { 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_dashboard", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_alertmanager": { 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_alertmanager", 2024-09-15T22:24:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_base": { 2024-09-15T22:24:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_base", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_elasticsearch": { 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "elasticsearch container image", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_grafana": { 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_grafana", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_haproxy": { 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_haproxy", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "HAproxy container image", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_agent": { 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_collector": { 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:24:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_jaeger_query": { 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Jaeger query container image", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_keepalived": { 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_keepalived", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Keepalived container image", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_loki": { 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_loki", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Loki container image", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_node_exporter": { 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_node_exporter", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_nvmeof": { 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_nvmeof", 2024-09-15T22:24:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Nvme-of container image", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_prometheus": { 2024-09-15T22:24:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_prometheus", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Prometheus container image", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_promtail": { 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_promtail", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Promtail container image", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_samba": { 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_samba", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "container_image_snmp_gateway": { 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "container_init": { 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "container_init", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:24:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "daemon_cache_timeout": { 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "900", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "default_registry": { 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "default_registry", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "docker.io", 2024-09-15T22:24:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "device_cache_timeout": { 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_cache_timeout", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1800", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "device_enhanced_scan": { 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_enhanced_scan", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "facts_cache_timeout": { 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "facts_cache_timeout", 2024-09-15T22:24:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "grafana_dashboards_path": { 2024-09-15T22:24:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "host_check_interval": { 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "host_check_interval", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "hw_monitoring": { 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "hw_monitoring", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "inventory_list_all": { 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "inventory_list_all", 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "log_refresh_metadata": { 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_refresh_metadata", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "*", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:24:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "max_count_per_host": { 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_count_per_host", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "max_osd_draining_count": { 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_osd_draining_count", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "migration_current": { 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "migration_current", 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "internal - do not modify", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "mode": { 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mode", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "root", 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm-package", 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "root" 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "oob_default_addr": { 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "oob_default_addr", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "169.254.1.1", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "prometheus_alerts_path": { 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_insecure": { 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_insecure", 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_password": { 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_password", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_url": { 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_url", 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "registry_username": { 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "registry_username", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "secure_monitoring_stack": { 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:24:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "service_discovery_port": { 2024-09-15T22:24:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "service_discovery_port", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8765", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "ssh_config_file": { 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssh_config_file", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "use_agent": { 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "use_agent", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "use_repo_digest": { 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "use_repo_digest", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_failed_host_check": { 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:24:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_stray_daemons": { 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_on_stray_hosts": { 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crash", 2024-09-15T22:24:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "retain_interval": { 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "retain_interval", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "31536000", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_recent_interval": { 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_recent_interval", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1209600", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "dashboard", 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:24:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:24:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:24:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:24:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.571 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.572 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_URL": { 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.573 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.574 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.576 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.577 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.578 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.579 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:24:29.580 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.581 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.582 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.584 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.585 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.586 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.587 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.589 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.590 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.591 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:24:29.592 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.594 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "45", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.595 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.596 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "admin", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.597 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:24:29.598 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.599 INFO:teuthology.orchestra.run.smithi150.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.600 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.601 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.602 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.603 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "cross_origin_url": { 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cross_origin_url", 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.604 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "crt_file": { 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "crt_file", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.606 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "debug": { 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "debug", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.607 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "jwt_token_ttl": { 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "jwt_token_ttl", 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "28800", 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.608 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.609 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.609 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.609 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.609 INFO:teuthology.orchestra.run.smithi150.stdout: "key_file": { 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "key_file", 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.610 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.611 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.612 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.613 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.614 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.615 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.616 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.616 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.616 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.616 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.616 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.617 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "motd": { 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "motd", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "The message of the day", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:24:29.619 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.620 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "::", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.621 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8080", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.622 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl": { 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.623 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl_server_port": { 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl_server_port", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8443", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.624 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_behaviour": { 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_behaviour", 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "redirect", 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.625 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "redirect" 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.626 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_error_status_code": { 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_error_status_code", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "500", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "400", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "599", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.627 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "url_prefix": { 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "url_prefix", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.628 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "devicehealth", 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.629 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "enable_monitoring": { 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enable_monitoring", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.630 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "monitor device health metrics", 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.631 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.632 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.633 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.634 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.635 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.636 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "mark_out_threshold": { 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mark_out_threshold", 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "2419200", 2024-09-15T22:24:29.637 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "pool_name": { 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pool_name", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.638 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "device_health_metrics", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "retention_period": { 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "retention_period", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.639 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15552000", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "scrape_frequency": { 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "scrape_frequency", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.640 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "86400", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "self_heal": { 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "self_heal", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.641 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.642 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "warn_threshold": { 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "warn_threshold", 2024-09-15T22:24:29.643 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "7257600", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "diskprediction_local", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.645 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.646 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.647 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.648 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.649 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.650 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "predict_interval": { 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "predict_interval", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "86400", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.651 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "predictor_model": { 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "predictor_model", 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.652 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "prophetstor", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.653 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "600", 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.654 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "influx", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": false, 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "batch_size": { 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "batch_size", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5000", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.655 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "database": { 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "database", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "ceph", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.656 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": { 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "hostname", 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.657 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.658 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "30", 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "5", 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.659 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.660 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.661 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.662 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.663 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.663 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.663 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.663 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.663 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.664 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.664 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.664 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.664 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.664 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.664 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.665 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.665 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.665 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.665 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.665 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.665 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.666 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.666 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.666 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.666 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.666 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.667 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.668 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.668 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.668 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.668 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.668 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.669 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.669 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.669 INFO:teuthology.orchestra.run.smithi150.stdout: "password": { 2024-09-15T22:24:29.669 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "password", 2024-09-15T22:24:29.669 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.670 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:24:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.671 INFO:teuthology.orchestra.run.smithi150.stdout: "port": { 2024-09-15T22:24:29.672 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "port", 2024-09-15T22:24:29.672 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.672 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.672 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.672 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "8086", 2024-09-15T22:24:29.672 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.673 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.673 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.673 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "InfluxDB server port", 2024-09-15T22:24:29.673 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.673 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.673 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: "ssl": { 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ssl", 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.674 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "false", 2024-09-15T22:24:29.675 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.675 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.675 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.675 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:24:29.675 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.675 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: "threads": { 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "threads", 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.676 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "32", 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.677 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: "username": { 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "username", 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.678 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.679 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "verify_ssl": { 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "verify_ssl", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "true", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.680 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "insights", 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.681 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.682 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.683 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.684 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.686 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "iostat", 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.687 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.688 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.689 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.690 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.691 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.692 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "k8sevents", 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_event_retention_days": { 2024-09-15T22:24:29.693 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "7", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "config_check_secs": { 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "config_check_secs", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "10", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.696 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.697 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.698 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.699 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.700 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "localpool", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "failure_domain": { 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "failure_domain", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "host", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.702 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.703 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.704 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.705 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.706 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.707 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.708 INFO:teuthology.orchestra.run.smithi150.stdout: "min_size": { 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "min_size", 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.709 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "num_rep": { 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "num_rep", 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.710 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3", 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.711 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_num": { 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pg_num", 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.712 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "128", 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.713 INFO:teuthology.orchestra.run.smithi150.stdout: "prefix": { 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prefix", 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.714 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "subtree": { 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "subtree", 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.715 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "rack", 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:24:29.716 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mds_autoscaler", 2024-09-15T22:24:29.717 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.718 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.719 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.720 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.721 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.722 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.723 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mirroring", 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.726 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.727 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.728 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.729 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.730 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "nfs", 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.731 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.732 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.733 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.734 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.735 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.736 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.737 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "orchestrator", 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.738 INFO:teuthology.orchestra.run.smithi150.stdout: "fail_fs": { 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "fail_fs", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.739 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.740 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.741 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.742 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.743 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.743 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.743 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.743 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.743 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.743 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.744 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.744 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.744 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.744 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.744 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.745 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.745 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.745 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.745 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.745 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.745 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.746 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.746 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.746 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.747 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.747 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.747 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.747 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.747 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.747 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.748 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.749 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.750 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.750 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.750 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator": { 2024-09-15T22:24:29.750 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "orchestrator", 2024-09-15T22:24:29.750 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.751 INFO:teuthology.orchestra.run.smithi150.stdout: "cephadm", 2024-09-15T22:24:29.752 INFO:teuthology.orchestra.run.smithi150.stdout: "rook", 2024-09-15T22:24:29.752 INFO:teuthology.orchestra.run.smithi150.stdout: "test_orchestrator" 2024-09-15T22:24:29.752 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.752 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Orchestrator backend", 2024-09-15T22:24:29.752 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.752 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.753 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.753 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.753 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.753 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.753 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.753 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "osd_perf_query", 2024-09-15T22:24:29.754 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.754 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.754 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.754 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.754 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.754 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.756 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.757 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.757 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.757 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.757 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.757 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.757 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.758 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.759 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.760 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.761 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "osd_support", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.762 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.763 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.764 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.765 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.766 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.767 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "pg_autoscaler", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.768 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.769 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.770 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.771 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.772 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.773 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "threshold": { 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "threshold", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "3.0", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1.0", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.774 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "scaling threshold", 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "progress", 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_pg_recovery_event": { 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:24:29.775 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "enabled": { 2024-09-15T22:24:29.776 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enabled", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.777 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.778 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.779 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.780 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.781 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.782 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "max_completed_events": { 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_completed_events", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "50", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.783 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "sleep_interval": { 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "sleep_interval", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:24:29.784 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "prometheus", 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "cache": { 2024-09-15T22:24:29.785 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "cache", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.786 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "exclude_perf_counters": { 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "exclude_perf_counters", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:24:29.787 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.788 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.789 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.790 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.792 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.792 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.792 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.792 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.792 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.793 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.794 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.795 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_stats_pools": { 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_stats_pools", 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.796 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:24:29.797 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "300", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "scrape_interval": { 2024-09-15T22:24:29.798 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "scrape_interval", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15.0", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "::", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.800 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "9283", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.801 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "stale_cache_strategy": { 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "stale_cache_strategy", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "log", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.802 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_behaviour": { 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_behaviour", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "default", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "default", 2024-09-15T22:24:29.803 INFO:teuthology.orchestra.run.smithi150.stdout: "error" 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "standby_error_status_code": { 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "standby_error_status_code", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "500", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "400", 2024-09-15T22:24:29.804 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "599", 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_support", 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.805 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.806 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.807 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.808 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.809 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.809 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.809 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.809 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.809 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.810 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.810 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.810 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.810 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.810 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.810 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.811 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.812 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.813 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.813 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.813 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.813 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.813 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.813 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.814 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.814 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.814 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.814 INFO:teuthology.orchestra.run.smithi150.stdout: "max_concurrent_snap_create": { 2024-09-15T22:24:29.814 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:24:29.815 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.815 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.815 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.815 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10", 2024-09-15T22:24:29.815 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.815 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.816 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "trash_purge_schedule": { 2024-09-15T22:24:29.817 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "trash_purge_schedule", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.818 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.819 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.819 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.819 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.819 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "restful", 2024-09-15T22:24:29.819 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.819 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.820 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.820 INFO:teuthology.orchestra.run.smithi150.stdout: "enable_auth": { 2024-09-15T22:24:29.820 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enable_auth", 2024-09-15T22:24:29.820 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.820 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.820 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.821 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.821 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.821 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.821 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.821 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.821 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "key_file": { 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "key_file", 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.822 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.823 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.824 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.824 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.824 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.824 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.824 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.824 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.825 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.825 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.825 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.825 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.825 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.826 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.826 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.826 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.826 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.826 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.826 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.827 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.828 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.829 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.830 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.831 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "server_addr": { 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_addr", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.832 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "server_port": { 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "server_port", 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.833 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rgw", 2024-09-15T22:24:29.834 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.835 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.836 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.837 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.838 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.839 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.840 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "5", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.841 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rook", 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.842 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.843 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.844 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.845 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.846 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.847 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "storage_class": { 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "storage_class", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "local", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.848 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "selftest", 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.849 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.850 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.851 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.852 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.853 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.854 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "roption1": { 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "roption1", 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.855 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "roption2": { 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "roption2", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "xyz", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.856 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption1": { 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption1", 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.857 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption2": { 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption2", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.858 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption3": { 2024-09-15T22:24:29.859 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption3", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "float", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.860 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption4": { 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption4", 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.861 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption5": { 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption5", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.862 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption6": { 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption6", 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.863 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "rwoption7": { 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rwoption7", 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.864 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "1", 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "42", 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.865 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "testkey": { 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testkey", 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "testlkey": { 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testlkey", 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.867 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.868 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.868 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.868 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.868 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.868 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.868 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: "testnewline": { 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "testnewline", 2024-09-15T22:24:29.869 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.870 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snap_schedule", 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "allow_m_granularity": { 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "allow_m_granularity", 2024-09-15T22:24:29.871 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.872 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "dump_on_update": { 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "dump_on_update", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.873 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.874 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.875 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.876 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.877 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.878 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.879 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "stats", 2024-09-15T22:24:29.880 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.881 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.882 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.883 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.884 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.885 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "status", 2024-09-15T22:24:29.886 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.887 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.888 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.889 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.890 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.891 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "telegraf", 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "address": { 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "address", 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.893 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.894 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "15", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.895 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.896 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.896 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.896 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.896 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.896 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.897 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.898 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.899 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.900 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.901 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.902 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "telemetry", 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_basic": { 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_basic", 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.903 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_crash": { 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_crash", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.904 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_device": { 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_device", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.905 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_ident": { 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_ident", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.906 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "channel_perf": { 2024-09-15T22:24:29.907 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "channel_perf", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.908 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "contact": { 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "contact", 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.909 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.910 INFO:teuthology.orchestra.run.smithi150.stdout: "description": { 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "description", 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.911 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "device_url": { 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "device_url", 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.912 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.913 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "enabled": { 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "enabled", 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.914 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.915 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "24", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "8", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.916 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "last_opt_revision": { 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "last_opt_revision", 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "1", 2024-09-15T22:24:29.917 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "leaderboard": { 2024-09-15T22:24:29.918 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "leaderboard", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.919 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "leaderboard_description": { 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "leaderboard_description", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.920 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.921 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.922 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.923 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.924 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.925 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "organization": { 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "organization", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.926 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "proxy": { 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "proxy", 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.927 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.928 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "url": { 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "url", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.929 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "test_orchestrator", 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.930 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.932 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.933 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.934 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.935 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.936 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "volumes", 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.937 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.938 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.939 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.940 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.942 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.943 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.944 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "max_concurrent_clones": { 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "max_concurrent_clones", 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "4", 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.946 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "periodic_async_work": { 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "periodic_async_work", 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.947 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Periodically check for async work", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot_clone_delay": { 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.948 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "0", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.949 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "True", 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix", 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "can_run": true, 2024-09-15T22:24:29.950 INFO:teuthology.orchestra.run.smithi150.stdout: "error_string": "", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "module_options": { 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "discovery_interval": { 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "discovery_interval", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "uint", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "100", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.951 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "identifier": { 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "identifier", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.952 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "interval": { 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "interval", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "secs", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "60", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.953 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "log_level": { 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_level", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.954 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster": { 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.955 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_cluster_level": { 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_cluster_level", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.956 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "info", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [ 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "critical", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "debug", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "error", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "info", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "warning" 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.957 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "log_to_file": { 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "log_to_file", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "bool", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 1, 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "False", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.958 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_host": { 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_host", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.959 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_port": { 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_port", 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "int", 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "10051", 2024-09-15T22:24:29.960 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "zabbix_sender": { 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "zabbix_sender", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "str", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "level": "advanced", 2024-09-15T22:24:29.961 INFO:teuthology.orchestra.run.smithi150.stdout: "flags": 0, 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "min": "", 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "max": "", 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "enum_allowed": [], 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "desc": "", 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "long_desc": "", 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "tags": [], 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "see_also": [] 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.962 INFO:teuthology.orchestra.run.smithi150.stdout: "services": { 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "dashboard": "https://172.21.15.150:8443/" 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "always_on_modules": { 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "octopus": [ 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "balancer", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "crash", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "devicehealth", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_autoscaler", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "progress", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_support", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "status", 2024-09-15T22:24:29.963 INFO:teuthology.orchestra.run.smithi150.stdout: "telemetry", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "volumes" 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "pacific": [ 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "balancer", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "crash", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "devicehealth", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_autoscaler", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "progress", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_support", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "status", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "telemetry", 2024-09-15T22:24:29.964 INFO:teuthology.orchestra.run.smithi150.stdout: "volumes" 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "quincy": [ 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "balancer", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "crash", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "devicehealth", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_autoscaler", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "progress", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_support", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "status", 2024-09-15T22:24:29.965 INFO:teuthology.orchestra.run.smithi150.stdout: "telemetry", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "volumes" 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "reef": [ 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "balancer", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "crash", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "devicehealth", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_autoscaler", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "progress", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_support", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "status", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "telemetry", 2024-09-15T22:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: "volumes" 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "squid": [ 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "balancer", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "crash", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "devicehealth", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "orchestrator", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "pg_autoscaler", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "progress", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "rbd_support", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "status", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "telemetry", 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "volumes" 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: "last_failure_osd_epoch": 3, 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: "active_clients": [ 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "devicehealth", 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3540537585 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "libcephsqlite", 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3823234340 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.969 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "rbd_support", 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3558756482 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "name": "volumes", 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "addrvec": [ 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-09-15T22:24:29.970 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v2", 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2942053054 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-09-15T22:24:29.971 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:24:29.972 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1221434340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:24:29.972 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:28 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3507359121' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:24:29.973 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:28 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1221434340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:24:29.973 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:28 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3507359121' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:24:29.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f96280a32d0 msgr2=0x7f96280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.973 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f96280a32d0 0x7f96280a5790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f962c0095f0 tx=0x7f962c005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 msgr2=0x7f9640199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 0x7f9640199e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f963400e9c0 tx=0x7f963400ee80 comp rx=0 tx=0).stop 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 shutdown_connections 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9640105720 0x7f96401a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9640104d60 0x7f964019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f96280a32d0 0x7f96280a5790 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 --2- 172.21.15.150:0/3507359121 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9640103b70 0x7f9640199e20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 >> 172.21.15.150:0/3507359121 conn(0x7f96400ff2f0 msgr2=0x7f9640108060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 shutdown_connections 2024-09-15T22:24:29.974 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:28.469+0000 7f9646a00640 1 -- 172.21.15.150:0/3507359121 wait complete. 2024-09-15T22:24:30.036 DEBUG:tasks.check_counter:Getting stats from a 2024-09-15T22:24:30.036 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-15T22:24:30.037 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:28 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1221434340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:24:30.037 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:28 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3507359121' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:24:30.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:29 smithi169 ceph-mon[35850]: pgmap v727: 97 pgs: 97 active+clean; 840 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 389 op/s 2024-09-15T22:24:30.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:29 smithi154 ceph-mon[34853]: pgmap v727: 97 pgs: 97 active+clean; 840 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 389 op/s 2024-09-15T22:24:30.416 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:30.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:29 smithi150 ceph-mon[30886]: pgmap v727: 97 pgs: 97 active+clean; 840 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 389 op/s 2024-09-15T22:24:30.995 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:24:30.995 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:30.995 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1644, 2024-09-15T22:24:30.995 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 1613, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 43052985, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 582548, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 3, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.357521452, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.105433108, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.155309874, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.082363000, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1612, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.170783669, 2024-09-15T22:24:30.996 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000105945 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 693248, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 148160 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 839, 2024-09-15T22:24:30.997 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 1017, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 46536926, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 663285, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.219689682, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.049581059, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.115223823, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.043552021, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1016, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.185597781, 2024-09-15T22:24:30.998 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000182674 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 398016 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 594, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 596, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 75650279, 2024-09-15T22:24:30.999 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 188904, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 6, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.225839775, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.017891558, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.156871499, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.042093577, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 594, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.059901426, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000100844 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.000 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 1, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.001 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-MDSRank": { 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 4709, 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.200165149, 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000042506 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.002 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "request": 0, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "reply": 0, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "reply_latency": { 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_reply": 0, 2024-09-15T22:24:31.003 INFO:teuthology.orchestra.run.smithi150.stdout: "forward": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_complete": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_commit": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_split": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_merge": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes": 18709, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_top": 205, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_bottom": 18504, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pin_tail": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pinned": 18416, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_expired": 0, 2024-09-15T22:24:31.004 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "subtrees": 2, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_hit": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_forward": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_discover": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_lock": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "load_cent": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "q": 0, 2024-09-15T22:24:31.005 INFO:teuthology.orchestra.run.smithi150.stdout: "exported": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "exported_inodes": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "imported": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "imported_inodes": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rfiles": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rbytes": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rsnaps": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:31.006 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:24:31.007 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_cap_release": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "process_request_cap_release": 0 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_cache": { 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_try_discover": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_send_discover": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_handle_discover": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:31.008 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_created": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_enqueued": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_migrated": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_started": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_completed": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:31.009 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_exportdir": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_flush": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_inodestats": 0 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_log": { 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "evlrg": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "evadd": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "evex": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "evtrm": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "ev": 83759, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "evexg": 0, 2024-09-15T22:24:31.010 INFO:teuthology.orchestra.run.smithi150.stdout: "evexd": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "segadd": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "segex": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "segtrm": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "seg": 108, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "segmjr": 8, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "segexg": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "segexd": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "expos": 4194304, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "wrpos": 167953696, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "rdpos": 167952558, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "jlat": { 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.011 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "replayed": 83759 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_mem": { 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "ino": 14, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "ino+": 38269, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "ino-": 38255, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "dir": 19, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "dir+": 1718, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "dir-": 1699, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "dn": 18231, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "dn+": 85359, 2024-09-15T22:24:31.012 INFO:teuthology.orchestra.run.smithi150.stdout: "dn-": 67128, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "cap": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "cap+": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "cap-": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "rss": 82264, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "heap": 215328 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_server": { 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_client_request": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_server_request": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_request": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_session": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_peer_request": 0, 2024-09-15T22:24:31.013 INFO:teuthology.orchestra.run.smithi150.stdout: "req_create_latency": { 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getattr_latency": { 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.014 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "req_link_latency": { 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookup_latency": { 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupino_latency": { 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.016 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupname_latency": { 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.017 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lssnap_latency": { 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.019 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mkdir_latency": { 2024-09-15T22:24:31.019 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mknod_latency": { 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mksnap_latency": { 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "req_open_latency": { 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "req_readdir_latency": { 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rename_latency": { 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.021 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.022 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmdir_latency": { 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setattr_latency": { 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.024 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setlayout_latency": { 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setxattr_latency": { 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "req_symlink_latency": { 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "req_unlink_latency": { 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:31.026 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_sessions": { 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "session_count": 1, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "session_add": 1, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "session_remove": 0, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_open": 1, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_stale": 0, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "total_load": 0, 2024-09-15T22:24:31.027 INFO:teuthology.orchestra.run.smithi150.stdout: "average_load": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "avg_session_uptime": 1819, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:31.028 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:31.029 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:31.030 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 243420, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 205, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:31.031 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 160, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 13549444, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 97427, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-15T22:24:31.032 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "objecter": { 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_active": 0, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_laggy": 0, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send": 2794, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send_bytes": 21, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_resend": 3, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_reply": 2794, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "op_latency": { 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2794, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 12.695753336, 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.004543934 2024-09-15T22:24:31.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "op_inflight": 0, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "oplen_avg": { 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2794, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 2795 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "op": 2794, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "op_r": 2794, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "op_w": 0, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "op_rmw": 0, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "op_pg": 0, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_stat": 1525, 2024-09-15T22:24:31.034 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_create": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_read": 1267, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_write": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writefull": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writesame": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_append": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_zero": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_truncate": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_delete": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_mapext": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:31.035 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_getxattr": 1, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_setxattr": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_call": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_watch": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_notify": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_other": 0, 2024-09-15T22:24:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_active": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_send": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_resend": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_ping": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_active": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_send": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_resend": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_active": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_send": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_resend": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_active": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_send": 0, 2024-09-15T22:24:31.037 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_resend": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "command_active": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "command_send": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "command_resend": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "map_epoch": 84, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "map_full": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "map_inc": 4, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_sessions": 11, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_open": 11, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_close": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_laggy": 0, 2024-09-15T22:24:31.038 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_wr": 0, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_rd": 2, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_del": 0 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "oft": { 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_objs": 0, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_updates": 0, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_removes": 0 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "osd-slow-ops": { 2024-09-15T22:24:31.039 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_ops_count": 0 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "purge_queue": { 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing": 0, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_high_water": 0, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed_ops": 0, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed": 0, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 3073, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 164946402, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 3073, 2024-09-15T22:24:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 3073, 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 164946402, 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.044 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 2794, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 163761590, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 2794, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 163761590, 2024-09-15T22:24:31.045 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1024, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:31.046 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 2794, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 2794, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 2794, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 2794, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-09-15T22:24:31.047 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.048 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle-0x55e7cb9ecbe0": { 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:31.049 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:31.050 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:24:31.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:31 smithi150 ceph-mon[30886]: pgmap v728: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 864 KiB/s wr, 304 op/s 2024-09-15T22:24:31.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:31 smithi154 ceph-mon[34853]: pgmap v728: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 864 KiB/s wr, 304 op/s 2024-09-15T22:24:31.880 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-15T22:24:31.880 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-15T22:24:31.881 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-15T22:24:31.881 DEBUG:tasks.check_counter:Getting stats from d 2024-09-15T22:24:31.881 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-15T22:24:31.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:31 smithi169 ceph-mon[35850]: pgmap v728: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 864 KiB/s wr, 304 op/s 2024-09-15T22:24:32.251 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:32.819 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:24:32.819 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 251, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 246, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 491056, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 150608, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.062415808, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.025794139, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.037681781, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:32.820 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 246, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.038487031, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000156451 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 491056, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 150608 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.821 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 186, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 111216, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.023448800, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.019606320, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.001586108, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 184, 2024-09-15T22:24:32.822 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.014134845, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000076819 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 111216 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 0, 2024-09-15T22:24:32.823 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 2, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 0, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 1, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.000725551, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000567991, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:32.824 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-15T22:24:32.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:32.826 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 148967, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 29, 2024-09-15T22:24:32.828 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:32.829 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 928, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 248, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 453134, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:32.830 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 248, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 248, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 453134, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:32.831 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:24:33.607 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:33 smithi150 ceph-mon[30886]: pgmap v729: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 804 KiB/s wr, 260 op/s 2024-09-15T22:24:33.643 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-15T22:24:33.643 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-15T22:24:33.643 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-15T22:24:33.644 DEBUG:tasks.check_counter:Getting stats from g 2024-09-15T22:24:33.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-15T22:24:33.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:33 smithi154 ceph-mon[34853]: pgmap v729: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 804 KiB/s wr, 260 op/s 2024-09-15T22:24:33.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:33 smithi169 ceph-mon[35850]: pgmap v729: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 804 KiB/s wr, 260 op/s 2024-09-15T22:24:34.017 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 243, 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 240, 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 486352, 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 147904, 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2024-09-15T22:24:34.571 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.055215771, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.028494068, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.028229138, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 239, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.020428572, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000085475 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:34.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 486352, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 147904 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 183, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 160, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 110688, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.022718660, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.019067829, 2024-09-15T22:24:34.573 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.001326766, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 181, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.026895731, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000148595 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:34.574 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 110688 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 4, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 4, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 448, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 1, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.003566675, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000067061, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.003332316, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:24:34.575 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.005869657, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001956552 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:24:34.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:34.577 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:34.578 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:34.579 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 148967, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 29, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-15T22:24:34.580 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 928, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:34.581 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 244, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 451977, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 244, 2024-09-15T22:24:34.582 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 244, 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 451977, 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:34.583 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:24:35.310 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-15T22:24:35.310 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-15T22:24:35.310 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-15T22:24:35.310 DEBUG:tasks.check_counter:Getting stats from j 2024-09-15T22:24:35.310 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-15T22:24:35.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:35 smithi150 ceph-mon[30886]: pgmap v730: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 804 KiB/s wr, 227 op/s 2024-09-15T22:24:35.683 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:35.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:35 smithi154 ceph-mon[34853]: pgmap v730: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 804 KiB/s wr, 227 op/s 2024-09-15T22:24:35.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:35 smithi169 ceph-mon[35850]: pgmap v730: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 804 KiB/s wr, 227 op/s 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1963, 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 1932, 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 165076418, 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 686262, 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:36.305 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 3, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.530746788, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.095103159, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.339608687, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.082308102, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1931, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.194211259, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000100575 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.306 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 696048, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 152976 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 604, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 788, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 159549319, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 679202, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 8, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:36.307 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.419532059, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.040306869, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.315929222, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.053936726, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 787, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.069817890, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000088713 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 488976 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 922, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 924, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 168016266, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 293203, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 6, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.419299282, 2024-09-15T22:24:36.309 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.029615533, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.329263446, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.049449702, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 922, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.071791313, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000077864 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 1, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-MDSRank": { 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 5171, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.176167932, 2024-09-15T22:24:36.311 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000034068 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-09-15T22:24:36.312 INFO:teuthology.orchestra.run.smithi150.stdout: "request": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "reply": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "reply_latency": { 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_reply": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "forward": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_complete": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_commit": 0, 2024-09-15T22:24:36.313 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_split": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_merge": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes": 35633, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_top": 2660, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_bottom": 32973, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pin_tail": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pinned": 31832, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_expired": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "subtrees": 1, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse": 0, 2024-09-15T22:24:36.314 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_hit": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_forward": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_discover": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_lock": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "load_cent": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "q": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "exported": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "exported_inodes": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "imported": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "imported_inodes": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:36.315 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rfiles": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rbytes": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rsnaps": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:36.316 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_cap_release": 0, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "process_request_cap_release": 0 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_cache": { 2024-09-15T22:24:36.317 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_try_discover": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_send_discover": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_handle_discover": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_created": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_enqueued": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_migrated": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:36.318 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_started": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_completed": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_exportdir": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_flush": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_inodestats": 0 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.319 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_log": { 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "evlrg": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "evadd": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "evex": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "evtrm": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "ev": 212678, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "evexg": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "evexd": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "segadd": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "segex": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "segtrm": 0, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "seg": 136, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "segmjr": 19, 2024-09-15T22:24:36.320 INFO:teuthology.orchestra.run.smithi150.stdout: "segexg": 0, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "segexd": 0, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "expos": 267417884, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "wrpos": 495219474, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "rdpos": 495218336, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "jlat": { 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "replayed": 212678 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_mem": { 2024-09-15T22:24:36.321 INFO:teuthology.orchestra.run.smithi150.stdout: "ino": 16, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "ino+": 91424, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "ino-": 91408, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "dir": 35, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "dir+": 4153, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "dir-": 4118, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "dn": 35633, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "dn+": 188726, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "dn-": 153093, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "cap": 0, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "cap+": 0, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "cap-": 0, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "rss": 94896, 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: "heap": 215328 2024-09-15T22:24:36.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_server": { 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_client_request": 0, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_server_request": 0, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_request": 0, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_session": 0, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_peer_request": 0, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "req_create_latency": { 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.323 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getattr_latency": { 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "req_link_latency": { 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.324 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookup_latency": { 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupino_latency": { 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.325 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupname_latency": { 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lssnap_latency": { 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mkdir_latency": { 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mknod_latency": { 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.328 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mksnap_latency": { 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "req_open_latency": { 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.329 INFO:teuthology.orchestra.run.smithi150.stdout: "req_readdir_latency": { 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rename_latency": { 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.330 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmdir_latency": { 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setattr_latency": { 2024-09-15T22:24:36.332 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setlayout_latency": { 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setxattr_latency": { 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "req_symlink_latency": { 2024-09-15T22:24:36.334 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "req_unlink_latency": { 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.335 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_sessions": { 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "session_count": 1, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "session_add": 1, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "session_remove": 0, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_open": 1, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_stale": 0, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "total_load": 0, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "average_load": 0, 2024-09-15T22:24:36.336 INFO:teuthology.orchestra.run.smithi150.stdout: "avg_session_uptime": 1826, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:36.337 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:36.338 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:36.339 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 240557, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 81, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:36.340 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 160, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 25168669, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 143196, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "objecter": { 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "op_active": 0, 2024-09-15T22:24:36.341 INFO:teuthology.orchestra.run.smithi150.stdout: "op_laggy": 0, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send": 3197, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send_bytes": 21, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "op_resend": 3, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "op_reply": 3197, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "op_latency": { 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3197, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 18.325643491, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.005732137 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "op_inflight": 0, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "oplen_avg": { 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3197, 2024-09-15T22:24:36.342 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 3198 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "op": 3197, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "op_r": 3197, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "op_w": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "op_rmw": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "op_pg": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_stat": 1826, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_create": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_read": 1369, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_write": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writefull": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writesame": 0, 2024-09-15T22:24:36.343 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_append": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_zero": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_truncate": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_delete": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_mapext": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_getxattr": 1, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_setxattr": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_call": 0, 2024-09-15T22:24:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_watch": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_notify": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_other": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_active": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_send": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_resend": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_ping": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_active": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_send": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_resend": 0, 2024-09-15T22:24:36.345 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_active": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_send": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_resend": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_active": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_send": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_resend": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "command_active": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "command_send": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "command_resend": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "map_epoch": 84, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "map_full": 0, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "map_inc": 4, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_sessions": 11, 2024-09-15T22:24:36.346 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_open": 11, 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_close": 0, 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_laggy": 0, 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_wr": 0, 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_rd": 2, 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_del": 0 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "oft": { 2024-09-15T22:24:36.348 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_objs": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_updates": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_removes": 0 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "osd-slow-ops": { 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_ops_count": 0 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "purge_queue": { 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_high_water": 0, 2024-09-15T22:24:36.349 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed_ops": 0, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed": 0, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 3485, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 492310689, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 3485, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:36.350 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 3485, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 492310689, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:36.351 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 3197, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 491056913, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 3197, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 491056913, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1024, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 3197, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 3197, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 3197, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 3197, 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:36.353 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:36.354 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle-0x559a5df0abe0": { 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-09-15T22:24:36.355 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.356 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-15T22:24:36.357 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-15T22:24:37.221 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-09-15T22:24:37.222 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-09-15T22:24:37.222 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2024-09-15T22:24:37.222 DEBUG:tasks.check_counter:Getting stats from b 2024-09-15T22:24:37.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-15T22:24:37.632 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:24:37.755 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:37 smithi154 ceph-mon[34853]: pgmap v731: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 147 KiB/s wr, 81 op/s 2024-09-15T22:24:37.839 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:37 smithi150 ceph-mon[30886]: pgmap v731: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 147 KiB/s wr, 81 op/s 2024-09-15T22:24:37.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:37 smithi169 ceph-mon[35850]: pgmap v731: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 147 KiB/s wr, 81 op/s 2024-09-15T22:24:38.373 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-15T22:24:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 205565, 2024-09-15T22:24:38.373 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 319347, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 77059593, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 282174987, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 14, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 10.063840992, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 4.905852359, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 8.329465867, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 1.002446739, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 319345, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 53.297506772, 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000166896 2024-09-15T22:24:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 211513, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.054039296, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000255 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 58160, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 29744 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 34590, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 35563, 2024-09-15T22:24:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 13996332, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 143344979, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 11, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 2.745113898, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 1.024906895, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.540408849, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 1.100445740, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 35563, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 49.107605400, 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001380862 2024-09-15T22:24:38.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6956, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001682570, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000241 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 730672, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 156608 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 40732, 2024-09-15T22:24:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 41177, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 31272340, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 100318455, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 107, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 8, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 2.946103484, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 1.285395427, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 1.462886671, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.491182138, 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:38.378 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 41175, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 17.905665623, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000434867 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 53278, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.008546970, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000160 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 407008 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6960, 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 74.278360235, 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.010672178 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 22179, 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.093011355, 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000139456 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 90854, 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 87421, 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 87421, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 726.497542765, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.008310332 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 3433, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 64, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 6480, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 97, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 58, 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 26, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 21, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 11, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 20, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 77098, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 3, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 3, 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 6, 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 145553, 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 127217, 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 3260, 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 384, 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 7, 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 116, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 612, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 192, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 55105, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 226, 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 45441, 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 147, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 16111, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 34742, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 5, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 50065, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 20359, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 482, 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 36450 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 6, 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-15T22:24:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 604, 2024-09-15T22:24:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 655, 2024-09-15T22:24:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 3, 2024-09-15T22:24:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 11572, 2024-09-15T22:24:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 11569, 2024-09-15T22:24:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 192, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 97, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 3, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 112078, 2024-09-15T22:24:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 111789, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 111789, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 289, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 385, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 175, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 174, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 174, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 1, 2024-09-15T22:24:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 1, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 1, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 261072073, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 261560456, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2595, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 262.311612237, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.101083472 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-15T22:24:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 39, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 46354, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 46315, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 52, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 2326, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2274, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 56, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 100733, 2024-09-15T22:24:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 100677, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 3, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 45155, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 45152, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 146596, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 231712 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 96472, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 7619, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 90854, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 262, 2024-09-15T22:24:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 16314, 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 21770, 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 51.125823141, 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002348453 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 638, 2024-09-15T22:24:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 37.505529281, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.058786096 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 27210, 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 477.655871325, 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.017554423 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000368777, 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000184388 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 169, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 5.167775298, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.030578552 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6036, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 12.117822138, 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002007591 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 493, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.097321151, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002225803 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 21386, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 115.165819854, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005385103 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 98, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 13.603630769, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.138812558 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.035454525, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005909087 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 7, 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.020977839, 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002996834 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002757694, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000919231 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 9603, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 12.998390973, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001353576 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 1792, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 1792, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 753, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 360, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 360, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 350510, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 142, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 528, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 6, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 160, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 211265, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 1795, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 65564, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 337394495, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 37, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 65564, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 65564, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 31063.837754348, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.473794121 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 65564, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 163530 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 65564, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 452, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 65112, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 5464, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 42021, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 388, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 2985, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 407, 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 97, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 12643, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 4, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 84042, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 5, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-15T22:24:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 84, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-09-15T22:24:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 13071, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 128, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 2275 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 14, 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 6, 2024-09-15T22:24:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 12009, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 11569, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 280883, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 99717997, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 280883, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 280883, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 99717997, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 65564, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 338562380, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 65564, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 338562380, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 65564, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 65564, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 65564, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 65564, 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 11569, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1168909, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 11569, 2024-09-15T22:24:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 389, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1168909, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55988a39c960": { 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 112078, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 257366152, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 112078, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2595, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 257366152, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:38.435 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-15T22:24:39.495 INFO:tasks.check_counter:Daemon mds.b mds.exported=192 2024-09-15T22:24:39.495 INFO:tasks.check_counter:Daemon mds.b mds.imported=226 2024-09-15T22:24:39.495 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=97 2024-09-15T22:24:39.496 DEBUG:tasks.check_counter:Getting stats from e 2024-09-15T22:24:39.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-15T22:24:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:24:40.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:39 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:40.176 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:39 smithi150 ceph-mon[30886]: pgmap v732: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 147 KiB/s wr, 63 op/s 2024-09-15T22:24:40.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:39 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:40.187 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:39 smithi154 ceph-mon[34853]: pgmap v732: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 147 KiB/s wr, 63 op/s 2024-09-15T22:24:40.209 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:39 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:40.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:39 smithi169 ceph-mon[35850]: pgmap v732: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 147 KiB/s wr, 63 op/s 2024-09-15T22:24:40.362 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 33890, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 26330, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 12651218, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 103026934, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 2.180194081, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.887363643, 2024-09-15T22:24:40.363 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 1.201758947, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.380088694, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 26331, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.022510959, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000076811 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 46947, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.006692836, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000142 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.364 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 721712, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 158480 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 26153, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 21333, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 9974042, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 124810273, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 10, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 1.849790762, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.890692385, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.731628548, 2024-09-15T22:24:40.365 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.320459728, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 21332, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.996617304, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000140475 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 29050, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.004599454, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000158 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-15T22:24:40.366 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 403920 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 198713, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 309110, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 76194098, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 214408734, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 15, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 9.459014989, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 4.927306112, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 13.071522277, 2024-09-15T22:24:40.367 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.241445842, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 309106, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 24.725294717, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000079989 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 229609, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.058781329, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000256 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:40.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6071, 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 71.218570278, 2024-09-15T22:24:40.369 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.011730945 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 26716, 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.561882619, 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000133323 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 85536, 2024-09-15T22:24:40.370 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 82768, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 82768, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 610.037498001, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.007370451 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 2768, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 1229, 2024-09-15T22:24:40.371 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 132, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 2, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 201, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 128, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 61, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 12, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 15, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 49529, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 5, 2024-09-15T22:24:40.372 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 134866, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 118268, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 2628, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 932, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 251, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 284, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 33004, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 227, 2024-09-15T22:24:40.373 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 14815, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:40.374 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 253, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 19211, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 39624, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:40.375 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 51908, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 22702, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 558, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 43159 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 16, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 12, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1041, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 1065, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 2, 2024-09-15T22:24:40.376 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 13695, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 13693, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-15T22:24:40.377 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 286, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 134, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 4, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 120670, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 14398, 2024-09-15T22:24:40.378 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 12291, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 108379, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 2107, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 147, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 19, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 16, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 131, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 9, 2024-09-15T22:24:40.379 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 3, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 32998263, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 266794721, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3029, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 226.631729793, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.074820643 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.380 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 35, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 34131, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 34096, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 33, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1800, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 1767, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 201, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 79097, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 78896, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-15T22:24:40.381 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 33840, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 33840, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 145188, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223520 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 93088, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 10425, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 85536, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 457, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 20753, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 23997, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 62.336627017, 2024-09-15T22:24:40.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002597684 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 94, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.590090124, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.027554150 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-15T22:24:40.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 15456, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 204.201477631, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.013211793 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.385 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.386 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 168, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 4.127245476, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.024566937 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.387 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6661, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 14.044728100, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002108501 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.388 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 579, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.990248854, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006891621 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 24000, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 285.667072226, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.011902794 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 94, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 17.912067221, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.190553906 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:40.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-15T22:24:40.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 11719, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 15.167941352, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001294303 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-15T22:24:40.394 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 14017, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 14017, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 672, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:40.395 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:40.396 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:40.397 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:40.398 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 343585, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 131, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:40.399 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 160, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 271139, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 2313, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:40.400 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 21634, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 288659893, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 21634, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 21634, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 515.094342107, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.023809482 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.401 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 21634, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 25948 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 21634, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 517, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 21117, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 27, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 1147, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 517, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 3550, 2024-09-15T22:24:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 304, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 131, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 14374, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 2294, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-15T22:24:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 84, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-09-15T22:24:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 3151, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 453 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 14, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 6, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 14277, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 13693, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 258752, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 78280762, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 258752, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 258752, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 78280762, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 21634, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 290043470, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 21634, 2024-09-15T22:24:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 290043470, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 21634, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 21634, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 21634, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 21634, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 13693, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1383577, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 13693, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 521, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1383577, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x5603ef02c960": { 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 120670, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 262600417, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 120670, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3029, 2024-09-15T22:24:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 262600417, 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:40.414 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-15T22:24:41.195 INFO:tasks.check_counter:Daemon mds.e mds.exported=284 2024-09-15T22:24:41.196 INFO:tasks.check_counter:Daemon mds.e mds.imported=227 2024-09-15T22:24:41.196 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=132 2024-09-15T22:24:41.196 DEBUG:tasks.check_counter:Getting stats from h 2024-09-15T22:24:41.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-15T22:24:41.450 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:24:41.768 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:41 smithi154 ceph-mon[34853]: pgmap v733: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.5 KiB/s wr, 21 op/s 2024-09-15T22:24:41.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:41 smithi150 ceph-mon[30886]: pgmap v733: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.5 KiB/s wr, 21 op/s 2024-09-15T22:24:41.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:41 smithi169 ceph-mon[35850]: pgmap v733: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.5 KiB/s wr, 21 op/s 2024-09-15T22:24:42.073 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 324011, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 571602, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 125814713, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 374568476, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 16, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 15.451856896, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 8.026034536, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 11.405425568, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.506527045, 2024-09-15T22:24:42.074 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 571597, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 30.640482692, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000053605 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 397281, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.097761551, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000246 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 730176, 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 157392 2024-09-15T22:24:42.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 45942, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 44366, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 44522265, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 169014197, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 3.749408243, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 1.872521475, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 1.533390273, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.578874461, 2024-09-15T22:24:42.076 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 44368, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.445136754, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000055110 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 56551, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.009392740, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000166 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 403120 2024-09-15T22:24:42.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 42371, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 30867, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 26454921, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 303220908, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 3.263971100, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 1.548247754, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 1.033605022, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.771150109, 2024-09-15T22:24:42.078 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 30866, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.474094187, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000080155 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 40022, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.005260405, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000131 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 7691, 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 128.859386123, 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.016754568 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.080 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 66619, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 10.802086776, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000162147 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 177350, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 170679, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 170679, 2024-09-15T22:24:42.081 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2075.728482036, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.012161592 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 6670, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 336, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 1450, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 155, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 15, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 170, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 106, 2024-09-15T22:24:42.082 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 51, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 13, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 16, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 128208, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 5, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 273595, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 247289, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 6581, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 901, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 4, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 225, 2024-09-15T22:24:42.083 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 129, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 361, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 96656, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 422, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 85020, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:42.084 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 196, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 26322, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 78381, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 1, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:42.085 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 72914, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 31356, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 1983, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 77205 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 6, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1320, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 985, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 3, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:42.086 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 35269, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 35266, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:42.087 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 361, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 172, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 14, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 212678, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 116903, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 110611, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 102067, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-15T22:24:42.088 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 6292, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 275, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 147, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 139, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 136, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 9, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 8, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 267417884, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 495219474, 2024-09-15T22:24:42.089 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3868, 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 266.511906881, 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.068901733 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.092 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 35, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 94052, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 94017, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 54, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 4427, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 4373, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 170, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 198136, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 197966, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 90103, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 90103, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 133896, 2024-09-15T22:24:42.093 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223520 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 189742, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 10806, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 177350, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 452, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 21059, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 37046, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 164.276623071, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004434395 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.094 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2699, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 292.201019666, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.108262697 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.095 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 50986, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1173.037656670, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.023007054 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-15T22:24:42.096 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.098 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:42.098 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.098 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 283, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.765577160, 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.009772357 2024-09-15T22:24:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-15T22:24:42.100 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 9843, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 41.817637767, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004248464 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1451, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.679327459, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001157358 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 37043, 2024-09-15T22:24:42.101 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 336.222092741, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.009076535 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 259, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 23.787248608, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.091842658 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.184897409, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.184897409 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 31068, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 39.756401485, 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001279657 2024-09-15T22:24:42.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-15T22:24:42.107 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 20111, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 20111, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2050, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:42.108 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:42.109 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:42.110 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 282626, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 112, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:42.111 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 160, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:42.112 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 278030, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 2044, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 45728, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 525961655, 2024-09-15T22:24:42.113 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 32, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 45728, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 45728, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 652.725593689, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.014274090 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 45728, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 49699 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 45728, 2024-09-15T22:24:42.114 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 1089, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 44639, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 38, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 608, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 753, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 4623, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 406, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 155, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 36942, 2024-09-15T22:24:42.115 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 4, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 1216, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:42.116 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 1, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-15T22:24:42.117 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 84, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 3747, 2024-09-15T22:24:42.118 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 672, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 534 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 13 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-15T22:24:42.119 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 14, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 6, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 36662, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 35266, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 412320, 2024-09-15T22:24:42.120 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 164246611, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 412320, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 412320, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 164246611, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.121 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 45728, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 529519561, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 45728, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 529519561, 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:42.122 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:42.123 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 45728, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 45728, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 45728, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 45728, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:42.124 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 35266, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 3563282, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 35266, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 754, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 3563282, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x5586a2eb0960": { 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 212678, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 491025170, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 212678, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3868, 2024-09-15T22:24:42.126 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 491025170, 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:42.127 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-15T22:24:42.829 INFO:tasks.check_counter:Daemon mds.h mds.exported=361 2024-09-15T22:24:42.829 INFO:tasks.check_counter:Daemon mds.h mds.imported=422 2024-09-15T22:24:42.829 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=155 2024-09-15T22:24:42.829 DEBUG:tasks.check_counter:Getting stats from k 2024-09-15T22:24:42.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-15T22:24:43.076 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:24:43.533 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 899, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 865, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 93137647, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 347740, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.123679939, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.026169635, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.085756483, 2024-09-15T22:24:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.012784968, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 865, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.046518395, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000053778 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 706656, 2024-09-15T22:24:43.535 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 155344 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 694, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 882, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 63069775, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 622587, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.101502585, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.021464509, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.055176318, 2024-09-15T22:24:43.536 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.018290486, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 880, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.030520780, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000034682 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 402208 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1753, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1755, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 105386606, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 557512, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.202163361, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.044752447, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.098381171, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.046711115, 2024-09-15T22:24:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1753, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.062032429, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000035386 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4984, 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.123043933, 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000024687 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.541 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 26208, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 228, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 25980, 2024-09-15T22:24:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 25882, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-15T22:24:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:43.544 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:43.545 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-15T22:24:43.546 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-15T22:24:43.548 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 120839, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 137, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 11, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-15T22:24:43.549 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 32425782, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 264221595, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 264220457, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 120839 2024-09-15T22:24:43.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 13, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 44478, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 44465, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 2293, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2282, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 26208, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 92785, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 66577, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-15T22:24:43.551 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 83020, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-15T22:24:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-15T22:24:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-15T22:24:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2053, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 232152, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 77, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 160, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 18494024, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 104960, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 3051, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 3051, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3051, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 22.104406153, 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.007244970 2024-09-15T22:24:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3051, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3052 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 3051, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 3051, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1808, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 1241, 2024-09-15T22:24:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-15T22:24:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 84, 2024-09-15T22:24:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 10, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 10, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-15T22:24:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-15T22:24:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3342, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 261275430, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3342, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3342, 2024-09-15T22:24:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 261275430, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 3051, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 260038484, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3051, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 260038484, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 3051, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 3051, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3051, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 3051, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x556d64930b40": { 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-15T22:24:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-15T22:24:43.584 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-15T22:24:43.585 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:43 smithi154 ceph-mon[34853]: pgmap v734: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-15T22:24:43.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:43 smithi150 ceph-mon[30886]: pgmap v734: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-15T22:24:43.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:43 smithi169 ceph-mon[35850]: pgmap v734: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-15T22:24:44.336 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-15T22:24:44.336 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-15T22:24:44.336 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-15T22:24:44.337 DEBUG:tasks.check_counter:Getting stats from c 2024-09-15T22:24:44.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-15T22:24:44.765 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:24:45.328 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T22:24:45.328 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 198264, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 283461, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 72488563, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 164775405, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 12, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 7.973468494, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 3.916550696, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 7.005658230, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.283904332, 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:45.329 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 283458, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 13.800679767, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000048686 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 168127, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.045181809, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000268 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:45.330 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 31079, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 34438, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 31050840, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 64416227, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 13, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 8, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 2.293647475, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.842545861, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 1.053996638, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.528168116, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 34437, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.249880821, 2024-09-15T22:24:45.331 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000036294 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 43362, 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.006833113, 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000157 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 714816, 2024-09-15T22:24:45.332 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 157648 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 42650, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 47667, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 26551286, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 94389378, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 8, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 2.805619613, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 1.338640401, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 1.533307773, 2024-09-15T22:24:45.333 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.212339223, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 47667, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2.076713365, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000043567 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 74967, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.011392033, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000151 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:45.334 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 403472 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 8279, 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 29.613577390, 2024-09-15T22:24:45.335 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.003576951 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 36088, 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 3.509587162, 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000097250 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.336 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 65107, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 64499, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 64499, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 961.586991558, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.014908556 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 608, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 106, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:45.337 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 305, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 33, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 68, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 24, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 33, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 11, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 14, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 46254, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 6, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 134260, 2024-09-15T22:24:45.338 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 108954, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 298, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 1125, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 15, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 461, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 4379, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 596, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 32499, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 484, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 62542, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:45.339 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:45.340 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 382, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 9349, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 23441, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 27617, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 10302, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 784, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 39179 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-15T22:24:45.341 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 17, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 13, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 1241, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 1969, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 1, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 18029, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 18028, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:45.342 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 596, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 33, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-15T22:24:45.343 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 7, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 83759, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 83759, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 108, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 108, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 8, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-15T22:24:45.344 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 167953696, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 0, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3857, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 67.562615233, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.017516882 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 0 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 56, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 39045, 2024-09-15T22:24:45.345 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 38989, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 62, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 1843, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 1781, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 68, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 87504, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 87436, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 46292, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 46292, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 126236, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 223520 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.346 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 87971, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 9676, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 65107, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 734, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 29764, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4052, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 18.962921835, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.004679891 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 74, 2024-09-15T22:24:45.347 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.048237154, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000651853 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-15T22:24:45.348 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 36349, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 385.076827787, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.010593876 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.349 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.350 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.351 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-15T22:24:45.352 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3092, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2.186056588, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000707004 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 719, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.710403094, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000988043 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4071, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 522.907732135, 2024-09-15T22:24:45.353 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.128446998 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.354 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 100, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 7.555819915, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.075558199 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.355 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:45.356 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.357 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.358 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 16042, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 24.138993050, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001504737 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.359 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 1, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 0, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 16754, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 16754, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2057, 2024-09-15T22:24:45.360 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:45.361 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:45.362 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:45.363 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 313008, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 133, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 160, 2024-09-15T22:24:45.364 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 257120, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 1216, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-15T22:24:45.365 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 25597, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 173312039, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 30, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 25597, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 25597, 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 296.483809904, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.011582756 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 25597, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 26824 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 25597, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 998, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 24599, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-15T22:24:45.370 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 10, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 892, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 4750, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 487, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 33, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 18559, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 4, 2024-09-15T22:24:45.371 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 20, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-15T22:24:45.372 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-15T22:24:45.373 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 84, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 12, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 12, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 1456, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 212, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 401 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-15T22:24:45.374 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 1, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 14, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 6, 2024-09-15T22:24:45.375 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 18508, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 18028, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 271989, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 108400043, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 271989, 2024-09-15T22:24:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 271989, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 108400043, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:45.377 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 25597, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 175131651, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 25597, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 175131651, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.378 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 25597, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 25597, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 25597, 2024-09-15T22:24:45.379 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 25597, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 18028, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1821308, 2024-09-15T22:24:45.380 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 18028, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 892, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1821308, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:45.381 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x55ee5d984960": { 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 83759, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 163759392, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 83759, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3857, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 163759392, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:45.382 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:45.383 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:45.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.383 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:45.383 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T22:24:45.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:45 smithi154 ceph-mon[34853]: pgmap v735: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2024-09-15T22:24:45.919 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:45 smithi169 ceph-mon[35850]: pgmap v735: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2024-09-15T22:24:45.926 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:45 smithi150 ceph-mon[30886]: pgmap v735: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2024-09-15T22:24:46.398 INFO:tasks.check_counter:Daemon mds.c mds.exported=596 2024-09-15T22:24:46.398 INFO:tasks.check_counter:Daemon mds.c mds.imported=484 2024-09-15T22:24:46.398 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=33 2024-09-15T22:24:46.398 DEBUG:tasks.check_counter:Getting stats from f 2024-09-15T22:24:46.398 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-15T22:24:46.652 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:24:47.134 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T22:24:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1779, 2024-09-15T22:24:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1745, 2024-09-15T22:24:47.134 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 80855451, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 626776, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.205710352, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.054428984, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.101980605, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.042511844, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1745, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.081432108, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000046665 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.135 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 706272, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 154224 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 890, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1076, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 88320045, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 774210, 2024-09-15T22:24:47.136 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 8, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.119571494, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.026930298, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.066219572, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.019775395, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1074, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.041451319, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000038595 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.137 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 491760 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 784, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 786, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 89802021, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 249319, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.106382782, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.021817195, 2024-09-15T22:24:47.138 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.059599539, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.019343151, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 784, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.026294263, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000033538 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:47.139 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5191, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.690763957, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000133069 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.140 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.141 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 11909, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 8218, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 3691, 2024-09-15T22:24:47.142 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 169, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 2, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-15T22:24:47.143 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:47.144 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:47.145 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:47.146 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-15T22:24:47.147 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 112078, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-15T22:24:47.148 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 51, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 261072073, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 261560456, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 261555819, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.149 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 112078 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 26, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 45650, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 45624, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 35, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 2171, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 2136, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 11909, 2024-09-15T22:24:47.150 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 96381, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 84472, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 89068, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-15T22:24:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-15T22:24:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-15T22:24:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.163 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2059, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:47.164 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:47.165 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:47.166 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 239526, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 80, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:47.167 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 160, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-15T22:24:47.168 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 8488599, 2024-09-15T22:24:47.169 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 49113, 2024-09-15T22:24:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-15T22:24:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 3158, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 26, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 4, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 3158, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3158, 2024-09-15T22:24:47.173 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 16.722648181, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.005295328 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3158, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 3159 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 3158, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 3158, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1853, 2024-09-15T22:24:47.174 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 1302, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 2, 2024-09-15T22:24:47.175 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-15T22:24:47.176 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-15T22:24:47.177 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 84, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 11, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 11, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-15T22:24:47.178 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-15T22:24:47.179 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-15T22:24:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:47.180 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 3449, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 258649304, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 3449, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3449, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 258649304, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.181 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:47.182 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 3158, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 257396805, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3158, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 257396805, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:47.183 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 3158, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 3158, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3158, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 3158, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.184 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-15T22:24:47.185 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x558119d34b40": { 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:47.186 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:47.187 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T22:24:47.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:47 smithi150 ceph-mon[30886]: pgmap v736: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-09-15T22:24:47.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:47 smithi154 ceph-mon[34853]: pgmap v736: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-09-15T22:24:47.918 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:47 smithi169 ceph-mon[35850]: pgmap v736: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-09-15T22:24:47.945 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-15T22:24:47.945 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-15T22:24:47.945 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-15T22:24:47.945 DEBUG:tasks.check_counter:Getting stats from i 2024-09-15T22:24:47.946 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-15T22:24:48.195 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 33929, 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 44914, 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 21261281, 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 101569614, 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 11, 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 4, 2024-09-15T22:24:48.699 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 2.686804232, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 1.212692691, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 1.186368045, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.409981413, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 44914, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.667088910, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000037117 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 57869, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.009387946, 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000162 2024-09-15T22:24:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 29927, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 41399, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 24271812, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 161011291, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 11, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 2.835785632, 2024-09-15T22:24:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 1.336142862, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.956635054, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.551131862, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 41398, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 3.621480911, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000087479 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 39547, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.006738789, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000170 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 726752, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 158672 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 182519, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 325355, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 64638583, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 189187633, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 14, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 8, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 8.881402770, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 4.559847563, 2024-09-15T22:24:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 6.509228469, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.292926867, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 325352, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 73.277544334, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000225225 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 217035, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.053769709, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000247 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 4896, 2024-09-15T22:24:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 495088 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 7072, 2024-09-15T22:24:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 55.715962045, 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.007878388 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 49897, 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 6.572809717, 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000131727 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-15T22:24:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 87816, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 86551, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 86551, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 422.179277194, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.004877809 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 1265, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 38, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 842, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 90, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 1, 2024-09-15T22:24:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 30, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 9, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 11, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 10, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 14, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 32942, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 1, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 1, 2024-09-15T22:24:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 6, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 141195, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 123173, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 1022, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 443, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 292, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 379, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-15T22:24:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 208, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 26965, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 282, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 36411, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 412, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 17805, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 45815, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 39662, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 19805, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 670, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 52544 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 16, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 12, 2024-09-15T22:24:48.712 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 834, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 1396, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 26198, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 26198, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:48.713 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:48.714 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 209, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 91, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 4, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 120839, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 19647, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 12291, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 108548, 2024-09-15T22:24:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 7356, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 153, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 25, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 16, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 137, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 9, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 9, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 32425782, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 264221595, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 0, 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-15T22:24:48.716 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3011, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 109.979088599, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.036525768 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 0 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 37, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 44661, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 44624, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 36, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 2308, 2024-09-15T22:24:48.717 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 2272, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 30, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 95939, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 95909, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 1, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 47647, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 47646, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 120792, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 223520 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 103376, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 7822, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 87816, 2024-09-15T22:24:48.718 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 321, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 21338, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 17176, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 33.137238549, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001929275 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 184, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 7.843692736, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.042628764 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.719 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 21533, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 153.120075376, 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.007110949 2024-09-15T22:24:48.720 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.721 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-15T22:24:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.722 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:48.723 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.724 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 109, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.454123045, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.013340578 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.725 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5395, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 4.483941455, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000831129 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.726 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1056, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.039647678, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000984514 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 17163, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 163.116353118, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.009503953 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.727 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 172, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 26.838660235, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.156038722 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.728 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.729 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-15T22:24:48.730 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.731 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 23763, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 31.145545002, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001310673 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:48.732 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-15T22:24:48.733 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 6053, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 6053, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 763, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:48.734 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:48.735 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:48.736 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 291842, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 119, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:48.737 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 160, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 153293, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 681, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:48.738 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 34287, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 280295124, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 32, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 34287, 2024-09-15T22:24:48.739 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 34287, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 382.972000990, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.011169597 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 34287, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 37513 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 34287, 2024-09-15T22:24:48.740 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 763, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 33524, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 18, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 772, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 725, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 3737, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 391, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 90, 2024-09-15T22:24:48.741 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 27285, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 2, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 1544, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:48.742 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-15T22:24:48.743 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 84, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 12, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 12, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-15T22:24:48.744 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 2443, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 76, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 430 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 1, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.745 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 14, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 6, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 27198, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 26198, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.746 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 246371, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 90549882, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 246371, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:48.747 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 246371, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 90549882, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:48.748 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 34287, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 282941514, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 34287, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 282941514, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.749 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 34287, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 34287, 2024-09-15T22:24:48.750 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 34287, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 34287, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:48.751 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 26198, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 2646998, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 26198, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 725, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2646998, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.752 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x55b1f13fa960": { 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 120839, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 260027291, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 120839, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:48.753 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3011, 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 260027291, 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:48.754 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T22:24:49.454 INFO:tasks.check_counter:Daemon mds.i mds.exported=208 2024-09-15T22:24:49.455 INFO:tasks.check_counter:Daemon mds.i mds.imported=282 2024-09-15T22:24:49.455 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=90 2024-09-15T22:24:49.455 DEBUG:tasks.check_counter:Getting stats from l 2024-09-15T22:24:49.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-15T22:24:49.702 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:24:50.370 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T22:24:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:24:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1366, 2024-09-15T22:24:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1331, 2024-09-15T22:24:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 34613158, 2024-09-15T22:24:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 496566, 2024-09-15T22:24:50.371 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-15T22:24:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.157077878, 2024-09-15T22:24:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.045688275, 2024-09-15T22:24:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.074795017, 2024-09-15T22:24:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.032934299, 2024-09-15T22:24:50.372 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1331, 2024-09-15T22:24:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.074432510, 2024-09-15T22:24:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000055922 2024-09-15T22:24:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.373 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 714000, 2024-09-15T22:24:50.374 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 156624 2024-09-15T22:24:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:24:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 820, 2024-09-15T22:24:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1010, 2024-09-15T22:24:50.375 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 116023850, 2024-09-15T22:24:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 666302, 2024-09-15T22:24:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 7, 2024-09-15T22:24:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 6, 2024-09-15T22:24:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.117577119, 2024-09-15T22:24:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.025735286, 2024-09-15T22:24:50.376 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.067842546, 2024-09-15T22:24:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.017989396, 2024-09-15T22:24:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1008, 2024-09-15T22:24:50.377 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.088195045, 2024-09-15T22:24:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000087495 2024-09-15T22:24:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.378 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 405792 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1070, 2024-09-15T22:24:50.379 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1072, 2024-09-15T22:24:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 113529281, 2024-09-15T22:24:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 340261, 2024-09-15T22:24:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-15T22:24:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 5, 2024-09-15T22:24:50.380 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.133839212, 2024-09-15T22:24:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.026238906, 2024-09-15T22:24:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.076438663, 2024-09-15T22:24:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.023847316, 2024-09-15T22:24:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:24:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1070, 2024-09-15T22:24:50.381 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.034780894, 2024-09-15T22:24:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000032505 2024-09-15T22:24:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:24:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.382 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:24:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:24:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-15T22:24:50.383 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-15T22:24:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-15T22:24:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-15T22:24:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:50.384 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4944, 2024-09-15T22:24:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.119297527, 2024-09-15T22:24:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000024129 2024-09-15T22:24:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-15T22:24:50.385 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-15T22:24:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-15T22:24:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.386 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-15T22:24:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-15T22:24:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-15T22:24:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-15T22:24:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.387 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-15T22:24:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-15T22:24:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-15T22:24:50.388 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-15T22:24:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-15T22:24:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-15T22:24:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-15T22:24:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 14451, 2024-09-15T22:24:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 357, 2024-09-15T22:24:50.389 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 14094, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 13941, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-15T22:24:50.390 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-15T22:24:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-15T22:24:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-15T22:24:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-15T22:24:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:24:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-15T22:24:50.391 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-15T22:24:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-15T22:24:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-15T22:24:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-15T22:24:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-15T22:24:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-15T22:24:50.392 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-15T22:24:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-15T22:24:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:24:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-15T22:24:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-15T22:24:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-15T22:24:50.393 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-15T22:24:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:24:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-15T22:24:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:24:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:24:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:24:50.394 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:24:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:24:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-15T22:24:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:24:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:24:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:24:50.395 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:24:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:24:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:24:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-15T22:24:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:24:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-15T22:24:50.396 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-15T22:24:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-15T22:24:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-15T22:24:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-15T22:24:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-15T22:24:50.397 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-15T22:24:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-15T22:24:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-15T22:24:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-15T22:24:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:24:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-15T22:24:50.398 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-15T22:24:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-15T22:24:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-15T22:24:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-15T22:24:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:24:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:24:50.399 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-15T22:24:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-15T22:24:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:24:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:24:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:24:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-15T22:24:50.400 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-15T22:24:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:24:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-15T22:24:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-15T22:24:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-15T22:24:50.401 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 120670, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-15T22:24:50.402 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 131, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 11, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-15T22:24:50.403 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 32998263, 2024-09-15T22:24:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 266794721, 2024-09-15T22:24:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 266792325, 2024-09-15T22:24:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-15T22:24:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.404 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 120670 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 15, 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 33690, 2024-09-15T22:24:50.405 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 33675, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 13, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 1793, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 1780, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 14451, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 73037, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 58586, 2024-09-15T22:24:50.406 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 89904, 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-15T22:24:50.407 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.408 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-15T22:24:50.409 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.410 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.411 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.412 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.413 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.414 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-15T22:24:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.415 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.416 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-15T22:24:50.417 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.418 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-15T22:24:50.419 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.420 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-15T22:24:50.421 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.422 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.423 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 1, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 0, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2060, 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-15T22:24:50.424 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:24:50.425 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:24:50.426 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:24:50.427 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 240346, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 84, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7704, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 160, 2024-09-15T22:24:50.428 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 10231760, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 65244, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-15T22:24:50.429 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2958, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2958, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2958, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 17.934623177, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.006063090 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2958, 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2959 2024-09-15T22:24:50.430 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2958, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 2958, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1715, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 1241, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-15T22:24:50.431 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-15T22:24:50.432 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-15T22:24:50.433 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 84, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 11, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 11, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-15T22:24:50.434 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-15T22:24:50.435 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:50.436 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 3252, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 263855642, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 3252, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3252, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 263855642, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.437 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2958, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 262625301, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2958, 2024-09-15T22:24:50.438 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 262625301, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:50.439 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2958, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2958, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2958, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2958, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:24:50.440 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.441 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x55a8a54dcb40": { 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-15T22:24:50.442 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T22:24:50.443 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T22:24:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:50 smithi154 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:50.521 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:50 smithi154 ceph-mon[34853]: pgmap v737: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 16 op/s 2024-09-15T22:24:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:50 smithi150 ceph-mon[30886]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:50.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:50 smithi150 ceph-mon[30886]: pgmap v737: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 16 op/s 2024-09-15T22:24:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:50 smithi169 ceph-mon[35850]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:24:50.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:50 smithi169 ceph-mon[35850]: pgmap v737: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 16 op/s 2024-09-15T22:24:51.231 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-15T22:24:51.231 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-15T22:24:51.231 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-15T22:24:51.231 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T22:24:51.241 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T22:24:51.241 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:24:51.241 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:24:51.284 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-15T22:24:51.284 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:24:51.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:24:51.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:51 smithi154 ceph-mon[34853]: pgmap v738: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 op/s 2024-09-15T22:24:51.782 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:51.920 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:51 smithi150 ceph-mon[30886]: pgmap v738: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 op/s 2024-09-15T22:24:51.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:51 smithi169 ceph-mon[35850]: pgmap v738: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 op/s 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 -- 172.21.15.150:0/4275249510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c104010 msgr2=0x7f341c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 --2- 172.21.15.150:0/4275249510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c104010 0x7f341c1043f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f340c009900 tx=0x7f340c02a410 comp rx=0 tx=0).stop 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 -- 172.21.15.150:0/4275249510 shutdown_connections 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 --2- 172.21.15.150:0/4275249510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c109140 0x7f341c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 --2- 172.21.15.150:0/4275249510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c1049c0 0x7f341c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 --2- 172.21.15.150:0/4275249510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c104010 0x7f341c1043f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 -- 172.21.15.150:0/4275249510 >> 172.21.15.150:0/4275249510 conn(0x7f341c0ffa50 msgr2=0x7f341c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 -- 172.21.15.150:0/4275249510 shutdown_connections 2024-09-15T22:24:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.320+0000 7f3421000640 1 -- 172.21.15.150:0/4275249510 wait complete. 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.321+0000 7f3421000640 1 Processor -- start 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 -- start start 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c104010 0x7f341c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c1049c0 0x7f341c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c109140 0x7f341c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1141b0 con 0x7f341c1049c0 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f341c114030 con 0x7f341c104010 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3421000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f341c114330 con 0x7f341c109140 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3411400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c1049c0 0x7f341c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3419e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c104010 0x7f341c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3411400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c1049c0 0x7f341c19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:52980/0 (socket says 172.21.15.150:52980) 2024-09-15T22:24:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f3411400640 1 -- 172.21.15.150:0/3067234217 learned_addr learned my addr 172.21.15.150:0/3067234217 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.322+0000 7f341a800640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c109140 0x7f341c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3419e00640 1 -- 172.21.15.150:0/3067234217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c109140 msgr2=0x7f341c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3419e00640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c109140 0x7f341c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3419e00640 1 -- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c1049c0 msgr2=0x7f341c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3419e00640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c1049c0 0x7f341c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3419e00640 1 -- 172.21.15.150:0/3067234217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c19f5e0 con 0x7f341c104010 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3419e00640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c104010 0x7f341c19a630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f340c02a930 tx=0x7f340c003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c03f070 con 0x7f341c104010 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c19f870 con 0x7f341c104010 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340c031c90 con 0x7f341c104010 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c035030 con 0x7f341c104010 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.323+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1a71b0 con 0x7f341c104010 2024-09-15T22:24:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.324+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c1043f0 con 0x7f341c104010 2024-09-15T22:24:52.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.326+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f340c042070 con 0x7f341c104010 2024-09-15T22:24:52.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.328+0000 7f3413400640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34000a32c0 0x7f34000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:52.331 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.328+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f340c0f08c0 con 0x7f341c104010 2024-09-15T22:24:52.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.328+0000 7f3411400640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34000a32c0 0x7f34000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:52.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.328+0000 7f3411400640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34000a32c0 0x7f34000a5780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f341c0ffe70 tx=0x7f3404005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:52.332 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.330+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f340c0bcf00 con 0x7f341c104010 2024-09-15T22:24:52.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.515+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f341c10c320 con 0x7f341c104010 2024-09-15T22:24:52.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.515+0000 7f3413400640 1 -- 172.21.15.150:0/3067234217 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+599 (secure 0 0 0) 0x7f340c0c1200 con 0x7f341c104010 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:6801/3271868660 2024-09-16T22:02:43.046629+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:6800/3271868660 2024-09-16T22:02:43.046629+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:0/2539129789 2024-09-16T22:02:43.046629+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:0/370021496 2024-09-16T22:02:43.046629+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:0/2466465214 2024-09-16T22:02:16.539388+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:0/3629553483 2024-09-16T22:02:43.046629+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:6801/685691735 2024-09-16T22:02:16.539388+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:0/3932611497 2024-09-16T22:02:16.539388+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:6800/685691735 2024-09-16T22:02:16.539388+0000 2024-09-15T22:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150:0/3547163182 2024-09-16T22:02:16.539388+0000 2024-09-15T22:24:52.519 INFO:teuthology.orchestra.run.smithi150.stderr:listed 10 entries 2024-09-15T22:24:52.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34000a32c0 msgr2=0x7f34000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:52.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34000a32c0 0x7f34000a5780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f341c0ffe70 tx=0x7f3404005f90 comp rx=0 tx=0).stop 2024-09-15T22:24:52.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c104010 msgr2=0x7f341c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c104010 0x7f341c19a630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f340c02a930 tx=0x7f340c003b20 comp rx=0 tx=0).stop 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 shutdown_connections 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f341c109140 0x7f341c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f34000a32c0 0x7f34000a5780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f341c1049c0 0x7f341c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 --2- 172.21.15.150:0/3067234217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f341c104010 0x7f341c19a630 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.518+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 >> 172.21.15.150:0/3067234217 conn(0x7f341c0ffa50 msgr2=0x7f341c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.519+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 shutdown_connections 2024-09-15T22:24:52.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:52.519+0000 7f3421000640 1 -- 172.21.15.150:0/3067234217 wait complete. 2024-09-15T22:24:52.909 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:52 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3067234217' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:24:52.962 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:52 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3067234217' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:24:53.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:52 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3067234217' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:24:53.287 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:24:53.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:53.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:24:53.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:24:53.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:53.452 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:24:53.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:53.537 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-15T22:24:53.614 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:24:53.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:53.615 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:24:53.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:24:53.743 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-15T22:24:53.928 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:53 smithi150 ceph-mon[30886]: pgmap v739: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-15T22:24:53.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:53 smithi169 ceph-mon[35850]: pgmap v739: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-15T22:24:54.021 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:53 smithi154 ceph-mon[34853]: pgmap v739: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 op/s 2024-09-15T22:24:54.096 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T22:24:54.107 INFO:tasks.cephadm:Teardown begin 2024-09-15T22:24:54.107 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:24:54.107 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:54.590 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 -- 172.21.15.150:0/3910727822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4112870 msgr2=0x7f69a4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 --2- 172.21.15.150:0/3910727822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4112870 0x7f69a4114c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f699c009900 tx=0x7f699c02a400 comp rx=0 tx=0).stop 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 -- 172.21.15.150:0/3910727822 shutdown_connections 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 --2- 172.21.15.150:0/3910727822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4112870 0x7f69a4114c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 --2- 172.21.15.150:0/3910727822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4077040 0x7f69a4112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 --2- 172.21.15.150:0/3910727822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a4076720 0x7f69a4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 -- 172.21.15.150:0/3910727822 >> 172.21.15.150:0/3910727822 conn(0x7f69a40ff910 msgr2=0x7f69a4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:55.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 -- 172.21.15.150:0/3910727822 shutdown_connections 2024-09-15T22:24:55.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.199+0000 7f69ab000640 1 -- 172.21.15.150:0/3910727822 wait complete. 2024-09-15T22:24:55.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.200+0000 7f69ab000640 1 Processor -- start 2024-09-15T22:24:55.203 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.200+0000 7f69ab000640 1 -- start start 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69ab000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a4076720 0x7f69a41a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69ab000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 0x7f69a41a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69ab000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4112870 0x7f69a419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69ab000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69a41183b0 con 0x7f69a4112870 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69ab000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69a4118230 con 0x7f69a4077040 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69ab000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69a4118530 con 0x7f69a4076720 2024-09-15T22:24:55.204 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69a9200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 0x7f69a41a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69aa600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4112870 0x7f69a419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69a9200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 0x7f69a41a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37836/0 (socket says 172.21.15.150:37836) 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69a9200640 1 -- 172.21.15.150:0/377937579 learned_addr learned my addr 172.21.15.150:0/377937579 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.201+0000 7f69a9c00640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a4076720 0x7f69a41a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a9200640 1 -- 172.21.15.150:0/377937579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a4076720 msgr2=0x7f69a41a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a9200640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a4076720 0x7f69a41a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a9200640 1 -- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4112870 msgr2=0x7f69a419e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a9200640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4112870 0x7f69a419e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a9200640 1 -- 172.21.15.150:0/377937579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a419ef10 con 0x7f69a4077040 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69aa600640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4112870 0x7f69a419e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a9200640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 0x7f69a41a4b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f699000e9f0 tx=0x7f699000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:55.205 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699000cd80 con 0x7f69a4077040 2024-09-15T22:24:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6990010910 con 0x7f69a4077040 2024-09-15T22:24:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a419f200 con 0x7f69a4077040 2024-09-15T22:24:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990018990 con 0x7f69a4077040 2024-09-15T22:24:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.202+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a41ab550 con 0x7f69a4077040 2024-09-15T22:24:55.206 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.204+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a419f570 con 0x7f69a4077040 2024-09-15T22:24:55.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.206+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f6990010ac0 con 0x7f69a4077040 2024-09-15T22:24:55.208 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.207+0000 7f69a2000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f698c0a3240 0x7f698c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:55.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.207+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f69900cffa0 con 0x7f69a4077040 2024-09-15T22:24:55.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.207+0000 7f69a9c00640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f698c0a3240 0x7f698c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:55.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.208+0000 7f69a9c00640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f698c0a3240 0x7f698c0a5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6998005fd0 tx=0x7f6998009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:55.212 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.209+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f699009c5e0 con 0x7f69a4077040 2024-09-15T22:24:55.429 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.427+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69a4077e90 con 0x7f69a4077040 2024-09-15T22:24:55.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.428+0000 7f69a2000640 1 -- 172.21.15.150:0/377937579 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+12026 (secure 0 0 0) 0x7f69a4077e90 con 0x7f69a4077040 2024-09-15T22:24:55.430 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:24:55.430 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":57,"btime":"2024-09-15T22:24:49:215334+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:24:49.165129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:24:55.431 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 57 2024-09-15T22:24:55.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f698c0a3240 msgr2=0x7f698c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f698c0a3240 0x7f698c0a5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6998005fd0 tx=0x7f6998009680 comp rx=0 tx=0).stop 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 msgr2=0x7f69a41a4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 0x7f69a41a4b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f699000e9f0 tx=0x7f699000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 shutdown_connections 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f698c0a3240 0x7f698c0a5700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69a4112870 0x7f69a419e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4077040 0x7f69a41a4b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 --2- 172.21.15.150:0/377937579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a4076720 0x7f69a41a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.430+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 >> 172.21.15.150:0/377937579 conn(0x7f69a40ff910 msgr2=0x7f69a4101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.431+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 shutdown_connections 2024-09-15T22:24:55.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:55.431+0000 7f69ab000640 1 -- 172.21.15.150:0/377937579 wait complete. 2024-09-15T22:24:55.697 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:55 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/377937579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:55.697 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:55 smithi150 ceph-mon[30886]: pgmap v740: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 17 op/s 2024-09-15T22:24:55.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:55 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/377937579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:55.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:55 smithi154 ceph-mon[34853]: pgmap v740: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 17 op/s 2024-09-15T22:24:55.959 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:55 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/377937579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:55.960 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:55 smithi169 ceph-mon[35850]: pgmap v740: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 17 op/s 2024-09-15T22:24:56.210 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:56.580 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 -- 172.21.15.150:0/1876560650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac074ee0 msgr2=0x7f83ac10dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 --2- 172.21.15.150:0/1876560650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac074ee0 0x7f83ac10dee0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8394009900 tx=0x7f839402a480 comp rx=0 tx=0).stop 2024-09-15T22:24:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 -- 172.21.15.150:0/1876560650 shutdown_connections 2024-09-15T22:24:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 --2- 172.21.15.150:0/1876560650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac10e420 0x7f83ac110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 --2- 172.21.15.150:0/1876560650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac074ee0 0x7f83ac10dee0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 --2- 172.21.15.150:0/1876560650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83ac0745c0 0x7f83ac0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 -- 172.21.15.150:0/1876560650 >> 172.21.15.150:0/1876560650 conn(0x7f83ac0fd8c0 msgr2=0x7f83ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 -- 172.21.15.150:0/1876560650 shutdown_connections 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.150+0000 7f83b1200640 1 -- 172.21.15.150:0/1876560650 wait complete. 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.151+0000 7f83b1200640 1 Processor -- start 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.151+0000 7f83b1200640 1 -- start start 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.151+0000 7f83b1200640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 0x7f83ac19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.151+0000 7f83b1200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83ac074ee0 0x7f83ac19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.151+0000 7f83b1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac10e420 0x7f83ac19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.151+0000 7f83b1200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1141d0 con 0x7f83ac10e420 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83b1200640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac114050 con 0x7f83ac0745c0 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83b1200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac114350 con 0x7f83ac074ee0 2024-09-15T22:24:57.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83aa800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac10e420 0x7f83ac19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 0x7f83ac19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a1400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83ac074ee0 0x7f83ac19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 0x7f83ac19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37842/0 (socket says 172.21.15.150:37842) 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83aa800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac10e420 0x7f83ac19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53012/0 (socket says 172.21.15.150:53012) 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 -- 172.21.15.150:0/1885798315 learned_addr learned my addr 172.21.15.150:0/1885798315 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 -- 172.21.15.150:0/1885798315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83ac074ee0 msgr2=0x7f83ac19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83ac074ee0 0x7f83ac19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 -- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac10e420 msgr2=0x7f83ac19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac10e420 0x7f83ac19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.152+0000 7f83a9e00640 1 -- 172.21.15.150:0/1885798315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac19f650 con 0x7f83ac0745c0 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.153+0000 7f83a9e00640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 0x7f83ac19a6a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f839c00eb90 tx=0x7f839c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:57.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.153+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c004d20 con 0x7f83ac0745c0 2024-09-15T22:24:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.153+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac19f940 con 0x7f83ac0745c0 2024-09-15T22:24:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.153+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c00ee90 con 0x7f83ac0745c0 2024-09-15T22:24:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.153+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c010830 con 0x7f83ac0745c0 2024-09-15T22:24:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.153+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac1a7220 con 0x7f83ac0745c0 2024-09-15T22:24:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.154+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac0749a0 con 0x7f83ac0745c0 2024-09-15T22:24:57.161 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.156+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f839c005000 con 0x7f83ac0745c0 2024-09-15T22:24:57.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.157+0000 7f83a3400640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83900a3240 0x7f83900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:57.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.158+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f839c0d01d0 con 0x7f83ac0745c0 2024-09-15T22:24:57.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.158+0000 7f83a1400640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83900a3240 0x7f83900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:57.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.158+0000 7f83a1400640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83900a3240 0x7f83900a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8394000c00 tx=0x7f8394005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:57.162 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.159+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f839c0541b0 con 0x7f83ac0745c0 2024-09-15T22:24:57.372 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.371+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83ac109600 con 0x7f83ac0745c0 2024-09-15T22:24:57.373 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.372+0000 7f83a3400640 1 -- 172.21.15.150:0/1885798315 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+12026 (secure 0 0 0) 0x7f839c09ce60 con 0x7f83ac0745c0 2024-09-15T22:24:57.374 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:24:57.374 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":57,"btime":"2024-09-15T22:24:49:215334+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2570378588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2570378588},{"type":"v1","addr":"172.21.15.150:6837","nonce":2570378588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14523,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/715300877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":715300877},{"type":"v1","addr":"172.21.15.150:6839","nonce":715300877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:09:57.693830+0000","modified":"2024-09-15T22:24:49.165129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24578,"mds_1":24539,"mds_2":24523,"mds_3":24512,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14535":{"gid":14535,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6841/1726301246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6840","nonce":1726301246},{"type":"v1","addr":"172.21.15.150:6841","nonce":1726301246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/2170086704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2170086704},{"type":"v1","addr":"172.21.15.169:6833","nonce":2170086704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1449001850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1449001850},{"type":"v1","addr":"172.21.15.154:6833","nonce":1449001850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/3135790520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3135790520},{"type":"v1","addr":"172.21.15.150:6835","nonce":3135790520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/721825855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":721825855},{"type":"v1","addr":"172.21.15.169:6835","nonce":721825855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.169:6837/2204560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2204560239},{"type":"v1","addr":"172.21.15.169:6837","nonce":2204560239}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2752652039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2752652039},{"type":"v1","addr":"172.21.15.154:6835","nonce":2752652039}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.169:6839/2442112974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":2442112974},{"type":"v1","addr":"172.21.15.169:6839","nonce":2442112974}]},"join_fscid":-1,"export_targets":[3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.154:6837/1010193359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":1010193359},{"type":"v1","addr":"172.21.15.154:6837","nonce":1010193359}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/2093141507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":2093141507},{"type":"v1","addr":"172.21.15.154:6839","nonce":2093141507}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24539,24523,24512,24508]},"id":1}]} 2024-09-15T22:24:57.374 INFO:teuthology.orchestra.run.smithi150.stderr:dumped fsmap epoch 57 2024-09-15T22:24:57.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83900a3240 msgr2=0x7f83900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:57.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83900a3240 0x7f83900a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8394000c00 tx=0x7f8394005b50 comp rx=0 tx=0).stop 2024-09-15T22:24:57.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 msgr2=0x7f83ac19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:57.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 0x7f83ac19a6a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f839c00eb90 tx=0x7f839c00c6a0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 shutdown_connections 2024-09-15T22:24:57.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f83900a3240 0x7f83900a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83ac10e420 0x7f83ac19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83ac074ee0 0x7f83ac19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 --2- 172.21.15.150:0/1885798315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0745c0 0x7f83ac19a6a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:57.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 >> 172.21.15.150:0/1885798315 conn(0x7f83ac0fd8c0 msgr2=0x7f83ac0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:57.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 shutdown_connections 2024-09-15T22:24:57.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:57.375+0000 7f83b1200640 1 -- 172.21.15.150:0/1885798315 wait complete. 2024-09-15T22:24:57.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:57 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1885798315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:57.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:57 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1885798315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:57.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:57 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1885798315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:58.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:24:58.546 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:58.686 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:58 smithi150 ceph-mon[30886]: pgmap v741: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-15T22:24:58.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:58 smithi169 ceph-mon[35850]: pgmap v741: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-15T22:24:58.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:58 smithi154 ceph-mon[34853]: pgmap v741: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 -- 172.21.15.150:0/2622685479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074620 msgr2=0x7fa428074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 --2- 172.21.15.150:0/2622685479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074620 0x7fa428074a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa418009900 tx=0x7fa41802a480 comp rx=0 tx=0).stop 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 -- 172.21.15.150:0/2622685479 shutdown_connections 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 --2- 172.21.15.150:0/2622685479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42810e210 0x7fa428110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 --2- 172.21.15.150:0/2622685479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa428074f40 0x7fa42810dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 --2- 172.21.15.150:0/2622685479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074620 0x7fa428074a00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 -- 172.21.15.150:0/2622685479 >> 172.21.15.150:0/2622685479 conn(0x7fa4280fd710 msgr2=0x7fa4280ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 -- 172.21.15.150:0/2622685479 shutdown_connections 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.114+0000 7fa42d600640 1 -- 172.21.15.150:0/2622685479 wait complete. 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.115+0000 7fa42d600640 1 Processor -- start 2024-09-15T22:24:59.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.115+0000 7fa42d600640 1 -- start start 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42d600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa428074620 0x7fa42819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42d600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 0x7fa42819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42d600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42810e210 0x7fa42819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42d600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa428113fc0 con 0x7fa428074f40 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42d600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa428113e40 con 0x7fa428074620 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42d600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa428114140 con 0x7fa42810e210 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa427400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 0x7fa42819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa427e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa428074620 0x7fa42819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa427e00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa428074620 0x7fa42819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:37864/0 (socket says 172.21.15.150:37864) 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa427e00640 1 -- 172.21.15.150:0/1760886845 learned_addr learned my addr 172.21.15.150:0/1760886845 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa427400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 0x7fa42819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:53022/0 (socket says 172.21.15.150:53022) 2024-09-15T22:24:59.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.116+0000 7fa42cc00640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42810e210 0x7fa42819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa427400640 1 -- 172.21.15.150:0/1760886845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42810e210 msgr2=0x7fa42819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa427400640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42810e210 0x7fa42819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa427400640 1 -- 172.21.15.150:0/1760886845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa428074620 msgr2=0x7fa42819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa427400640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa428074620 0x7fa42819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa427400640 1 -- 172.21.15.150:0/1760886845 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42819f470 con 0x7fa428074f40 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa42cc00640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42810e210 0x7fa42819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa427400640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 0x7fa42819aa00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa41400e9f0 tx=0x7fa41400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41400ccc0 con 0x7fa428074f40 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa414005020 con 0x7fa428074f40 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42819f760 con 0x7fa428074f40 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4140049e0 con 0x7fa428074f40 2024-09-15T22:24:59.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.117+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4281a7040 con 0x7fa428074f40 2024-09-15T22:24:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.118+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa428074a00 con 0x7fa428074f40 2024-09-15T22:24:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.121+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fa414005560 con 0x7fa428074f40 2024-09-15T22:24:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.122+0000 7fa424c00640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa40c0a3240 0x7fa40c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:59.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.122+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7fa4140cf910 con 0x7fa428074f40 2024-09-15T22:24:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.123+0000 7fa427e00640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa40c0a3240 0x7fa40c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:59.126 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.123+0000 7fa427e00640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa40c0a3240 0x7fa40c0a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa4180096c0 tx=0x7fa418005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:59.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.127+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4140051d0 con 0x7fa428074f40 2024-09-15T22:24:59.303 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.301+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa42802d7c0 con 0x7fa428074f40 2024-09-15T22:24:59.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.303+0000 7fa424c00640 1 -- 172.21.15.150:0/1760886845 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22912 (secure 0 0 0) 0x7fa41409c5a0 con 0x7fa428074f40 2024-09-15T22:24:59.305 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-15T22:24:59.305 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":84,"fsid":"faa38c0e-73ad-11ef-bceb-c7b262605968","created":"2024-09-15T22:01:51.173086+0000","modified":"2024-09-15T22:11:44.269746+0000","last_up_change":"2024-09-15T22:09:01.146791+0000","last_in_change":"2024-09-15T22:08:38.518509+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:05:05.654013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:09:52.845421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:09:55.664798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"defc4d93-c2c6-464f-a12c-3081cad7a002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6803","nonce":1337195961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6805","nonce":1337195961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6809","nonce":1337195961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1337195961},{"type":"v1","addr":"172.21.15.150:6807","nonce":1337195961}]},"public_addr":"172.21.15.150:6803/1337195961","cluster_addr":"172.21.15.150:6805/1337195961","heartbeat_back_addr":"172.21.15.150:6809/1337195961","heartbeat_front_addr":"172.21.15.150:6807/1337195961","state":["exists","up"]},{"osd":1,"uuid":"042fff78-7cda-42c3-b58a-ad6488a3dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6801","nonce":1467569583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6803","nonce":1467569583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6807","nonce":1467569583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1467569583},{"type":"v1","addr":"172.21.15.154:6805","nonce":1467569583}]},"public_addr":"172.21.15.154:6801/1467569583","cluster_addr":"172.21.15.154:6803/1467569583","heartbeat_back_addr":"172.21.15.154:6807/1467569583","heartbeat_front_addr":"172.21.15.154:6805/1467569583","state":["exists","up"]},{"osd":2,"uuid":"82099aa0-3e95-412f-8801-880ea1f6d9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6801","nonce":2021221848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6803","nonce":2021221848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6807","nonce":2021221848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2021221848},{"type":"v1","addr":"172.21.15.169:6805","nonce":2021221848}]},"public_addr":"172.21.15.169:6801/2021221848","cluster_addr":"172.21.15.169:6803/2021221848","heartbeat_back_addr":"172.21.15.169:6807/2021221848","heartbeat_front_addr":"172.21.15.169:6805/2021221848","state":["exists","up"]},{"osd":3,"uuid":"c82106b6-b1f8-47e1-9be8-631d67fbb09e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6811","nonce":720589173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6813","nonce":720589173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6817","nonce":720589173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":720589173},{"type":"v1","addr":"172.21.15.150:6815","nonce":720589173}]},"public_addr":"172.21.15.150:6811/720589173","cluster_addr":"172.21.15.150:6813/720589173","heartbeat_back_addr":"172.21.15.150:6817/720589173","heartbeat_front_addr":"172.21.15.150:6815/720589173","state":["exists","up"]},{"osd":4,"uuid":"2d7e1830-827c-415b-b6e2-a495eb3914fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6809","nonce":3739544078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6811","nonce":3739544078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6815","nonce":3739544078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3739544078},{"type":"v1","addr":"172.21.15.154:6813","nonce":3739544078}]},"public_addr":"172.21.15.154:6809/3739544078","cluster_addr":"172.21.15.154:6811/3739544078","heartbeat_back_addr":"172.21.15.154:6815/3739544078","heartbeat_front_addr":"172.21.15.154:6813/3739544078","state":["exists","up"]},{"osd":5,"uuid":"8835e251-fc59-4515-b973-ee290b8c9093","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6809","nonce":2553035733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6811","nonce":2553035733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6815","nonce":2553035733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2553035733},{"type":"v1","addr":"172.21.15.169:6813","nonce":2553035733}]},"public_addr":"172.21.15.169:6809/2553035733","cluster_addr":"172.21.15.169:6811/2553035733","heartbeat_back_addr":"172.21.15.169:6815/2553035733","heartbeat_front_addr":"172.21.15.169:6813/2553035733","state":["exists","up"]},{"osd":6,"uuid":"a6debad2-ff5e-42e8-941d-5568a5d7d9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6819","nonce":2947582295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6821","nonce":2947582295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6825","nonce":2947582295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2947582295},{"type":"v1","addr":"172.21.15.150:6823","nonce":2947582295}]},"public_addr":"172.21.15.150:6819/2947582295","cluster_addr":"172.21.15.150:6821/2947582295","heartbeat_back_addr":"172.21.15.150:6825/2947582295","heartbeat_front_addr":"172.21.15.150:6823/2947582295","state":["exists","up"]},{"osd":7,"uuid":"b2fe39e3-34ef-4b27-a7ab-688f0497e893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6817","nonce":1862188814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6819","nonce":1862188814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6823","nonce":1862188814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1862188814},{"type":"v1","addr":"172.21.15.154:6821","nonce":1862188814}]},"public_addr":"172.21.15.154:6817/1862188814","cluster_addr":"172.21.15.154:6819/1862188814","heartbeat_back_addr":"172.21.15.154:6823/1862188814","heartbeat_front_addr":"172.21.15.154:6821/1862188814","state":["exists","up"]},{"osd":8,"uuid":"d0cfc7ba-4548-480a-9251-906ba609e9cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6817","nonce":2545784116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6819","nonce":2545784116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6823","nonce":2545784116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2545784116},{"type":"v1","addr":"172.21.15.169:6821","nonce":2545784116}]},"public_addr":"172.21.15.169:6817/2545784116","cluster_addr":"172.21.15.169:6819/2545784116","heartbeat_back_addr":"172.21.15.169:6823/2545784116","heartbeat_front_addr":"172.21.15.169:6821/2545784116","state":["exists","up"]},{"osd":9,"uuid":"1f871001-d0f3-4b56-ab67-15c4c7ac88d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6827","nonce":3744711849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6829","nonce":3744711849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6833","nonce":3744711849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3744711849},{"type":"v1","addr":"172.21.15.150:6831","nonce":3744711849}]},"public_addr":"172.21.15.150:6827/3744711849","cluster_addr":"172.21.15.150:6829/3744711849","heartbeat_back_addr":"172.21.15.150:6833/3744711849","heartbeat_front_addr":"172.21.15.150:6831/3744711849","state":["exists","up"]},{"osd":10,"uuid":"cbf9fa28-8307-41a7-8c98-b00697d3c837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6825","nonce":3374528953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6827","nonce":3374528953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6831","nonce":3374528953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3374528953},{"type":"v1","addr":"172.21.15.154:6829","nonce":3374528953}]},"public_addr":"172.21.15.154:6825/3374528953","cluster_addr":"172.21.15.154:6827/3374528953","heartbeat_back_addr":"172.21.15.154:6831/3374528953","heartbeat_front_addr":"172.21.15.154:6829/3374528953","state":["exists","up"]},{"osd":11,"uuid":"8474de2f-ba9c-4888-adec-e408f8c16e95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6825","nonce":33837423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6827","nonce":33837423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6831","nonce":33837423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":33837423},{"type":"v1","addr":"172.21.15.169:6829","nonce":33837423}]},"public_addr":"172.21.15.169:6825/33837423","cluster_addr":"172.21.15.169:6827/33837423","heartbeat_back_addr":"172.21.15.169:6831/33837423","heartbeat_front_addr":"172.21.15.169:6829/33837423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:12.460673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:04:38.107867+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:02.995468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:32.519938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:05:57.691061+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:22.528443+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:06:51.994989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:17.290972+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:07:41.957323+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:10.665194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.920613+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:00.097856+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8},{"from":3,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6800/3271868660":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2539129789":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/370021496":"2024-09-16T22:02:43.046629+0000","172.21.15.150:0/2466465214":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3629553483":"2024-09-16T22:02:43.046629+0000","172.21.15.150:6801/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3932611497":"2024-09-16T22:02:16.539388+0000","172.21.15.150:6800/685691735":"2024-09-16T22:02:16.539388+0000","172.21.15.150:0/3547163182":"2024-09-16T22:02:16.539388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:24:59.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa40c0a3240 msgr2=0x7fa40c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:59.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa40c0a3240 0x7fa40c0a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa4180096c0 tx=0x7fa418005a20 comp rx=0 tx=0).stop 2024-09-15T22:24:59.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 msgr2=0x7fa42819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:59.307 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 0x7fa42819aa00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa41400e9f0 tx=0x7fa41400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 shutdown_connections 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42810e210 0x7fa42819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fa40c0a3240 0x7fa40c0a5700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa428074f40 0x7fa42819aa00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 --2- 172.21.15.150:0/1760886845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa428074620 0x7fa42819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.305+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 >> 172.21.15.150:0/1760886845 conn(0x7fa4280fd710 msgr2=0x7fa4280fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.306+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 shutdown_connections 2024-09-15T22:24:59.308 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:24:59.306+0000 7fa42d600640 1 -- 172.21.15.150:0/1760886845 wait complete. 2024-09-15T22:24:59.651 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:24:59 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/1760886845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:59.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:24:59 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/1760886845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:59.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:24:59 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/1760886845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:24:59.989 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T22:25:00.361 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:00.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:00 smithi169 ceph-mon[35850]: pgmap v742: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.2 KiB/s wr, 17 op/s 2024-09-15T22:25:00.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:00 smithi150 ceph-mon[30886]: pgmap v742: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.2 KiB/s wr, 17 op/s 2024-09-15T22:25:00.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:00 smithi154 ceph-mon[34853]: pgmap v742: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.2 KiB/s wr, 17 op/s 2024-09-15T22:25:01.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 -- 172.21.15.150:0/777078246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e54109140 msgr2=0x7f6e54110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 --2- 172.21.15.150:0/777078246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e54109140 0x7f6e54110cc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009ca0 tx=0x7f6e4c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 -- 172.21.15.150:0/777078246 shutdown_connections 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 --2- 172.21.15.150:0/777078246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e54109140 0x7f6e54110cc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 --2- 172.21.15.150:0/777078246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e541049c0 0x7f6e54108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 --2- 172.21.15.150:0/777078246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54104010 0x7f6e541043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 -- 172.21.15.150:0/777078246 >> 172.21.15.150:0/777078246 conn(0x7f6e540ffa50 msgr2=0x7f6e54101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.007+0000 7f6e59a00640 1 -- 172.21.15.150:0/777078246 shutdown_connections 2024-09-15T22:25:01.010 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.008+0000 7f6e59a00640 1 -- 172.21.15.150:0/777078246 wait complete. 2024-09-15T22:25:01.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 Processor -- start 2024-09-15T22:25:01.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 -- start start 2024-09-15T22:25:01.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e54104010 0x7f6e5419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:01.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 0x7f6e5419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54109140 0x7f6e5419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6e541141c0 con 0x7f6e541049c0 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e54114040 con 0x7f6e54109140 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e59a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e54114340 con 0x7f6e54104010 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e52000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 0x7f6e5419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e52000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 0x7f6e5419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60004/0 (socket says 172.21.15.150:60004) 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e52000640 1 -- 172.21.15.150:0/3520012157 learned_addr learned my addr 172.21.15.150:0/3520012157 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.009+0000 7f6e52a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e54104010 0x7f6e5419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:01.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e53400640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54109140 0x7f6e5419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:01.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e52000640 1 -- 172.21.15.150:0/3520012157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e54104010 msgr2=0x7f6e5419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e52000640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e54104010 0x7f6e5419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e52000640 1 -- 172.21.15.150:0/3520012157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54109140 msgr2=0x7f6e5419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e52000640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54109140 0x7f6e5419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e52000640 1 -- 172.21.15.150:0/3520012157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5419f5f0 con 0x7f6e541049c0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.010+0000 7f6e52000640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 0x7f6e5419ab80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000e9f0 tx=0x7f6e4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.011+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000cd80 con 0x7f6e541049c0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.011+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e40005500 con 0x7f6e541049c0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.011+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40010690 con 0x7f6e541049c0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.011+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5419f8e0 con 0x7f6e541049c0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.011+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e541a71c0 con 0x7f6e541049c0 2024-09-15T22:25:01.014 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.012+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e541043f0 con 0x7f6e541049c0 2024-09-15T22:25:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.014+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f6e400046c0 con 0x7f6e541049c0 2024-09-15T22:25:01.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.015+0000 7f6e4b400640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6e380a32c0 0x7f6e380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:01.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.015+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8285+0+0 (secure 0 0 0) 0x7f6e400cff40 con 0x7f6e541049c0 2024-09-15T22:25:01.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.015+0000 7f6e52a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6e380a32c0 0x7f6e380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:01.017 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.016+0000 7f6e52a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6e380a32c0 0x7f6e380a5780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e440095f0 tx=0x7f6e44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:01.019 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.017+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e4009cbd0 con 0x7f6e541049c0 2024-09-15T22:25:01.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.231+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6e5419b9a0 con 0x7f6e541049c0 2024-09-15T22:25:01.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.234+0000 7f6e4b400640 1 -- 172.21.15.150:0/3520012157 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) ==== 161+0+0 (secure 0 0 0) 0x7f6e5419b9a0 con 0x7f6e541049c0 2024-09-15T22:25:01.236 INFO:teuthology.orchestra.run.smithi150.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:25:01.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.238+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6e380a32c0 msgr2=0x7f6e380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.238+0000 7f6e59a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6e380a32c0 0x7f6e380a5780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e440095f0 tx=0x7f6e44005f90 comp rx=0 tx=0).stop 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.238+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 msgr2=0x7f6e5419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.238+0000 7f6e59a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 0x7f6e5419ab80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000e9f0 tx=0x7f6e4000edf0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 shutdown_connections 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e54109140 0x7f6e5419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f6e380a32c0 0x7f6e380a5780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.241 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e541049c0 0x7f6e5419ab80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 --2- 172.21.15.150:0/3520012157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e54104010 0x7f6e5419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:01.242 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 >> 172.21.15.150:0/3520012157 conn(0x7f6e540ffa50 msgr2=0x7f6e54100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:01.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 shutdown_connections 2024-09-15T22:25:01.243 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:01.239+0000 7f6e59a00640 1 -- 172.21.15.150:0/3520012157 wait complete. 2024-09-15T22:25:01.257 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a[30882]: 2024-09-15T22:25:01.232+0000 7feb53c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:25:01.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3520012157' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:25:01.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mon[30886]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:25:01.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mon[30886]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:25:01.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/3520012157' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:25:01.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mon[30886]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:25:01.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mon[30886]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j[70637]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j[70637]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mds[70643]: -- 172.21.15.150:0/1593409452 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558fd5e85860 con 0x558fd5e63400 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j[70637]: starting mds.j at 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a[72197]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a[72197]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-mds[72201]: -- 172.21.15.150:0/870249679 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640d0a35c20 con 0x5640d0a12800 2024-09-15T22:25:01.583 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:25:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a[72197]: starting mds.a at 2024-09-15T22:25:01.611 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3520012157' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:25:01.611 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mon[35850]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:25:01.611 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mon[35850]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:25:01.611 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/3520012157' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mon[35850]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mon[35850]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i[66519]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i[66519]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mds[66523]: -- 172.21.15.169:0/669803768 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d08f5d860 con 0x555d08f3b000 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i[66519]: starting mds.i at 2024-09-15T22:25:01.612 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l[65604]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.613 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l[65604]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.613 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mds[65608]: -- 172.21.15.169:0/3186532877 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd3e811860 con 0x55bd3e7ee800 2024-09-15T22:25:01.613 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l[65604]: starting mds.l at 2024-09-15T22:25:01.613 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c[66218]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.613 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c[66218]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.613 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mds[66222]: -- 172.21.15.169:0/11034341 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55799487b860 con 0x557994859000 2024-09-15T22:25:01.614 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c[66218]: starting mds.c at 2024-09-15T22:25:01.614 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f[65919]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.614 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f[65919]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.614 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-mds[65923]: -- 172.21.15.169:0/3704232980 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f54a9d860 con 0x560f54a7a800 2024-09-15T22:25:01.614 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:25:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f[65919]: starting mds.f at 2024-09-15T22:25:01.771 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e[64221]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.771 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e[64221]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.771 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e[64221]: starting mds.e at 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3520012157' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mon[34853]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mon[34853]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/3520012157' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mon[34853]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mon[34853]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-15T22:25:01.772 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: starting mds.b at 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k[63906]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k[63906]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mds[63910]: -- 172.21.15.154:0/107933465 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a97d6f860 con 0x563a97d4d000 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k[63906]: starting mds.k at 2024-09-15T22:25:01.773 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h[64523]: ignoring --setuser ceph since I am not root 2024-09-15T22:25:01.774 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h[64523]: ignoring --setgroup ceph since I am not root 2024-09-15T22:25:01.774 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-mds[64527]: -- 172.21.15.154:0/679745603 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d453ffd860 con 0x55d453fdb400 2024-09-15T22:25:01.774 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:25:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h[64523]: starting mds.h at 2024-09-15T22:25:01.914 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:25:02.287 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: pgmap v744: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6832/404220624,v1:172.21.15.169:6834/404220624] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6833/2992422600,v1:172.21.15.169:6835/2992422600] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6837/66377743,v1:172.21.15.169:6839/66377743] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.169:6836/678490553,v1:172.21.15.169:6838/678490553] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6832/596900155,v1:172.21.15.154:6834/596900155] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6833/1384484184,v1:172.21.15.154:6835/1384484184] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6836/3475972935,v1:172.21.15.154:6838/3475972935] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.154:6837/2359346183,v1:172.21.15.154:6839/2359346183] up:boot 2024-09-15T22:25:02.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.150:6834/2454688982,v1:172.21.15.150:6840/2454688982] up:boot 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: mds.? [v2:172.21.15.150:6835/3937281134,v1:172.21.15.150:6841/3937281134] up:boot 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:25:02.678 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:02 smithi150 ceph-mon[30886]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: pgmap v744: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6832/404220624,v1:172.21.15.169:6834/404220624] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6833/2992422600,v1:172.21.15.169:6835/2992422600] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6837/66377743,v1:172.21.15.169:6839/66377743] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.169:6836/678490553,v1:172.21.15.169:6838/678490553] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6832/596900155,v1:172.21.15.154:6834/596900155] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6833/1384484184,v1:172.21.15.154:6835/1384484184] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6836/3475972935,v1:172.21.15.154:6838/3475972935] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.154:6837/2359346183,v1:172.21.15.154:6839/2359346183] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.150:6834/2454688982,v1:172.21.15.150:6840/2454688982] up:boot 2024-09-15T22:25:02.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: mds.? [v2:172.21.15.150:6835/3937281134,v1:172.21.15.150:6841/3937281134] up:boot 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:25:02.711 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:02 smithi169 ceph-mon[35850]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:25:02.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: pgmap v744: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6832/404220624,v1:172.21.15.169:6834/404220624] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6833/2992422600,v1:172.21.15.169:6835/2992422600] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6837/66377743,v1:172.21.15.169:6839/66377743] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.169:6836/678490553,v1:172.21.15.169:6838/678490553] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6832/596900155,v1:172.21.15.154:6834/596900155] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6833/1384484184,v1:172.21.15.154:6835/1384484184] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6836/3475972935,v1:172.21.15.154:6838/3475972935] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.154:6837/2359346183,v1:172.21.15.154:6839/2359346183] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.150:6834/2454688982,v1:172.21.15.150:6840/2454688982] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: mds.? [v2:172.21.15.150:6835/3937281134,v1:172.21.15.150:6841/3937281134] up:boot 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-15T22:25:02.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:25:02.773 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:02 smithi154 ceph-mon[34853]: from='mgr.14150 172.21.15.150:0/4177760413' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.815+0000 7f5526000640 1 -- 172.21.15.150:0/3277450196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074620 msgr2=0x7f5520074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.815+0000 7f5526000640 1 --2- 172.21.15.150:0/3277450196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074620 0x7f5520074a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5510009900 tx=0x7f551002a480 comp rx=0 tx=0).stop 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 -- 172.21.15.150:0/3277450196 shutdown_connections 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 --2- 172.21.15.150:0/3277450196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552010e3c0 0x7f5520110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 --2- 172.21.15.150:0/3277450196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5520074f40 0x7f552010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 --2- 172.21.15.150:0/3277450196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074620 0x7f5520074a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 -- 172.21.15.150:0/3277450196 >> 172.21.15.150:0/3277450196 conn(0x7f55200fd8c0 msgr2=0x7f55200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 -- 172.21.15.150:0/3277450196 shutdown_connections 2024-09-15T22:25:02.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.816+0000 7f5526000640 1 -- 172.21.15.150:0/3277450196 wait complete. 2024-09-15T22:25:02.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 Processor -- start 2024-09-15T22:25:02.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 -- start start 2024-09-15T22:25:02.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5520074620 0x7f552019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:02.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074f40 0x7f552019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:02.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f552010e3c0 0x7f552019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f55201141a0 con 0x7f5520074620 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5520114020 con 0x7f552010e3c0 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5526000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5520114320 con 0x7f5520074f40 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f551f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5520074620 0x7f552019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f551f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5520074620 0x7f552019a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60046/0 (socket says 172.21.15.150:60046) 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f5516a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074f40 0x7f552019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.817+0000 7f551f400640 1 -- 172.21.15.150:0/2179902618 learned_addr learned my addr 172.21.15.150:0/2179902618 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:25:02.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f551fe00640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f552010e3c0 0x7f552019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5516a00640 1 -- 172.21.15.150:0/2179902618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f552010e3c0 msgr2=0x7f552019df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5516a00640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f552010e3c0 0x7f552019df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5516a00640 1 -- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5520074620 msgr2=0x7f552019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5516a00640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5520074620 0x7f552019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5516a00640 1 -- 172.21.15.150:0/2179902618 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552019e6b0 con 0x7f5520074f40 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5516a00640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074f40 0x7f552019aca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f550800e9f0 tx=0x7f550800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550800cd80 con 0x7f5520074f40 2024-09-15T22:25:02.821 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552019e9a0 con 0x7f5520074f40 2024-09-15T22:25:02.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55080035f0 con 0x7f5520074f40 2024-09-15T22:25:02.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508010670 con 0x7f5520074f40 2024-09-15T22:25:02.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.818+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55201a7310 con 0x7f5520074f40 2024-09-15T22:25:02.822 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.820+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5520074a00 con 0x7f5520074f40 2024-09-15T22:25:02.823 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.821+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7f55080037a0 con 0x7f5520074f40 2024-09-15T22:25:02.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.823+0000 7f551cc00640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55040a3240 0x7f55040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:02.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.823+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8715+0+0 (secure 0 0 0) 0x7f55080d01c0 con 0x7f5520074f40 2024-09-15T22:25:02.825 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.824+0000 7f551f400640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55040a3240 0x7f55040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:02.826 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.824+0000 7f551f400640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55040a3240 0x7f55040a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f55100096c0 tx=0x7f55100046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:02.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:02.828+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f550809cca0 con 0x7f5520074f40 2024-09-15T22:25:03.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.041+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5520109540 con 0x7f5520074f40 2024-09-15T22:25:03.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.449+0000 7f551cc00640 1 -- 172.21.15.150:0/2179902618 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) ==== 104+0+0 (secure 0 0 0) 0x7f550809c5a0 con 0x7f5520074f40 2024-09-15T22:25:03.453 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.451+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55040a3240 msgr2=0x7f55040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.451+0000 7f5526000640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55040a3240 0x7f55040a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f55100096c0 tx=0x7f55100046c0 comp rx=0 tx=0).stop 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074f40 msgr2=0x7f552019aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074f40 0x7f552019aca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f550800e9f0 tx=0x7f550800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 shutdown_connections 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f552010e3c0 0x7f552019df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5520074f40 0x7f552019aca0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7f55040a3240 0x7f55040a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 --2- 172.21.15.150:0/2179902618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5520074620 0x7f552019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 >> 172.21.15.150:0/2179902618 conn(0x7f55200fd8c0 msgr2=0x7f55200fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 shutdown_connections 2024-09-15T22:25:03.454 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:03.452+0000 7f5526000640 1 -- 172.21.15.150:0/2179902618 wait complete. 2024-09-15T22:25:03.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:03 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2179902618' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:03.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:03 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:03 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2179902618' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:03.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:03 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:03.834 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:03 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2179902618' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:03.834 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:03 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:25:04.213 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:25:04.586 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:04.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:04 smithi169 ceph-mon[35850]: pgmap v745: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-15T22:25:04.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:04 smithi169 ceph-mon[35850]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:25:04.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:04 smithi169 ceph-mon[35850]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:25:04.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:04 smithi169 ceph-mon[35850]: Cluster is now healthy 2024-09-15T22:25:04.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:04 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:04.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:04 smithi169 ceph-mon[35850]: fsmap 12 up:standby 2024-09-15T22:25:04.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:04 smithi150 ceph-mon[30886]: pgmap v745: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-15T22:25:04.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:04 smithi150 ceph-mon[30886]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:25:04.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:04 smithi150 ceph-mon[30886]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:25:04.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:04 smithi150 ceph-mon[30886]: Cluster is now healthy 2024-09-15T22:25:04.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:04 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:04.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:04 smithi150 ceph-mon[30886]: fsmap 12 up:standby 2024-09-15T22:25:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:04 smithi154 ceph-mon[34853]: pgmap v745: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-15T22:25:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:04 smithi154 ceph-mon[34853]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:25:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:04 smithi154 ceph-mon[34853]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:25:04.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:04 smithi154 ceph-mon[34853]: Cluster is now healthy 2024-09-15T22:25:04.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:04 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:25:04.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:04 smithi154 ceph-mon[34853]: fsmap 12 up:standby 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 -- 172.21.15.150:0/3383207003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 msgr2=0x7ff1c8108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 --2- 172.21.15.150:0/3383207003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c8108a10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009900 tx=0x7ff1b402a410 comp rx=0 tx=0).stop 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 -- 172.21.15.150:0/3383207003 shutdown_connections 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 --2- 172.21.15.150:0/3383207003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8109140 0x7ff1c8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 --2- 172.21.15.150:0/3383207003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c8108a10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 --2- 172.21.15.150:0/3383207003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c8104010 0x7ff1c81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.108+0000 7ff1cd600640 1 -- 172.21.15.150:0/3383207003 >> 172.21.15.150:0/3383207003 conn(0x7ff1c80ffa50 msgr2=0x7ff1c8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.109+0000 7ff1cd600640 1 -- 172.21.15.150:0/3383207003 shutdown_connections 2024-09-15T22:25:05.111 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.109+0000 7ff1cd600640 1 -- 172.21.15.150:0/3383207003 wait complete. 2024-09-15T22:25:05.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 Processor -- start 2024-09-15T22:25:05.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 -- start start 2024-09-15T22:25:05.112 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8104010 0x7ff1c819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c8109140 0x7ff1c819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8114160 con 0x7ff1c81049c0 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8113fe0 con 0x7ff1c8109140 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1cd600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81142e0 con 0x7ff1c8104010 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1c6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1c6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60060/0 (socket says 172.21.15.150:60060) 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.110+0000 7ff1c6a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8104010 0x7ff1c819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 -- 172.21.15.150:0/2716718201 learned_addr learned my addr 172.21.15.150:0/2716718201 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:25:05.113 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c7400640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c8109140 0x7ff1c819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:05.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 -- 172.21.15.150:0/2716718201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8104010 msgr2=0x7ff1c819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:05.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8104010 0x7ff1c819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 -- 172.21.15.150:0/2716718201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c8109140 msgr2=0x7ff1c819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:05.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c8109140 0x7ff1c819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 -- 172.21.15.150:0/2716718201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c819f5f0 con 0x7ff1c81049c0 2024-09-15T22:25:05.115 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6a00640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8104010 0x7ff1c819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:05.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.111+0000 7ff1c6000640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c819ab80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006010 tx=0x7ff1b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:05.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.112+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b403f030 con 0x7ff1c81049c0 2024-09-15T22:25:05.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.112+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b4004440 con 0x7ff1c81049c0 2024-09-15T22:25:05.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.112+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4035070 con 0x7ff1c81049c0 2024-09-15T22:25:05.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.112+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c819f880 con 0x7ff1c81049c0 2024-09-15T22:25:05.116 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.112+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c819fd10 con 0x7ff1c81049c0 2024-09-15T22:25:05.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.114+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c81043f0 con 0x7ff1c81049c0 2024-09-15T22:25:05.118 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.117+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7ff1b4042030 con 0x7ff1c81049c0 2024-09-15T22:25:05.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.118+0000 7ff1bf400640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff1ac0a3240 0x7ff1ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:05.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.118+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8715+0+0 (secure 0 0 0) 0x7ff1b40efb40 con 0x7ff1c81049c0 2024-09-15T22:25:05.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.118+0000 7ff1c6a00640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff1ac0a3240 0x7ff1ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:05.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.119+0000 7ff1c6a00640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff1ac0a3240 0x7ff1ac0a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80095f0 tx=0x7ff1b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:05.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.123+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1b40bbfd0 con 0x7ff1c81049c0 2024-09-15T22:25:05.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.303+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff1c810bdf0 con 0x7ff1c81049c0 2024-09-15T22:25:05.452 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.450+0000 7ff1bf400640 1 -- 172.21.15.150:0/2716718201 <== mon.0 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7ff1b40c02d0 con 0x7ff1c81049c0 2024-09-15T22:25:05.452 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:25:05.456 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff1ac0a3240 msgr2=0x7ff1ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff1ac0a3240 0x7ff1ac0a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80095f0 tx=0x7ff1b8005f90 comp rx=0 tx=0).stop 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 msgr2=0x7ff1c819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c819ab80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006010 tx=0x7ff1b4004040 comp rx=0 tx=0).stop 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 shutdown_connections 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1c8109140 0x7ff1c819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7ff1ac0a3240 0x7ff1ac0a5700 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c81049c0 0x7ff1c819ab80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 --2- 172.21.15.150:0/2716718201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1c8104010 0x7ff1c819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:05.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.454+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 >> 172.21.15.150:0/2716718201 conn(0x7ff1c80ffa50 msgr2=0x7ff1c8100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:05.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.455+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 shutdown_connections 2024-09-15T22:25:05.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:05.455+0000 7ff1cd600640 1 -- 172.21.15.150:0/2716718201 wait complete. 2024-09-15T22:25:05.677 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:05 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2716718201' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:05.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:05 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2716718201' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:05.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:05 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2716718201' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:06.232 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:25:06.613 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:06 smithi169 ceph-mon[35850]: pgmap v746: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-15T22:25:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:06 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/2716718201' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:25:06.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:06 smithi169 ceph-mon[35850]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:25:06.752 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:06 smithi150 ceph-mon[30886]: pgmap v746: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-15T22:25:06.752 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:06 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/2716718201' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:25:06.752 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:06 smithi150 ceph-mon[30886]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:25:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:06 smithi154 ceph-mon[34853]: pgmap v746: 97 pgs: 97 active+clean; 839 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-15T22:25:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:06 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/2716718201' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:25:06.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:06 smithi154 ceph-mon[34853]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:25:07.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 -- 172.21.15.150:0/3043069205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac60074ee0 msgr2=0x7fac6010dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:07.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 --2- 172.21.15.150:0/3043069205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac60074ee0 0x7fac6010dd20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac48009900 tx=0x7fac4802a480 comp rx=0 tx=0).stop 2024-09-15T22:25:07.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 -- 172.21.15.150:0/3043069205 shutdown_connections 2024-09-15T22:25:07.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 --2- 172.21.15.150:0/3043069205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.188 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 --2- 172.21.15.150:0/3043069205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac60074ee0 0x7fac6010dd20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 --2- 172.21.15.150:0/3043069205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac600745c0 0x7fac600749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 -- 172.21.15.150:0/3043069205 >> 172.21.15.150:0/3043069205 conn(0x7fac600fd740 msgr2=0x7fac600ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:07.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 -- 172.21.15.150:0/3043069205 shutdown_connections 2024-09-15T22:25:07.189 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.186+0000 7fac5fe00640 1 -- 172.21.15.150:0/3043069205 wait complete. 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 Processor -- start 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 -- start start 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac600745c0 0x7fac60101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac60074ee0 0x7fac60101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fac60113fb0 con 0x7fac600745c0 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac60113e30 con 0x7fac6010e260 2024-09-15T22:25:07.190 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.187+0000 7fac5fe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac60114130 con 0x7fac60074ee0 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac600745c0 0x7fac60101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac56000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac60074ee0 0x7fac60101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac600745c0 0x7fac60101980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:60078/0 (socket says 172.21.15.150:60078) 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60102400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.150:33820/0 (socket says 172.21.15.150:33820) 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5ea00640 1 -- 172.21.15.150:0/34624886 learned_addr learned my addr 172.21.15.150:0/34624886 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 -- 172.21.15.150:0/34624886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac60074ee0 msgr2=0x7fac60101ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac60074ee0 0x7fac60101ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 -- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac600745c0 msgr2=0x7fac60101980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac600745c0 0x7fac60101980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.191 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.188+0000 7fac5f400640 1 -- 172.21.15.150:0/34624886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac601aab30 con 0x7fac6010e260 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.189+0000 7fac5f400640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60102400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fac5800ea80 tx=0x7fac5800ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.189+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5800cea0 con 0x7fac6010e260 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.189+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac58005020 con 0x7fac6010e260 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.189+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac601aae20 con 0x7fac6010e260 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.189+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac580106d0 con 0x7fac6010e260 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.189+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac601ab2e0 con 0x7fac6010e260 2024-09-15T22:25:07.193 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.190+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac60075c70 con 0x7fac6010e260 2024-09-15T22:25:07.194 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.192+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 138356+0+0 (secure 0 0 0) 0x7fac58005540 con 0x7fac6010e260 2024-09-15T22:25:07.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.193+0000 7fac57e00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fac440a3240 0x7fac440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:07.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.193+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8153+0+0 (secure 0 0 0) 0x7fac580cff10 con 0x7fac6010e260 2024-09-15T22:25:07.195 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.194+0000 7fac5ea00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fac440a3240 0x7fac440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:07.196 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.194+0000 7fac5ea00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fac440a3240 0x7fac440a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fac50009c90 tx=0x7fac50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:07.199 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.197+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac5809cc30 con 0x7fac6010e260 2024-09-15T22:25:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.377+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac6002d7c0 con 0x7fac6010e260 2024-09-15T22:25:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.468+0000 7fac57e00640 1 -- 172.21.15.150:0/34624886 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7fac5809c530 con 0x7fac6010e260 2024-09-15T22:25:07.470 INFO:teuthology.orchestra.run.smithi150.stderr:pool 'cephfs_data' removed 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.471+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fac440a3240 msgr2=0x7fac440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.471+0000 7fac5fe00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fac440a3240 0x7fac440a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fac50009c90 tx=0x7fac50005f90 comp rx=0 tx=0).stop 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.471+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 msgr2=0x7fac60102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.471+0000 7fac5fe00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60102400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fac5800ea80 tx=0x7fac5800ef40 comp rx=0 tx=0).stop 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.472+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 shutdown_connections 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.472+0000 7fac5fe00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac6010e260 0x7fac60102400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.472+0000 7fac5fe00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac60074ee0 0x7fac60101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.472+0000 7fac5fe00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:6800/1242932536,v1:172.21.15.150:6801/1242932536] conn(0x7fac440a3240 0x7fac440a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.472+0000 7fac5fe00640 1 --2- 172.21.15.150:0/34624886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac600745c0 0x7fac60101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:07.474 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.472+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 >> 172.21.15.150:0/34624886 conn(0x7fac600fd740 msgr2=0x7fac600fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:07.476 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.475+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 shutdown_connections 2024-09-15T22:25:07.477 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-15T22:25:07.475+0000 7fac5fe00640 1 -- 172.21.15.150:0/34624886 wait complete. 2024-09-15T22:25:07.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:07 smithi150 ceph-mon[30886]: from='client.? 172.21.15.150:0/34624886' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:07.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:07 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:07.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:07 smithi169 ceph-mon[35850]: from='client.? 172.21.15.150:0/34624886' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:07.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:07 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:07 smithi154 ceph-mon[34853]: from='client.? 172.21.15.150:0/34624886' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:07.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:07 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:25:08.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:25:08.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:25:08.295 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:25:08.325 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T22:25:08.325 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:25:08.361 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:25:08.377 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:25:08.393 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T22:25:08.393 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T22:25:08.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:25:08.709 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:08 smithi169 ceph-mon[35850]: pgmap v748: 65 pgs: 65 active+clean; 577 KiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:25:08.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:08 smithi169 ceph-mon[35850]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:25:08.710 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:08 smithi169 ceph-mon[35850]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:25:08.771 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:08 smithi154 ceph-mon[34853]: pgmap v748: 65 pgs: 65 active+clean; 577 KiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:25:08.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:08 smithi154 ceph-mon[34853]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:25:08.772 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:08 smithi154 ceph-mon[34853]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:25:08.816 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 ceph-mon[30886]: pgmap v748: 65 pgs: 65 active+clean; 577 KiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:25:08.816 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 ceph-mon[30886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:25:08.817 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 ceph-mon[30886]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:25:08.817 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 systemd[1]: Stopping Ceph mon.a for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:09.163 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a[30882]: 2024-09-15T22:25:08.813+0000 7feb5aa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:09.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a[30882]: 2024-09-15T22:25:08.813+0000 7feb5aa00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T22:25:09.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:08 smithi150 podman[93386]: 2024-09-15 22:25:08.855725385 +0000 UTC m=+0.176868435 container died f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:25:09.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:09 smithi150 podman[93386]: 2024-09-15 22:25:09.319343272 +0000 UTC m=+0.640486330 container cleanup f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-15T22:25:09.426 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:09 smithi150 bash[93386]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:25:09.788 INFO:journalctl@ceph.mon.a.smithi150.stdout:Sep 15 22:25:09 smithi150 podman[93398]: 2024-09-15 22:25:09.52099663 +0000 UTC m=+0.658729638 container remove f6d2430797db8715fda7518ad72bc6bf2bdfca1906c29ea1e245325fe0c5b0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-15T22:25:09.812 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T22:25:09.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:09.903 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T22:25:09.903 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T22:25:09.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.b 2024-09-15T22:25:10.271 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:09 smithi154 systemd[1]: Stopping Ceph mon.b for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:10.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b[34849]: 2024-09-15T22:25:10.269+0000 7f7413c64640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:10.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b[34849]: 2024-09-15T22:25:10.269+0000 7f7413c64640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:25:10.604 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:10 smithi154 podman[69442]: 2024-09-15 22:25:10.341152963 +0000 UTC m=+0.181432556 container died 95a0988015cdad3cb89740d83b7a499183866ca27f6431974f5c8843cc10aa7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:25:10.980 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:10 smithi154 podman[69442]: 2024-09-15 22:25:10.685850754 +0000 UTC m=+0.526130334 container cleanup 95a0988015cdad3cb89740d83b7a499183866ca27f6431974f5c8843cc10aa7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:25:10.980 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 15 22:25:10 smithi154 bash[69442]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-b 2024-09-15T22:25:11.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T22:25:11.148 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:11.148 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T22:25:11.149 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T22:25:11.149 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.c 2024-09-15T22:25:11.459 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:11 smithi169 systemd[1]: Stopping Ceph mon.c for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:11.875 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-c[35846]: 2024-09-15T22:25:11.463+0000 7f3e80b8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-c[35846]: 2024-09-15T22:25:11.463+0000 7f3e80b8b640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:25:11.876 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:11 smithi169 podman[71542]: 2024-09-15 22:25:11.536047188 +0000 UTC m=+0.173557494 container died aee14a94e3d1843bac3ef214aa7a97f8c00446bab8c5750d4dfdcfc15bbc8e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:25:12.201 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:11 smithi169 podman[71542]: 2024-09-15 22:25:11.973056057 +0000 UTC m=+0.610566359 container cleanup aee14a94e3d1843bac3ef214aa7a97f8c00446bab8c5750d4dfdcfc15bbc8e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:25:12.201 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:11 smithi169 bash[71542]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-c 2024-09-15T22:25:12.434 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T22:25:12.456 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:12 smithi169 podman[71555]: 2024-09-15 22:25:12.199940341 +0000 UTC m=+0.657313140 container remove aee14a94e3d1843bac3ef214aa7a97f8c00446bab8c5750d4dfdcfc15bbc8e54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T22:25:12.456 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:12 smithi169 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-15T22:25:12.456 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:12 smithi169 systemd[1]: Stopped Ceph mon.c for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:25:12.456 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 15 22:25:12 smithi169 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mon.c.service: Consumed 13.123s CPU time. 2024-09-15T22:25:12.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:12.494 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T22:25:12.495 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T22:25:12.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:25:12.904 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:12 smithi150 systemd[1]: Stopping Ceph mgr.x for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:13.176 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:25:12.901+0000 7ff5e2800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:13.177 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x[31110]: 2024-09-15T22:25:12.901+0000 7ff5e2800640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-15T22:25:13.177 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:12 smithi150 podman[93508]: 2024-09-15 22:25:12.984847816 +0000 UTC m=+0.209655953 container died 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T22:25:13.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:13 smithi150 podman[93508]: 2024-09-15 22:25:13.566191527 +0000 UTC m=+0.790999667 container cleanup 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T22:25:13.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:13 smithi150 bash[93508]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x 2024-09-15T22:25:13.926 INFO:journalctl@ceph.mgr.x.smithi150.stdout:Sep 15 22:25:13 smithi150 podman[93521]: 2024-09-15 22:25:13.767961015 +0000 UTC m=+0.771639881 container remove 975e487d24f191bcda60f11beb15e82787d50730a4e99524fb7a075559bf5b46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:25:14.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T22:25:14.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:14.127 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T22:25:14.128 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T22:25:14.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.y 2024-09-15T22:25:14.446 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:25:14 smithi154 systemd[1]: Stopping Ceph mgr.y for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:14.743 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:25:14 smithi154 podman[69565]: 2024-09-15 22:25:14.445092869 +0000 UTC m=+0.120050358 container died b1940ca9085b1ef6bdf780e40f20a4c5a2a3ef5451ce33000e3080369ffefb04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:25:15.021 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:25:14 smithi154 podman[69565]: 2024-09-15 22:25:14.841212694 +0000 UTC m=+0.516170171 container cleanup b1940ca9085b1ef6bdf780e40f20a4c5a2a3ef5451ce33000e3080369ffefb04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:25:15.021 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 15 22:25:14 smithi154 bash[69565]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-y 2024-09-15T22:25:15.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T22:25:15.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:15.275 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T22:25:15.275 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T22:25:15.275 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.z 2024-09-15T22:25:15.584 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:25:15 smithi169 systemd[1]: Stopping Ceph mgr.z for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:15.872 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:25:15 smithi169 podman[71668]: 2024-09-15 22:25:15.582776251 +0000 UTC m=+0.118307895 container died 373cce3569b1ce1bf581c1b05987ef67d712389c677eea79f5f94a1438b20b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:25:16.209 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:25:15 smithi169 podman[71668]: 2024-09-15 22:25:15.970006474 +0000 UTC m=+0.505538098 container cleanup 373cce3569b1ce1bf581c1b05987ef67d712389c677eea79f5f94a1438b20b6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T22:25:16.210 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 15 22:25:15 smithi169 bash[71668]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mgr-z 2024-09-15T22:25:16.397 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T22:25:16.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:16.432 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T22:25:16.432 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T22:25:16.432 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.0 2024-09-15T22:25:16.676 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:16 smithi150 systemd[1]: Stopping Ceph osd.0 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:17.176 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0[44633]: 2024-09-15T22:25:16.839+0000 7f663be00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:17.176 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0[44633]: 2024-09-15T22:25:16.839+0000 7f663be00640 -1 osd.0 87 *** Got signal Terminated *** 2024-09-15T22:25:17.176 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0[44633]: 2024-09-15T22:25:16.839+0000 7f663be00640 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:25:22.733 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:22 smithi150 podman[93630]: 2024-09-15 22:25:22.442806845 +0000 UTC m=+5.725233896 container died d0f74982009de288eef29d42ae33e077551f3b3de9e02b5d368d8cf728b7cfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:25:23.106 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:22 smithi150 podman[93630]: 2024-09-15 22:25:22.845305321 +0000 UTC m=+6.127732381 container cleanup d0f74982009de288eef29d42ae33e077551f3b3de9e02b5d368d8cf728b7cfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-15T22:25:23.106 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:22 smithi150 bash[93630]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0 2024-09-15T22:25:23.426 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:23 smithi150 podman[93648]: 2024-09-15 22:25:23.105175522 +0000 UTC m=+0.653139009 container remove d0f74982009de288eef29d42ae33e077551f3b3de9e02b5d368d8cf728b7cfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T22:25:23.843 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:23 smithi150 podman[93735]: 2024-09-15 22:25:23.564283968 +0000 UTC m=+0.114629958 container create f2cf0f0ab925cbf755267964d2208034430cba8970be438ca606057d9eac2b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-15T22:25:23.843 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:23 smithi150 podman[93735]: 2024-09-15 22:25:23.476995639 +0000 UTC m=+0.027341640 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:25:23.843 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:23 smithi150 podman[93735]: 2024-09-15 22:25:23.842151751 +0000 UTC m=+0.392497744 container init f2cf0f0ab925cbf755267964d2208034430cba8970be438ca606057d9eac2b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:25:24.111 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:23 smithi150 podman[93735]: 2024-09-15 22:25:23.84938707 +0000 UTC m=+0.399733061 container start f2cf0f0ab925cbf755267964d2208034430cba8970be438ca606057d9eac2b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e) 2024-09-15T22:25:24.111 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:23 smithi150 podman[93735]: 2024-09-15 22:25:23.933380079 +0000 UTC m=+0.483726084 container attach f2cf0f0ab925cbf755267964d2208034430cba8970be438ca606057d9eac2b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T22:25:24.426 INFO:journalctl@ceph.osd.0.smithi150.stdout:Sep 15 22:25:24 smithi150 podman[93735]: 2024-09-15 22:25:24.110678507 +0000 UTC m=+0.661024513 container died f2cf0f0ab925cbf755267964d2208034430cba8970be438ca606057d9eac2b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-15T22:25:24.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T22:25:24.849 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:24.850 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T22:25:24.850 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T22:25:24.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.1 2024-09-15T22:25:25.163 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:24 smithi154 systemd[1]: Stopping Ceph osd.1 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:25.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1[39352]: 2024-09-15T22:25:25.161+0000 7ff293199640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:25.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1[39352]: 2024-09-15T22:25:25.161+0000 7ff293199640 -1 osd.1 87 *** Got signal Terminated *** 2024-09-15T22:25:25.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1[39352]: 2024-09-15T22:25:25.161+0000 7ff293199640 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:25:31.014 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:30 smithi154 podman[69688]: 2024-09-15 22:25:30.732074521 +0000 UTC m=+5.689512206 container died 899a815b63d8d44c3a89cb2734534ac3dcc76dee178437d78f0e5775697dfcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:25:31.271 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 podman[69688]: 2024-09-15 22:25:31.086622371 +0000 UTC m=+6.044060048 container cleanup 899a815b63d8d44c3a89cb2734534ac3dcc76dee178437d78f0e5775697dfcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:25:31.272 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 bash[69688]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1 2024-09-15T22:25:31.698 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 podman[69702]: 2024-09-15 22:25:31.387945453 +0000 UTC m=+0.653678191 container remove 899a815b63d8d44c3a89cb2734534ac3dcc76dee178437d78f0e5775697dfcc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:25:31.950 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 podman[69792]: 2024-09-15 22:25:31.600183043 +0000 UTC m=+0.015641225 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:25:31.950 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 podman[69792]: 2024-09-15 22:25:31.722110316 +0000 UTC m=+0.137568488 container create 741fad3fcbcc4cdb44547046e1ed9ad2bfd444acc7fb6434ed7e9c9bbbd1cc0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-15T22:25:31.951 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 podman[69792]: 2024-09-15 22:25:31.949534645 +0000 UTC m=+0.364992817 container init 741fad3fcbcc4cdb44547046e1ed9ad2bfd444acc7fb6434ed7e9c9bbbd1cc0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-15T22:25:32.251 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:31 smithi154 podman[69792]: 2024-09-15 22:25:31.95326917 +0000 UTC m=+0.368727343 container start 741fad3fcbcc4cdb44547046e1ed9ad2bfd444acc7fb6434ed7e9c9bbbd1cc0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T22:25:32.251 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:32 smithi154 podman[69792]: 2024-09-15 22:25:32.049655329 +0000 UTC m=+0.465113547 container attach 741fad3fcbcc4cdb44547046e1ed9ad2bfd444acc7fb6434ed7e9c9bbbd1cc0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:25:32.521 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 15 22:25:32 smithi154 podman[69792]: 2024-09-15 22:25:32.251170165 +0000 UTC m=+0.666628352 container died 741fad3fcbcc4cdb44547046e1ed9ad2bfd444acc7fb6434ed7e9c9bbbd1cc0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:25:32.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T22:25:32.909 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:32.909 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T22:25:32.909 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T22:25:32.909 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.2 2024-09-15T22:25:33.201 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:32 smithi169 systemd[1]: Stopping Ceph osd.2 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:33.454 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2[40857]: 2024-09-15T22:25:33.199+0000 7fe6da91e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:33.455 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2[40857]: 2024-09-15T22:25:33.199+0000 7fe6da91e640 -1 osd.2 87 *** Got signal Terminated *** 2024-09-15T22:25:33.455 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2[40857]: 2024-09-15T22:25:33.199+0000 7fe6da91e640 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:25:39.018 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:38 smithi169 podman[71792]: 2024-09-15 22:25:38.740568201 +0000 UTC m=+5.634563352 container died d0eeb5bbf8df28d78d7353e83e95877152c27fb743df29ba962c491bf6a3587c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:25:39.359 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 podman[71792]: 2024-09-15 22:25:39.115520945 +0000 UTC m=+6.009516094 container cleanup d0eeb5bbf8df28d78d7353e83e95877152c27fb743df29ba962c491bf6a3587c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T22:25:39.359 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 bash[71792]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2 2024-09-15T22:25:39.688 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 podman[71818]: 2024-09-15 22:25:39.35831808 +0000 UTC m=+0.613779824 container remove d0eeb5bbf8df28d78d7353e83e95877152c27fb743df29ba962c491bf6a3587c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-15T22:25:39.959 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 podman[71905]: 2024-09-15 22:25:39.590464386 +0000 UTC m=+0.015547530 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:25:39.960 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 podman[71905]: 2024-09-15 22:25:39.700885669 +0000 UTC m=+0.125968844 container create bed59e944ca9362a675f6c3ad498baf1f5b81dd6ff1ff0e26a6acd53923dff20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:25:40.230 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 podman[71905]: 2024-09-15 22:25:39.979174664 +0000 UTC m=+0.404257807 container init bed59e944ca9362a675f6c3ad498baf1f5b81dd6ff1ff0e26a6acd53923dff20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T22:25:40.230 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:39 smithi169 podman[71905]: 2024-09-15 22:25:39.982603577 +0000 UTC m=+0.407686712 container start bed59e944ca9362a675f6c3ad498baf1f5b81dd6ff1ff0e26a6acd53923dff20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e) 2024-09-15T22:25:40.230 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:40 smithi169 podman[71905]: 2024-09-15 22:25:40.054136515 +0000 UTC m=+0.479219658 container attach bed59e944ca9362a675f6c3ad498baf1f5b81dd6ff1ff0e26a6acd53923dff20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:25:40.625 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 15 22:25:40 smithi169 podman[71905]: 2024-09-15 22:25:40.229083304 +0000 UTC m=+0.654166439 container died bed59e944ca9362a675f6c3ad498baf1f5b81dd6ff1ff0e26a6acd53923dff20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-15T22:25:40.950 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T22:25:40.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:40.995 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T22:25:40.995 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T22:25:40.996 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.3 2024-09-15T22:25:41.426 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:41 smithi150 systemd[1]: Stopping Ceph osd.3 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:41.926 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:25:41.433+0000 7f318ce00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:41.926 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:25:41.433+0000 7f318ce00640 -1 osd.3 87 *** Got signal Terminated *** 2024-09-15T22:25:41.926 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:41 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:25:41.433+0000 7f318ce00640 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:25:43.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:43 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:43.627+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:44.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:44 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:44.645+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:45.209 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:44.753+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:45.926 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:45 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-15T22:25:45.626+0000 7f3183800640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.664821+0000 front 2024-09-15T22:25:20.664790+0000 (oldest deadline 2024-09-15T22:25:45.364953+0000) 2024-09-15T22:25:45.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:45 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:45.612+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:46.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:45 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:45.726+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:46.210 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:45.718+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:46.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:45.951+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:46.676 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:46 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:46.573+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:46.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:46.707+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:46.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:46.916+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:47.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:46 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:46.703+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:47.375 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:47 smithi150 podman[93856]: 2024-09-15 22:25:47.116139275 +0000 UTC m=+5.825863306 container died 1208ace4fd0a55ec90fa28e03bcf5cc09a197a05f0faae16db2b00c517fdb4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:25:47.676 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:47 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:47.555+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:47.676 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:47 smithi150 podman[93856]: 2024-09-15 22:25:47.506588284 +0000 UTC m=+6.216312321 container cleanup 1208ace4fd0a55ec90fa28e03bcf5cc09a197a05f0faae16db2b00c517fdb4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T22:25:47.676 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:47 smithi150 bash[93856]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3 2024-09-15T22:25:47.953 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:47.687+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:47.958 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:47 smithi150 podman[93873]: 2024-09-15 22:25:47.696192032 +0000 UTC m=+0.568269264 container remove 1208ace4fd0a55ec90fa28e03bcf5cc09a197a05f0faae16db2b00c517fdb4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T22:25:48.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:47 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:47.698+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:48.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:47.952+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:48.243 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:47 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:47.956+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:48.528 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:48 smithi150 podman[93957]: 2024-09-15 22:25:48.146736409 +0000 UTC m=+0.026413259 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:25:48.529 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:48 smithi150 podman[93957]: 2024-09-15 22:25:48.250289667 +0000 UTC m=+0.129966518 container create 3886322b2e6777deace14440df7ac0f620aa08d7f0eff899a6541f5c3d9ade60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-15T22:25:48.793 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:48 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:48.547+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:48.793 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:48 smithi150 podman[93957]: 2024-09-15 22:25:48.527689677 +0000 UTC m=+0.407366528 container init 3886322b2e6777deace14440df7ac0f620aa08d7f0eff899a6541f5c3d9ade60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T22:25:48.793 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:48 smithi150 podman[93957]: 2024-09-15 22:25:48.535077731 +0000 UTC m=+0.414754583 container start 3886322b2e6777deace14440df7ac0f620aa08d7f0eff899a6541f5c3d9ade60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T22:25:48.793 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:48 smithi150 podman[93957]: 2024-09-15 22:25:48.648881071 +0000 UTC m=+0.528557923 container attach 3886322b2e6777deace14440df7ac0f620aa08d7f0eff899a6541f5c3d9ade60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T22:25:48.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:48.664+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:48.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:48.914+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:49.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:48 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:48.667+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:49.114 INFO:journalctl@ceph.osd.3.smithi150.stdout:Sep 15 22:25:48 smithi150 podman[93957]: 2024-09-15 22:25:48.792160625 +0000 UTC m=+0.671837484 container died 3886322b2e6777deace14440df7ac0f620aa08d7f0eff899a6541f5c3d9ade60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:25:49.115 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:48 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:48.996+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:49.448 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T22:25:49.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:49.525 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T22:25:49.526 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T22:25:49.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.4 2024-09-15T22:25:49.676 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:49 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:49.524+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:49.823 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:49 smithi154 systemd[1]: Stopping Ceph osd.4 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:49.824 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:49.688+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:49.928 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:49.618+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:50.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:49.927+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:50.271 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:49.821+0000 7fa644291640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:50.271 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:49.821+0000 7fa644291640 -1 osd.4 87 *** Got signal Terminated *** 2024-09-15T22:25:50.271 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:49 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:49.821+0000 7fa644291640 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:25:50.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:49 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:49.949+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:50.886 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:50.629+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:50.921 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:50 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:50.515+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:51.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:50 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:50.694+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:51.176 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:50 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:50.920+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:51.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:50.885+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:51.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:50.885+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:51.881 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:51 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:51.548+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:51.923 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:51 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:51.669+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:52.021 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:51 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:51.554+0000 7fa63c88e640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.611410+0000 front 2024-09-15T22:25:27.611455+0000 (oldest deadline 2024-09-15T22:25:51.111658+0000) 2024-09-15T22:25:52.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:51 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:51.721+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:52.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:51 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:51.721+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:52.176 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:51 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:51.879+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:52.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:51 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:51.922+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:52.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:51 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:51.922+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:52.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:52 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:52.578+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:52.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:52 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:52.699+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:52.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:52 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:52.916+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:52.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:52 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:52.916+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:53.021 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:52 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:52.574+0000 7fa63c88e640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.611410+0000 front 2024-09-15T22:25:27.611455+0000 (oldest deadline 2024-09-15T22:25:51.111658+0000) 2024-09-15T22:25:53.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:52 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:52.549+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:53.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:52 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:52.678+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:53.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:52 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:52.678+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:53.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:52 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:52.926+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:53.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:53 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:53.551+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:53.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:53 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:53.707+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:53.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:53 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:53.943+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:53.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:53 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:53.943+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:54.021 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:53 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:53.572+0000 7fa63c88e640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.611410+0000 front 2024-09-15T22:25:27.611455+0000 (oldest deadline 2024-09-15T22:25:51.111658+0000) 2024-09-15T22:25:54.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:53 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:53.558+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:54.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:53 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:53.678+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:54.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:53 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:53.678+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:54.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:53 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:53.952+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:54.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:53 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:53.952+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:25:54.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:54 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:54.529+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:54.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:54 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:54.529+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:25:54.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:54 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:54.564+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:25:54.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:54 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:54.660+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:54.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:54 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:54.660+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:25:55.021 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:54 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4[45844]: 2024-09-15T22:25:54.535+0000 7fa63c88e640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.611410+0000 front 2024-09-15T22:25:27.611455+0000 (oldest deadline 2024-09-15T22:25:51.111658+0000) 2024-09-15T22:25:55.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:54 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:54.587+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:55.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:54 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:54.689+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:55.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:54 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:54.689+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:55.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:55 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:55.002+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:55.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:55 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:55.002+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:25:55.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:54 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:54.978+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:55.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:54 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:54.978+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:55.521 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:55 smithi154 podman[69912]: 2024-09-15 22:25:55.239050204 +0000 UTC m=+5.514581173 container died b7275eb9cf4a82cd29c6920df55586bd7af7e22aedf6104660b414d4a420426a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-15T22:25:55.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:55 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:55.538+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:55.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:55 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:55.538+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:25:55.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:55 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:55.551+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:25:55.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:55 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:55.643+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:55.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:55 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:55.643+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:25:56.016 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:55 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:55.602+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:56.017 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:55 smithi154 podman[69912]: 2024-09-15 22:25:55.696948022 +0000 UTC m=+5.972478980 container cleanup b7275eb9cf4a82cd29c6920df55586bd7af7e22aedf6104660b414d4a420426a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T22:25:56.017 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:55 smithi154 bash[69912]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4 2024-09-15T22:25:56.017 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:55 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:55.688+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:56.017 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:55 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:55.688+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:56.272 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[69926]: 2024-09-15 22:25:56.015445914 +0000 UTC m=+0.773085928 container remove b7275eb9cf4a82cd29c6920df55586bd7af7e22aedf6104660b414d4a420426a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T22:25:56.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:56 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:56.007+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:56.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:56 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:56.007+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:25:56.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:55 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:55.968+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:56.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:55 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:55.968+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:56.661 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:56 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:56.592+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:56.661 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[70018]: 2024-09-15 22:25:56.26371818 +0000 UTC m=+0.015909019 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:25:56.662 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[70018]: 2024-09-15 22:25:56.366280272 +0000 UTC m=+0.118471103 container create ab1306dfd95933ee9189ddcbe303473ecac2f605fa42217ee545ab6dbed1e42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:25:56.662 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[70018]: 2024-09-15 22:25:56.568741682 +0000 UTC m=+0.320932516 container init ab1306dfd95933ee9189ddcbe303473ecac2f605fa42217ee545ab6dbed1e42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:25:56.662 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[70018]: 2024-09-15 22:25:56.572177477 +0000 UTC m=+0.324368315 container start ab1306dfd95933ee9189ddcbe303473ecac2f605fa42217ee545ab6dbed1e42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:25:56.662 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[70018]: 2024-09-15 22:25:56.660234508 +0000 UTC m=+0.412425335 container attach ab1306dfd95933ee9189ddcbe303473ecac2f605fa42217ee545ab6dbed1e42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T22:25:56.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:56 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:56.520+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:56.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:56 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:56.520+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:25:56.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:56 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:56.583+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:25:56.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:56 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:56.630+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:56.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:56 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:56.630+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:25:57.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:56 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:56.661+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:57.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:56 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:56.661+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:57.022 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:56 smithi154 podman[70018]: 2024-09-15 22:25:56.764189681 +0000 UTC m=+0.516380519 container died ab1306dfd95933ee9189ddcbe303473ecac2f605fa42217ee545ab6dbed1e42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T22:25:57.330 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 15 22:25:57 smithi154 podman[70041]: 2024-09-15 22:25:57.305500868 +0000 UTC m=+0.533994242 container remove ab1306dfd95933ee9189ddcbe303473ecac2f605fa42217ee545ab6dbed1e42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:25:57.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T22:25:57.376 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:25:57.376 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T22:25:57.376 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T22:25:57.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.5 2024-09-15T22:25:57.404 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:57.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:57.404 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:57.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:57.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:57 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:57.036+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:57.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:57 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:57.036+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:25:57.686 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:57 smithi169 systemd[1]: Stopping Ceph osd.5 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:25:57.687 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:57.625+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:57.687 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:57.625+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:25:57.687 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:57.683+0000 7fa908ce3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:25:57.687 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:57.683+0000 7fa908ce3640 -1 osd.5 87 *** Got signal Terminated *** 2024-09-15T22:25:57.687 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:57.683+0000 7fa908ce3640 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:25:57.687 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:57 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:57.587+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:25:57.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:57 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:57.553+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:57.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:57 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:57.553+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:25:58.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:57 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:57.623+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:58.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:57 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:57.689+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:58.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:57 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:57.689+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:58.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:58 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:58.071+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:58.427 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:58 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:58.071+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:25:58.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:58 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:58.025+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:58.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:58 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:58.025+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:58.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:58 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:58.584+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:58.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:58 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:58.584+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:25:58.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:58 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:58.675+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:58.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:58 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:58.675+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:25:58.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:58 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:58.556+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:25:59.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:58 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:58.585+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:25:59.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:58 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:58.676+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:25:59.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:58 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:58.676+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:25:59.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:59.040+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:25:59.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:25:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:25:59.040+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:25:59.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:59.021+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:25:59.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:25:59.021+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:25:59.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:59.556+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:25:59.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:59.556+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:25:59.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:25:59 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:25:59.556+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:25:59.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:59.522+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:25:59.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:25:59.522+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:25:59.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:59.648+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:25:59.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:59.648+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:25:59.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:25:59 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:25:59.648+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:36.528261+0000 front 2024-09-15T22:25:36.528297+0000 (oldest deadline 2024-09-15T22:25:58.828449+0000) 2024-09-15T22:26:00.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:25:59 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:25:59.603+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:00.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:59 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:59.723+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:00.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:25:59 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:25:59.723+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:00.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:00.078+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:00.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:00.078+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:00.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:00.056+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:00.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:00.056+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:00.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:00.535+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:00.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:00.535+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:00.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:00 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:00.535+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:00.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:26:00.640+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:26:00.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:26:00.640+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:26:00.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:26:00.640+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:36.528261+0000 front 2024-09-15T22:25:36.528297+0000 (oldest deadline 2024-09-15T22:25:58.828449+0000) 2024-09-15T22:26:00.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:00.566+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:00.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:00 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:00.566+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:01.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:00 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:00.602+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:01.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:00 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:00.741+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:01.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:00 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:00.741+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:01.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:01.065+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:01.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:01.065+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:01.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:01.034+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:01.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:01.034+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:01.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:01.034+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:01.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:01.555+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:01.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:01.555+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:01.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:01 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:01.555+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:01.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:01.564+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:01.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:01.564+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:01.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:26:01.687+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:17.225850+0000 front 2024-09-15T22:25:17.225988+0000 (oldest deadline 2024-09-15T22:25:44.226462+0000) 2024-09-15T22:26:01.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:26:01.687+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.927499+0000 front 2024-09-15T22:25:28.927608+0000 (oldest deadline 2024-09-15T22:25:54.227379+0000) 2024-09-15T22:26:01.960 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:01 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5[47793]: 2024-09-15T22:26:01.687+0000 7fa9012e0640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:36.528261+0000 front 2024-09-15T22:25:36.528297+0000 (oldest deadline 2024-09-15T22:25:58.828449+0000) 2024-09-15T22:26:02.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:01.639+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:02.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:01.784+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:02.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:01.784+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:02.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:01 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:01.784+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:02.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:02.019+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:02.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:02.019+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:02.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:02.019+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:02.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:02 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:02.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:02.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:02 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:02.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:02.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:02 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:02.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:02.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:02.576+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:02.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:02.576+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:02.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:02.576+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:02.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:02 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:02.577+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:02.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:02 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:02.577+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:03.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:02 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:02.592+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:03.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:02 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:02.798+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:03.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:02 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:02.798+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:03.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:02 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:02.798+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:03.354 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:03 smithi169 podman[72007]: 2024-09-15 22:26:03.067679311 +0000 UTC m=+5.493159599 container died 9e7bce783e85f24fb9dac2b1f3e8b3a6f1e1a739dcd74928c07c99298175d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-15T22:26:03.355 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:03.032+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:03.355 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:03.032+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:03.355 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:03.032+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:03.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:03.032+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:03.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:03.032+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:03.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:03.032+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:03.696 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:03 smithi169 podman[72007]: 2024-09-15 22:26:03.477165395 +0000 UTC m=+5.902645674 container cleanup 9e7bce783e85f24fb9dac2b1f3e8b3a6f1e1a739dcd74928c07c99298175d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T22:26:03.696 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:03 smithi169 bash[72007]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5 2024-09-15T22:26:03.697 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:03.557+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:03.697 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:03 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:03.557+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:03.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:03.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:03.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:03.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:03.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:03 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:03.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:03.959 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:03 smithi169 podman[72023]: 2024-09-15 22:26:03.695035464 +0000 UTC m=+0.629164254 container remove 9e7bce783e85f24fb9dac2b1f3e8b3a6f1e1a739dcd74928c07c99298175d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:26:04.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:03 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:03.605+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:04.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:03 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:03.605+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:04.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:03 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:03.839+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:04.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:03 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:03.839+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:04.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:03 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:03.839+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:04.316 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:04.005+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:04.316 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:04.005+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:04.316 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:04.005+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:04.316 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:04 smithi169 podman[72111]: 2024-09-15 22:26:04.104152515 +0000 UTC m=+0.113608501 container create 9610a9fd7f8c73e345afda655dd4228cecc0bf6b514357ce8a62092c07a2d87c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-15T22:26:04.316 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:04 smithi169 podman[72111]: 2024-09-15 22:26:04.00721165 +0000 UTC m=+0.016667597 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:04.316 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:04 smithi169 podman[72111]: 2024-09-15 22:26:04.314875385 +0000 UTC m=+0.324331326 container init 9610a9fd7f8c73e345afda655dd4228cecc0bf6b514357ce8a62092c07a2d87c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-15T22:26:04.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:04.032+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:04.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:04.032+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:04.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:04.032+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:04.710 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:04.560+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:04.710 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:04.560+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:04.710 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:04 smithi169 podman[72111]: 2024-09-15 22:26:04.318403062 +0000 UTC m=+0.327859005 container start 9610a9fd7f8c73e345afda655dd4228cecc0bf6b514357ce8a62092c07a2d87c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:26:04.710 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:04 smithi169 podman[72111]: 2024-09-15 22:26:04.398203286 +0000 UTC m=+0.407659231 container attach 9610a9fd7f8c73e345afda655dd4228cecc0bf6b514357ce8a62092c07a2d87c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:26:04.710 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 15 22:26:04 smithi169 podman[72111]: 2024-09-15 22:26:04.506246718 +0000 UTC m=+0.515702664 container died 9610a9fd7f8c73e345afda655dd4228cecc0bf6b514357ce8a62092c07a2d87c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:26:04.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:04.669+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:04.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:04.669+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:04.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:04 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:04.669+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:05.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:04 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:04.598+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:05.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:04 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:04.598+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:05.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:04 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:04.793+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:05.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:04 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:04.793+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:05.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:04 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:04.793+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:05.086 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:04.982+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:05.086 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:04.982+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:05.086 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:04 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:04.982+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:05.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T22:26:05.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:05.189 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T22:26:05.189 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T22:26:05.190 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.6 2024-09-15T22:26:05.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.027+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:05.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.027+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:05.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.027+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:05.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 systemd[1]: Stopping Ceph osd.6 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:05.710 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:05 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:05.546+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:05.710 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:05 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:05.546+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:05.716 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.578+0000 7fea4ec00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:05.716 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.578+0000 7fea4ec00640 -1 osd.6 87 *** Got signal Terminated *** 2024-09-15T22:26:05.717 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.578+0000 7fea4ec00640 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:26:05.996 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:05.714+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:05.996 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:05.714+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:05.996 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:05.714+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:06.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:05 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:05.634+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:06.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:05 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:05.634+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:06.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:05 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:05.774+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:06.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:05 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:05.774+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:06.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:05 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:05.774+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:06.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:05 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:05.944+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:06.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:05 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:05.944+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:06.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:05 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:05.944+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:06.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.994+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:06.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.994+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:06.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:05 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:05.994+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:06.712 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:06 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:06.550+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:06.712 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:06 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:06.550+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:06.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:06 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:06.673+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:06.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:06 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:06.673+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:06.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:06 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:06.673+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:07.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:06 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:06.647+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:07.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:06 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:06.647+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:07.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:06 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:06.736+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:07.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:06 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:06.736+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:07.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:06 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:06.736+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:07.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:06 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:06.900+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:07.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:06 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:06.900+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:07.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:06 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:06.900+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:07.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:06 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:06.973+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:07.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:06 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:06.973+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:07.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:06 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:06.973+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:07.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:07.657+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:07.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:07.657+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:07.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:07.657+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:07.931 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:07 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:07.542+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:07.931 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:07 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:07.542+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:08.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:07 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:07.686+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:08.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:07 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:07.686+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:08.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:07 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:07.729+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:08.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:07 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:07.729+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:08.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:07 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:07.729+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:08.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:07 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:07.929+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:08.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:07 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:07.929+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:08.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:07 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:07.929+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:08.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:07.988+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:08.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:07.988+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:08.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:07.988+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:08.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:08.658+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:08.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:08.658+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:08.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:08.658+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:08.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:08.658+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:08.929 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:08 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:08.553+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:08.930 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:08 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:08.553+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:09.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:08 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:08.731+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:09.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:08 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:08.731+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:09.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:08 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:08.745+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:09.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:08 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:08.745+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:09.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:08 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:08.745+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:09.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:08 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:08.928+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:09.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:08 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:08.928+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:09.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:08 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:08.928+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:09.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:08.942+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:09.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:08.942+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:09.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:08.942+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:09.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:08 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:08.942+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:41.802427+0000 front 2024-09-15T22:25:41.802444+0000 (oldest deadline 2024-09-15T22:26:08.203162+0000) 2024-09-15T22:26:09.887 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:09 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:09.570+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:09.887 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:09 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:09.570+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:09.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:09.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:09.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:09.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:09.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:09.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:09.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:09.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:10.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:09.687+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:10.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:09.687+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:10.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:09.746+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:10.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:09.746+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:10.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:09 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:09.746+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:10.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:09 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:09.885+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:10.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:09 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:09.885+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:10.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:09 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:09.885+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:10.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:09.990+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:16.499280+0000 front 2024-09-15T22:25:16.498944+0000 (oldest deadline 2024-09-15T22:25:47.700149+0000) 2024-09-15T22:26:10.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:09.990+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.700876+0000 front 2024-09-15T22:25:27.700757+0000 (oldest deadline 2024-09-15T22:25:53.600884+0000) 2024-09-15T22:26:10.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:09.990+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.701858+0000 front 2024-09-15T22:25:37.702017+0000 (oldest deadline 2024-09-15T22:26:01.801911+0000) 2024-09-15T22:26:10.426 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:09 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6[58590]: 2024-09-15T22:26:09.990+0000 7fea4a600640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:41.802427+0000 front 2024-09-15T22:25:41.802444+0000 (oldest deadline 2024-09-15T22:26:08.203162+0000) 2024-09-15T22:26:10.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:10.623+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:10.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:10.623+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:10.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:10.623+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:10.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:10 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:10.623+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:10.927 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:10 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:10.612+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:10.927 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:10 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:10.612+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:11.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:10.726+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:11.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:10.726+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:11.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:10.703+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:11.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:10.703+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:11.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:10.703+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:11.212 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:10 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:10.926+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:11.212 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:10 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:10.926+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:11.212 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:10 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:10.926+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:11.469 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:11 smithi150 podman[94058]: 2024-09-15 22:26:11.203445093 +0000 UTC m=+5.732265068 container died 5370f66844439c73db86a40aa822a8b4daaed77b0aaf6d6ff05b852b7656a0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T22:26:11.760 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:11 smithi150 podman[94058]: 2024-09-15 22:26:11.575268387 +0000 UTC m=+6.104088362 container cleanup 5370f66844439c73db86a40aa822a8b4daaed77b0aaf6d6ff05b852b7656a0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T22:26:11.761 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:11 smithi150 bash[94058]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6 2024-09-15T22:26:11.761 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:11.643+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:11.761 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:11.643+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:11.761 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:11.643+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:11.761 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:11 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:11.643+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:11.925 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:11.570+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:11.925 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:11.570+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:11.926 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:11.570+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:12.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:11 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:11.701+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:12.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:11 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:11.701+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:12.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:11 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:11.693+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:12.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:11 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:11.693+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:12.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:11 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:11.693+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:12.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:11 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:11.693+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:12.176 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:11 smithi150 podman[94087]: 2024-09-15 22:26:11.759553679 +0000 UTC m=+0.542078500 container remove 5370f66844439c73db86a40aa822a8b4daaed77b0aaf6d6ff05b852b7656a0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:26:12.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:11.923+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:12.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:11.923+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:12.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:11 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:11.923+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:12.644 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:12 smithi150 podman[94172]: 2024-09-15 22:26:12.241040166 +0000 UTC m=+0.027699562 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:12.644 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:12 smithi150 podman[94172]: 2024-09-15 22:26:12.360726955 +0000 UTC m=+0.147386351 container create 3a722dd02fa044fe2591a31e361dbf88618c01f67a8e57ce6800d4f4267782b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-15T22:26:12.645 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:12 smithi150 podman[94172]: 2024-09-15 22:26:12.579742979 +0000 UTC m=+0.366402401 container init 3a722dd02fa044fe2591a31e361dbf88618c01f67a8e57ce6800d4f4267782b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:26:12.645 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:12 smithi150 podman[94172]: 2024-09-15 22:26:12.586444744 +0000 UTC m=+0.373104144 container start 3a722dd02fa044fe2591a31e361dbf88618c01f67a8e57ce6800d4f4267782b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T22:26:12.906 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:12.553+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:12.906 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:12.553+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:12.906 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:12.553+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:12.926 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:12 smithi150 podman[94172]: 2024-09-15 22:26:12.699988712 +0000 UTC m=+0.486648124 container attach 3a722dd02fa044fe2591a31e361dbf88618c01f67a8e57ce6800d4f4267782b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:26:12.926 INFO:journalctl@ceph.osd.6.smithi150.stdout:Sep 15 22:26:12 smithi150 podman[94172]: 2024-09-15 22:26:12.857985376 +0000 UTC m=+0.644644777 container died 3a722dd02fa044fe2591a31e361dbf88618c01f67a8e57ce6800d4f4267782b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:26:12.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:12.639+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:12.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:12.639+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:12.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:12.639+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:12.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:12 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:12.639+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:13.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:12.691+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:13.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:12.691+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:13.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:12.691+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:13.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:12.723+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:13.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:12.723+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:13.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:12.723+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:13.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:12 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:12.723+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:13.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:12.904+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:13.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:12.904+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:13.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:12 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:12.904+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:13.502 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T22:26:13.578 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:13.579 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T22:26:13.579 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T22:26:13.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.7 2024-09-15T22:26:13.884 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:13.718+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:13.884 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:13.718+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:13.884 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:13.718+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:13.884 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:13.718+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:13.884 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 systemd[1]: Stopping Ceph osd.7 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:13.885 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:13.660+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:13.885 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:13.660+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:13.885 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:13.660+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:13.917 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:13 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:13.574+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:13.917 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:13 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:13.574+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:13.917 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:13 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:13.574+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:13.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:13 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:13.637+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:13.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:13 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:13.637+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:13.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:13 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:13.637+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:13.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:13 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:13.637+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:14.145 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:13.882+0000 7f88843bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:14.146 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:13.882+0000 7f88843bf640 -1 osd.7 87 *** Got signal Terminated *** 2024-09-15T22:26:14.146 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:13 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:13.882+0000 7f88843bf640 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:26:14.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:13 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:13.916+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:14.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:13 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:13.916+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:14.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:13 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:13.916+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:14.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:14.588+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:14.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:14.588+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:14.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:14.588+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:14.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:14 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:14.588+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:14.939 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:14 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:14.594+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:14.939 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:14 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:14.594+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:14.939 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:14 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:14.594+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:15.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:14.737+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:15.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:14.737+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:15.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:14.737+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:15.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:14.737+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:15.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:14.680+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:15.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:14.680+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:15.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:14.680+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:15.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:14 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:14.938+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:15.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:14 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:14.938+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:15.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:14 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:14.938+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:15.915 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:15.630+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:15.915 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:15.630+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:15.915 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:15.630+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:15.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:15.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:15.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:15.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:15.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:15.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:15.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:15 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:15.619+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:16.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:15.721+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:15.721+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:15.721+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:15.749+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:15.749+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:15.749+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:15.749+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:16.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:15 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:15.749+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:16.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:15.913+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:16.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:15.913+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:16.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:15.913+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:16.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:15 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:15.913+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:16.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:16.610+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:16.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:16.610+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:16.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:16.610+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:16.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:16 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:16.610+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:16.934 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:16.663+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:16.934 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:16.663+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:16.935 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:16.663+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:17.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:16.682+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:17.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:16.682+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:17.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:16.682+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:17.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:16.705+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:17.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:16.705+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:17.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:16.705+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:17.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:16.705+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:17.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:16 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:16.705+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:17.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:16.933+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:17.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:16.933+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:17.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:16.933+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:17.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:16 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:16.933+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:17.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:17 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:17.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:17.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:17 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:17.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:17.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:17 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:17.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:17.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:17 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:17.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:17.942 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:17.687+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:17.942 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:17.687+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:17.942 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:17.687+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:18.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:17.683+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:18.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:17.683+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:17.683+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:17.683+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:51.969359+0000 front 2024-09-15T22:25:51.969440+0000 (oldest deadline 2024-09-15T22:26:17.269482+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:17.685+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:17.685+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:17.685+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:17.685+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:18.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:17 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:17.685+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:18.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:17.940+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:18.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:17.940+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:18.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:17.940+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:18.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:17 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:17.940+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:18.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:18.617+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:18.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:18.617+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:18.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:18.617+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:18.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:18 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:18.617+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:18.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:18.645+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:18.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:18.645+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:18.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:18.645+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:19.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:18.724+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:28.466812+0000 front 2024-09-15T22:25:28.466904+0000 (oldest deadline 2024-09-15T22:25:51.966933+0000) 2024-09-15T22:26:19.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:18.724+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.267905+0000 front 2024-09-15T22:25:37.267921+0000 (oldest deadline 2024-09-15T22:26:03.167941+0000) 2024-09-15T22:26:19.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:18.724+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:46.069310+0000 front 2024-09-15T22:25:46.069273+0000 (oldest deadline 2024-09-15T22:26:11.969067+0000) 2024-09-15T22:26:19.022 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7[52410]: 2024-09-15T22:26:18.724+0000 7f887c9bc640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:51.969359+0000 front 2024-09-15T22:25:51.969440+0000 (oldest deadline 2024-09-15T22:26:17.269482+0000) 2024-09-15T22:26:19.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:18.653+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:19.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:18.653+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:19.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:18.653+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:19.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:18.653+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:19.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:18.653+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:19.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:18.985+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:19.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:18.985+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:19.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:18.985+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:19.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:18 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:18.985+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:19.659 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:19 smithi154 podman[70123]: 2024-09-15 22:26:19.389486981 +0000 UTC m=+5.615583932 container died d6367dc968aa2b259f6bac5a6795bb0f8c98f0f7f3adffdeb600eaad79161785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-15T22:26:19.659 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:19 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:19.611+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:19.660 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:19 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:19.611+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:19.660 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:19 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:19.611+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:19.660 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:19 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:19.611+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:19.660 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:19 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:19.611+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:19.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:19 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:19.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:19.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:19 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:19.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:19.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:19 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:19.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:19.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:19 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:19.603+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:19.958 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:19.602+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:19.958 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:19.602+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:19.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:19.602+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:19.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:19.602+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:20.009 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:19 smithi154 podman[70123]: 2024-09-15 22:26:19.749008258 +0000 UTC m=+5.975105208 container cleanup d6367dc968aa2b259f6bac5a6795bb0f8c98f0f7f3adffdeb600eaad79161785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-15T22:26:20.009 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:19 smithi154 bash[70123]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7 2024-09-15T22:26:20.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:19.957+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:20.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:19.957+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:20.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:19.957+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:20.211 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:19 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:19.957+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:20.271 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70150]: 2024-09-15 22:26:20.008589911 +0000 UTC m=+0.612513813 container remove d6367dc968aa2b259f6bac5a6795bb0f8c98f0f7f3adffdeb600eaad79161785 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:26:20.679 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:20 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:20.605+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:20 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:20.605+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:20 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:20.605+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:20 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:20.605+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:20 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:20.605+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70242]: 2024-09-15 22:26:20.266722024 +0000 UTC m=+0.015728335 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70242]: 2024-09-15 22:26:20.367729134 +0000 UTC m=+0.116735504 container create 9f91950e7fddfe9d089bbbaec666614ba077bb9d412baffd68a586639710e317 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70242]: 2024-09-15 22:26:20.603988046 +0000 UTC m=+0.352994361 container init 9f91950e7fddfe9d089bbbaec666614ba077bb9d412baffd68a586639710e317 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70242]: 2024-09-15 22:26:20.607456297 +0000 UTC m=+0.356462604 container start 9f91950e7fddfe9d089bbbaec666614ba077bb9d412baffd68a586639710e317 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:26:20.680 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70242]: 2024-09-15 22:26:20.67863362 +0000 UTC m=+0.427639939 container attach 9f91950e7fddfe9d089bbbaec666614ba077bb9d412baffd68a586639710e317 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:26:20.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:20 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:20.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:20.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:20 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:20.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:20.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:20 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:20.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:20.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:20 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:20.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:20.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:20.606+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:20.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:20.606+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:20.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:20.606+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:20.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:20.606+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:21.021 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 15 22:26:20 smithi154 podman[70242]: 2024-09-15 22:26:20.797029487 +0000 UTC m=+0.546035793 container died 9f91950e7fddfe9d089bbbaec666614ba077bb9d412baffd68a586639710e317 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:26:21.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T22:26:21.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:21.440 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T22:26:21.440 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T22:26:21.440 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.8 2024-09-15T22:26:21.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:20.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:21.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:20.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:21.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:20.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:21.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:20 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:20.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:21.764 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 systemd[1]: Stopping Ceph osd.8 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:21.764 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.563+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:21.764 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.563+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:21.764 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.563+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:21.764 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.563+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:21.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:21.596+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:21.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:21.596+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:21.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:21.596+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:21.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:21 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:21.596+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:22.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:21 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:21.630+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:22.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:21 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:21.630+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:22.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:21 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:21.630+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:22.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:21 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:21.630+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:22.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:21 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:21.630+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.762+0000 7f3849158640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.762+0000 7f3849158640 -1 osd.8 87 *** Got signal Terminated *** 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:21.762+0000 7f3849158640 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:21.991+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:21.991+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:21.991+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:22.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:21 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:21.991+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:22.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:22 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:22.614+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:22.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:22 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:22.614+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:22.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:22 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:22.614+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:22.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:22 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:22.614+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:22.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:22 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:22.585+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:22.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:22 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:22.585+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:22.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:22 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:22.585+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:22.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:22 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:22.585+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:23.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:22.640+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:23.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:22.640+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:23.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:22.640+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:23.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:22.640+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:23.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:22.640+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:23.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:23.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:23.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:23.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:23.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:23.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:23.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:23.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:23.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:23 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:23.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:23.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:23 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:23.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:23.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:23 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:23.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:23.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:23 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:23.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:23.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:23 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:23.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:23.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:23.573+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:23.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:23.573+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:23.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:23.573+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:23.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:23 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:23.573+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:24.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:23 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:23.612+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:24.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:23 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:23.612+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:24.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:23 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:23.612+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:24.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:23 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:23.612+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:24.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:23 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:23.612+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:24.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:23 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:23.612+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:24.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:24.022+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:24.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:24.022+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:24.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:24.022+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:24.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:24.022+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:24.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:24 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:24.635+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:24.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:24 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:24.635+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:24.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:24 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:24.635+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:24.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:24 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:24.635+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:24.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:24 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:24.635+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:24.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:24.610+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:24.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:24.610+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:24.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:24.610+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:24.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:24 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:24.610+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:25.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:24.594+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:25.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:24.594+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:25.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:24.594+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:25.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:24.594+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:25.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:24.594+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:25.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:24 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:24.594+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:25.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:25.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:25.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:25.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:25.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:25.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:25.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:25.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:25.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:25.062+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:25.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:25 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:25.594+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:25.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:25 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:25.594+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:25.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:25 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:25.594+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:25.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:25 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:25.594+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:25.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:25 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:25.594+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:25.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:25.568+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:25.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:25.568+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:25.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:25.568+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:25.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:25 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:25.568+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:26.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:25.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:26.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:25.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:26.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:25.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:26.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:25.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:26.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:25.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:26.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:25 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:25.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:26.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:26.018+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:26.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:26.018+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:26.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:26.018+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:26.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:26.018+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:26.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:26.018+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:26.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:26 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:26.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:26.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:26 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:26.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:26.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:26 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:26.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:26.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:26 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:26.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:26.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:26 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:26.606+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:26.959 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:26.614+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:30.037459+0000 front 2024-09-15T22:25:30.037521+0000 (oldest deadline 2024-09-15T22:25:54.137368+0000) 2024-09-15T22:26:26.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:26.614+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:34.638063+0000 front 2024-09-15T22:25:34.638156+0000 (oldest deadline 2024-09-15T22:25:59.338198+0000) 2024-09-15T22:26:26.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:26.614+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:43.840493+0000 front 2024-09-15T22:25:43.840546+0000 (oldest deadline 2024-09-15T22:26:10.840784+0000) 2024-09-15T22:26:26.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:26.614+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.141893+0000 front 2024-09-15T22:25:53.141857+0000 (oldest deadline 2024-09-15T22:26:19.041980+0000) 2024-09-15T22:26:26.960 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8[54641]: 2024-09-15T22:26:26.614+0000 7f384575d640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.243648+0000 front 2024-09-15T22:26:01.243704+0000 (oldest deadline 2024-09-15T22:26:25.943792+0000) 2024-09-15T22:26:27.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:26 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:26.589+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:27.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:26 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:26.589+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:27.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:26 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:26.589+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:27.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:26 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:26.589+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:27.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:26 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:26.589+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:27.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:26 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:26.589+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:27.439 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:27 smithi169 podman[72227]: 2024-09-15 22:26:27.175287341 +0000 UTC m=+5.541600482 container died 401387ad03bd486fbaa186096ba969678aeb2a5cc7a1c58e02677cad216c8de5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:26:27.439 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:27 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:27.020+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:27.439 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:27 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:27.020+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:27.439 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:27 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:27.020+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:27.439 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:27 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:27.020+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:27.439 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:27 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:27.020+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:27.709 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:27 smithi169 podman[72227]: 2024-09-15 22:26:27.537368601 +0000 UTC m=+5.903681733 container cleanup 401387ad03bd486fbaa186096ba969678aeb2a5cc7a1c58e02677cad216c8de5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:26:27.709 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:27 smithi169 bash[72227]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8 2024-09-15T22:26:27.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:27 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:27.592+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:27.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:27 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:27.592+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:27.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:27 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:27.592+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:27.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:27 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:27.592+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:27.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:27 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:27.592+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:28.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:27 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:27.577+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:28.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:27 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:27.577+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:28.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:27 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:27.577+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:28.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:27 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:27.577+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:28.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:27 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:27.577+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:28.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:27 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:27.577+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:28.148 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:27 smithi169 podman[72245]: 2024-09-15 22:26:27.797157581 +0000 UTC m=+0.622085121 container remove 401387ad03bd486fbaa186096ba969678aeb2a5cc7a1c58e02677cad216c8de5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:26:28.149 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:28 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:28.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:28.149 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:28 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:28.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:28.149 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:28 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:28.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:28.149 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:28 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:28.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:28.149 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:28 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:28.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:28.451 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:28 smithi169 podman[72335]: 2024-09-15 22:26:28.050217384 +0000 UTC m=+0.016312315 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:28.451 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:28 smithi169 podman[72335]: 2024-09-15 22:26:28.156137442 +0000 UTC m=+0.122232363 container create 3986017a94e6cfbe1d4461098ea7d41976bf91dd130510da5d9269605962dd59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:26:28.451 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:28 smithi169 podman[72335]: 2024-09-15 22:26:28.375356856 +0000 UTC m=+0.341451777 container init 3986017a94e6cfbe1d4461098ea7d41976bf91dd130510da5d9269605962dd59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-15T22:26:28.451 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:28 smithi169 podman[72335]: 2024-09-15 22:26:28.37871943 +0000 UTC m=+0.344814352 container start 3986017a94e6cfbe1d4461098ea7d41976bf91dd130510da5d9269605962dd59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:26:28.451 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:28 smithi169 podman[72335]: 2024-09-15 22:26:28.450261661 +0000 UTC m=+0.416356593 container attach 3986017a94e6cfbe1d4461098ea7d41976bf91dd130510da5d9269605962dd59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:26:28.709 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 15 22:26:28 smithi169 podman[72335]: 2024-09-15 22:26:28.56790884 +0000 UTC m=+0.534003765 container died 3986017a94e6cfbe1d4461098ea7d41976bf91dd130510da5d9269605962dd59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T22:26:28.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:28 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:28.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:28.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:28 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:28.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:28.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:28 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:28.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:28.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:28 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:28.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:28.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:28 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:28.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:29.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:28 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:28.617+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:29.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:28 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:28.617+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:29.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:28 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:28.617+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:29.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:28 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:28.617+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:29.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:28 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:28.617+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:29.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:28 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:28.617+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:29.146 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:29 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:29.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:29.146 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:29 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:29.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:29.146 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:29 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:29.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:29.146 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:29 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:29.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:29.146 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:29 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:29.011+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:29.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T22:26:29.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:29.248 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T22:26:29.248 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T22:26:29.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.9 2024-09-15T22:26:29.564 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 systemd[1]: Stopping Ceph osd.9 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:29.564 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.561+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:29.564 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.561+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:29.564 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.561+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:29.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.561+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:29.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.561+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:29.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.680+0000 7fada1600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:29.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.680+0000 7fada1600640 -1 osd.9 87 *** Got signal Terminated *** 2024-09-15T22:26:29.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:29 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:29.680+0000 7fada1600640 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:26:30.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:29 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:29.586+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:30.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:29 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:29.586+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:30.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:29 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:29.586+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:30.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:29 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:29.586+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:30.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:29 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:29.586+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:30.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:29 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:29.586+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:30.371 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:30.043+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:30.371 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:30.043+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:30.371 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:30.043+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:30.371 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:30.043+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:30.371 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:30.043+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:30.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:30 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:30.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:30.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:30 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:30.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:30.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:30 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:30.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:30.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:30 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:30.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:30.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:30 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:30.611+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:31.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:30 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:30.557+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:31.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:30 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:30.557+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:31.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:30 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:30.557+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:31.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:30 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:30.557+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:31.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:30 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:30.557+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:31.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:30 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:30.557+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:31.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:31 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:31.007+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:31.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:31 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:31.007+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:31.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:31 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:31.007+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:31.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:31 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:31.007+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:31.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:31 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:31.007+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:31.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:31.515+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:31.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:31.515+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:31.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:31.515+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:31.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:31.515+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:31.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:31.515+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:31.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:31 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:31.515+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:31.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:31 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:31.618+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:31.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:31 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:31.618+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:31.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:31 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:31.618+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:31.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:31 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:31.618+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:31.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:31 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:31.618+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:32.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:32 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:32.052+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:32.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:32 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:32.052+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:32.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:32 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:32.052+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:32.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:32 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:32.052+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:32.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:32 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:32.052+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:32.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:32 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:32.490+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:32.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:32 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:32.490+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:32.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:32 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:32.490+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:32.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:32 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:32.490+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:32.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:32 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:32.490+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:32.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:32 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:32.490+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:32.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:32 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:32.589+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:32.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:32 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:32.589+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:32.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:32 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:32.589+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:32.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:32 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:32.589+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:32.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:32 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:32.589+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:33.361 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:33.028+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:33.361 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:33.028+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:33.361 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:33.028+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:33.361 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:33.028+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:33.361 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:33.028+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:33.361 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:33 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:33.028+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:33.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:33 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:33.511+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:33.771 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:33 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:33.511+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:33.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:33 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:33.511+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:33.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:33 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:33.511+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:33.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:33 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:33.511+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:33.772 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:33 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:33.511+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:33.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:33 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:33.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:33.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:33 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:33.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:33.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:33 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:33.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:33.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:33 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:33.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:33.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:33 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:33.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:33.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:33 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:33.590+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:07.340861+0000 front 2024-09-15T22:26:07.340842+0000 (oldest deadline 2024-09-15T22:26:33.240844+0000) 2024-09-15T22:26:34.373 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:34.045+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:34.374 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:34.045+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:34.374 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:34.045+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:34.374 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:34.045+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:34.374 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:34.045+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:34.374 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:34.045+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:34.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:34.569+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:18.631912+0000 front 2024-09-15T22:25:18.632296+0000 (oldest deadline 2024-09-15T22:25:42.731950+0000) 2024-09-15T22:26:34.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:34.569+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.535221+0000 front 2024-09-15T22:25:29.535059+0000 (oldest deadline 2024-09-15T22:25:53.635238+0000) 2024-09-15T22:26:34.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:34.569+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:35.936351+0000 front 2024-09-15T22:25:35.936519+0000 (oldest deadline 2024-09-15T22:25:58.836171+0000) 2024-09-15T22:26:34.926 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:34.569+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:42.337013+0000 front 2024-09-15T22:25:42.337060+0000 (oldest deadline 2024-09-15T22:26:08.237033+0000) 2024-09-15T22:26:34.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:34.569+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:00.439654+0000 front 2024-09-15T22:26:00.439595+0000 (oldest deadline 2024-09-15T22:26:23.339412+0000) 2024-09-15T22:26:34.927 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:34 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9[65181]: 2024-09-15T22:26:34.569+0000 7fad9d000640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:07.340861+0000 front 2024-09-15T22:26:07.340842+0000 (oldest deadline 2024-09-15T22:26:33.240844+0000) 2024-09-15T22:26:35.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:35.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:35.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:35.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:35.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:35.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:35.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:34 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:34.560+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:35.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:35 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:35.024+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:35.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:35 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:35.024+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:35.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:35 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:35.024+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:35.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:35 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:35.024+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:35.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:35 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:35.024+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:35.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:35 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:35.024+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:35.517 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:35 smithi150 podman[94274]: 2024-09-15 22:26:35.263845886 +0000 UTC m=+5.732271450 container died 4d89312107aab303fbaaa824a557c4c784e5d494e0cc7505b38cdd44eb82021b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-15T22:26:35.813 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:35 smithi150 podman[94274]: 2024-09-15 22:26:35.63533594 +0000 UTC m=+6.103761504 container cleanup 4d89312107aab303fbaaa824a557c4c784e5d494e0cc7505b38cdd44eb82021b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:26:35.813 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:35 smithi150 bash[94274]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9 2024-09-15T22:26:36.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:36.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:36.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:36.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:36.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:36.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:36.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:35 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:35.574+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:36.176 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:35 smithi150 podman[94289]: 2024-09-15 22:26:35.811608306 +0000 UTC m=+0.537049409 container remove 4d89312107aab303fbaaa824a557c4c784e5d494e0cc7505b38cdd44eb82021b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:26:36.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:36.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:36.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:36.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:36.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:36.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.029+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:36.615 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:36 smithi150 podman[94380]: 2024-09-15 22:26:36.244327512 +0000 UTC m=+0.026922980 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:36.616 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:36 smithi150 podman[94380]: 2024-09-15 22:26:36.354193841 +0000 UTC m=+0.136789291 container create 09fb3c843547ea75579c11bcad224cf9f65266b0664a8b4926355e2fd880908a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-15T22:26:36.616 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:36 smithi150 podman[94380]: 2024-09-15 22:26:36.614821492 +0000 UTC m=+0.397416963 container init 09fb3c843547ea75579c11bcad224cf9f65266b0664a8b4926355e2fd880908a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-15T22:26:36.883 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:36 smithi150 podman[94380]: 2024-09-15 22:26:36.621629093 +0000 UTC m=+0.404224543 container start 09fb3c843547ea75579c11bcad224cf9f65266b0664a8b4926355e2fd880908a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-15T22:26:36.883 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:36 smithi150 podman[94380]: 2024-09-15 22:26:36.697951331 +0000 UTC m=+0.480546791 container attach 09fb3c843547ea75579c11bcad224cf9f65266b0664a8b4926355e2fd880908a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-15T22:26:37.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:37.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:37.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:37.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:37.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:37.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:37.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:36 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:36.563+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:37.176 INFO:journalctl@ceph.osd.9.smithi150.stdout:Sep 15 22:26:36 smithi150 podman[94380]: 2024-09-15 22:26:36.882829076 +0000 UTC m=+0.665424539 container died 09fb3c843547ea75579c11bcad224cf9f65266b0664a8b4926355e2fd880908a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:26:37.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:37.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:37.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:37.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:37.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:37.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:36 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:36.993+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:37.505 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T22:26:37.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:37.582 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T22:26:37.582 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T22:26:37.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.10 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.530+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:37.878 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 systemd[1]: Stopping Ceph osd.10 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:37.879 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.875+0000 7f1874b62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:37.879 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.875+0000 7f1874b62640 -1 osd.10 87 *** Got signal Terminated *** 2024-09-15T22:26:37.879 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:37 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:37.875+0000 7f1874b62640 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:26:38.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:38.015+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:38.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:38.015+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:38.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:38.015+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:38.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:38.015+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:38.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:38.015+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:38.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:38.015+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:39.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:39.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:39.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:39.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:39.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:39.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:39.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:38 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:38.576+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:39.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:39 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:39.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:39.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:39 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:39.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:39.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:39 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:39.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:39.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:39 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:39.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:39.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:39 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:39.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:39.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:39 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:39.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:40.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:40.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:40.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:40.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:40.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:40.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:40.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:39 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:39.620+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:40.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:40.104+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:40.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:40.104+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:40.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:40.104+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:40.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:40.104+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:40.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:40.104+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:40.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:40 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:40.104+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:41.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:41.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:41.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:41.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:41.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:41.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:41.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:40 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:40.595+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:41.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:41.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:41.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:41.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:41.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:41.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:41.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:41 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:41.145+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:42.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:42.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:42.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:42.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:42.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:42.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:42.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:41 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:41.572+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:42.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:42.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:42.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:42.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:42.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:42.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:42.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:42 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:42.144+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:43.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:19.637440+0000 front 2024-09-15T22:25:19.637619+0000 (oldest deadline 2024-09-15T22:25:44.937456+0000) 2024-09-15T22:26:43.021 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:27.238347+0000 front 2024-09-15T22:25:27.238374+0000 (oldest deadline 2024-09-15T22:25:50.738563+0000) 2024-09-15T22:26:43.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:37.640756+0000 front 2024-09-15T22:25:37.640790+0000 (oldest deadline 2024-09-15T22:26:01.140954+0000) 2024-09-15T22:26:43.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6814 osd.3 since back 2024-09-15T22:25:45.142705+0000 front 2024-09-15T22:25:45.142576+0000 (oldest deadline 2024-09-15T22:26:11.042518+0000) 2024-09-15T22:26:43.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:53.343472+0000 front 2024-09-15T22:25:53.343502+0000 (oldest deadline 2024-09-15T22:26:15.544254+0000) 2024-09-15T22:26:43.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:02.347231+0000 front 2024-09-15T22:26:02.347411+0000 (oldest deadline 2024-09-15T22:26:23.447064+0000) 2024-09-15T22:26:43.022 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:42 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10[59293]: 2024-09-15T22:26:42.565+0000 7f186d15f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:08.748420+0000 front 2024-09-15T22:26:08.748441+0000 (oldest deadline 2024-09-15T22:26:34.048073+0000) 2024-09-15T22:26:43.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:43.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:43.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:43.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:43.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:43.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:43.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:43 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:43.113+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:43.603 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:43 smithi154 podman[70346]: 2024-09-15 22:26:43.339279229 +0000 UTC m=+5.558362720 container died a578f84453105f6d6221f9dde13131489070c28c18824bd47ab965474902dcf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-15T22:26:43.977 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:43 smithi154 podman[70346]: 2024-09-15 22:26:43.700544365 +0000 UTC m=+5.919627853 container cleanup a578f84453105f6d6221f9dde13131489070c28c18824bd47ab965474902dcf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:26:43.978 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:43 smithi154 bash[70346]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10 2024-09-15T22:26:44.271 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:43 smithi154 podman[70363]: 2024-09-15 22:26:43.97691071 +0000 UTC m=+0.640933949 container remove a578f84453105f6d6221f9dde13131489070c28c18824bd47ab965474902dcf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-15T22:26:44.421 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:44.421 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:44.421 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:44.421 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:44.422 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:44.422 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:44.422 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:44 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:44.105+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:44.556 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:44 smithi154 podman[70454]: 2024-09-15 22:26:44.187228038 +0000 UTC m=+0.015843406 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:44.556 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:44 smithi154 podman[70454]: 2024-09-15 22:26:44.294280774 +0000 UTC m=+0.122896140 container create 4ce0191905951d814c3ee197244390cdc7ee0648bd8d7da91e87744141295919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T22:26:44.556 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:44 smithi154 podman[70454]: 2024-09-15 22:26:44.480245141 +0000 UTC m=+0.308860504 container init 4ce0191905951d814c3ee197244390cdc7ee0648bd8d7da91e87744141295919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T22:26:44.556 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:44 smithi154 podman[70454]: 2024-09-15 22:26:44.48434948 +0000 UTC m=+0.312964845 container start 4ce0191905951d814c3ee197244390cdc7ee0648bd8d7da91e87744141295919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:26:44.557 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:44 smithi154 podman[70454]: 2024-09-15 22:26:44.555120284 +0000 UTC m=+0.383735647 container attach 4ce0191905951d814c3ee197244390cdc7ee0648bd8d7da91e87744141295919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-15T22:26:44.892 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 15 22:26:44 smithi154 podman[70477]: 2024-09-15 22:26:44.700681666 +0000 UTC m=+0.016968688 container died 4ce0191905951d814c3ee197244390cdc7ee0648bd8d7da91e87744141295919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-15T22:26:45.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T22:26:45.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:45.223 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T22:26:45.223 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T22:26:45.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.11 2024-09-15T22:26:45.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.070+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:45.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 systemd[1]: Stopping Ceph osd.11 for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:45.959 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.547+0000 7f0c5d7f4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:45.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.547+0000 7f0c5d7f4640 -1 osd.11 87 *** Got signal Terminated *** 2024-09-15T22:26:45.960 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:45 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:45.547+0000 7f0c5d7f4640 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:26:46.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:46.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:46.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:46.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:46.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:46.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:46.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:46 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:46.094+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:47.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:47.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:47.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:47.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:47.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:47.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:47.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:47 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:47.060+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:48.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:48.459 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:48.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:48.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:48.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:48.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:48.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:48.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:48 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:48.096+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6820 osd.8 since back 2024-09-15T22:26:22.084131+0000 front 2024-09-15T22:26:22.084152+0000 (oldest deadline 2024-09-15T22:26:47.384167+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:49.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:49.461 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:49 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:49.048+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6820 osd.8 since back 2024-09-15T22:26:22.084131+0000 front 2024-09-15T22:26:22.084152+0000 (oldest deadline 2024-09-15T22:26:47.384167+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6806 osd.0 since back 2024-09-15T22:25:20.473423+0000 front 2024-09-15T22:25:20.473519+0000 (oldest deadline 2024-09-15T22:25:45.173513+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-15T22:25:29.775314+0000 front 2024-09-15T22:25:29.775337+0000 (oldest deadline 2024-09-15T22:25:50.875442+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-15T22:25:32.477013+0000 front 2024-09-15T22:25:32.477043+0000 (oldest deadline 2024-09-15T22:26:00.677777+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-15T22:25:52.979770+0000 front 2024-09-15T22:25:52.979683+0000 (oldest deadline 2024-09-15T22:26:15.879614+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-15T22:26:01.780465+0000 front 2024-09-15T22:26:01.780485+0000 (oldest deadline 2024-09-15T22:26:24.680654+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.150:6822 osd.6 since back 2024-09-15T22:26:10.482495+0000 front 2024-09-15T22:26:10.482404+0000 (oldest deadline 2024-09-15T22:26:32.782377+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-15T22:26:18.683417+0000 front 2024-09-15T22:26:18.683489+0000 (oldest deadline 2024-09-15T22:26:40.383234+0000) 2024-09-15T22:26:50.460 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11[61252]: 2024-09-15T22:26:50.006+0000 7f0c59df9640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.169:6820 osd.8 since back 2024-09-15T22:26:22.084131+0000 front 2024-09-15T22:26:22.084152+0000 (oldest deadline 2024-09-15T22:26:47.384167+0000) 2024-09-15T22:26:51.241 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:50 smithi169 podman[72451]: 2024-09-15 22:26:50.974839449 +0000 UTC m=+5.554266706 container died 45205e195884ca099a0138b70ed8653149ef98c96cea30e45749115fa4099166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-15T22:26:51.591 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:51 smithi169 podman[72451]: 2024-09-15 22:26:51.338972094 +0000 UTC m=+5.918399361 container cleanup 45205e195884ca099a0138b70ed8653149ef98c96cea30e45749115fa4099166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-15T22:26:51.591 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:51 smithi169 bash[72451]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11 2024-09-15T22:26:51.913 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:51 smithi169 podman[72468]: 2024-09-15 22:26:51.590258058 +0000 UTC m=+0.602217392 container remove 45205e195884ca099a0138b70ed8653149ef98c96cea30e45749115fa4099166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T22:26:52.209 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:51 smithi169 podman[72554]: 2024-09-15 22:26:51.814747676 +0000 UTC m=+0.015956354 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:26:52.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:51 smithi169 podman[72554]: 2024-09-15 22:26:51.924251304 +0000 UTC m=+0.125459967 container create c0ae0ecc2a751fc22f5ec6dd41c41e7d51e912d9021f09d661da0e718decb7ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-15T22:26:52.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:52 smithi169 podman[72554]: 2024-09-15 22:26:52.13524365 +0000 UTC m=+0.336452320 container init c0ae0ecc2a751fc22f5ec6dd41c41e7d51e912d9021f09d661da0e718decb7ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-15T22:26:52.210 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:52 smithi169 podman[72554]: 2024-09-15 22:26:52.138421957 +0000 UTC m=+0.339630624 container start c0ae0ecc2a751fc22f5ec6dd41c41e7d51e912d9021f09d661da0e718decb7ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T22:26:52.622 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:52 smithi169 podman[72554]: 2024-09-15 22:26:52.21017821 +0000 UTC m=+0.411386888 container attach c0ae0ecc2a751fc22f5ec6dd41c41e7d51e912d9021f09d661da0e718decb7ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-15T22:26:52.622 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 15 22:26:52 smithi169 podman[72554]: 2024-09-15 22:26:52.327356693 +0000 UTC m=+0.528565362 container died c0ae0ecc2a751fc22f5ec6dd41c41e7d51e912d9021f09d661da0e718decb7ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-15T22:26:52.908 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T22:26:52.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:52.947 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T22:26:52.947 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T22:26:52.948 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.a 2024-09-15T22:26:53.359 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:53 smithi150 systemd[1]: Stopping Ceph mds.a for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:53.676 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:53 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a[72197]: 2024-09-15T22:26:53.356+0000 7faf2f600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:53.676 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:53 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a[72197]: 2024-09-15T22:26:53.356+0000 7faf2f600640 -1 mds.a *** got signal Terminated *** 2024-09-15T22:26:57.630 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:57 smithi150 podman[94495]: 2024-09-15 22:26:57.343202459 +0000 UTC m=+4.111267210 container died eddaef94981213c114de2aef329749fd7f71bf995c937cba34e8745c3c4d49cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-15T22:26:57.926 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:57 smithi150 podman[94495]: 2024-09-15 22:26:57.744465913 +0000 UTC m=+4.512530640 container cleanup eddaef94981213c114de2aef329749fd7f71bf995c937cba34e8745c3c4d49cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T22:26:57.926 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:57 smithi150 bash[94495]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a 2024-09-15T22:26:58.179 INFO:journalctl@ceph.mds.a.smithi150.stdout:Sep 15 22:26:58 smithi150 podman[94507]: 2024-09-15 22:26:58.029381758 +0000 UTC m=+0.673210924 container remove eddaef94981213c114de2aef329749fd7f71bf995c937cba34e8745c3c4d49cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T22:26:58.198 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T22:26:58.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:26:58.270 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T22:26:58.270 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T22:26:58.270 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.d 2024-09-15T22:26:58.653 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:26:58 smithi150 systemd[1]: Stopping Ceph mds.d for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:26:58.926 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:26:58 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d[71027]: 2024-09-15T22:26:58.651+0000 7f14eba00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:26:58.926 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:26:58 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d[71027]: 2024-09-15T22:26:58.651+0000 7f14eba00640 -1 mds.d *** got signal Terminated *** 2024-09-15T22:27:01.852 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:27:01 smithi150 podman[94615]: 2024-09-15 22:27:01.59331515 +0000 UTC m=+3.058445309 container died 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T22:27:02.126 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:27:01 smithi150 podman[94615]: 2024-09-15 22:27:01.956847822 +0000 UTC m=+3.421977976 container cleanup 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:27:02.126 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:27:01 smithi150 bash[94615]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d 2024-09-15T22:27:02.377 INFO:journalctl@ceph.mds.d.smithi150.stdout:Sep 15 22:27:02 smithi150 podman[94640]: 2024-09-15 22:27:02.124772725 +0000 UTC m=+0.522254217 container remove 5a696de46c8dde70ba76e48b24a22583c346c147f69b8038aef59f0642d3476c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:27:02.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T22:27:02.460 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:02.460 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T22:27:02.461 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T22:27:02.461 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.g 2024-09-15T22:27:02.676 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:27:02 smithi150 systemd[1]: Stopping Ceph mds.g for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:03.176 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:27:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g[71788]: 2024-09-15T22:27:02.838+0000 7f5d46a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:03.176 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:27:02 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g[71788]: 2024-09-15T22:27:02.838+0000 7f5d46a00640 -1 mds.g *** got signal Terminated *** 2024-09-15T22:27:06.030 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:27:05 smithi150 podman[94750]: 2024-09-15 22:27:05.748794626 +0000 UTC m=+3.019143686 container died ee9ee4ad915d61b02b140978cc892f35ddee1e418beea103a0fcfeb1ad98ced2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T22:27:06.426 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:27:06 smithi150 podman[94750]: 2024-09-15 22:27:06.135582224 +0000 UTC m=+3.405931282 container cleanup ee9ee4ad915d61b02b140978cc892f35ddee1e418beea103a0fcfeb1ad98ced2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-15T22:27:06.426 INFO:journalctl@ceph.mds.g.smithi150.stdout:Sep 15 22:27:06 smithi150 bash[94750]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-g 2024-09-15T22:27:06.643 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T22:27:06.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:06.714 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T22:27:06.714 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T22:27:06.714 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.j 2024-09-15T22:27:07.176 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:06 smithi150 systemd[1]: Stopping Ceph mds.j for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:07.676 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j[70637]: 2024-09-15T22:27:07.318+0000 7f76b9c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:07.676 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:07 smithi150 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j[70637]: 2024-09-15T22:27:07.318+0000 7f76b9c00640 -1 mds.j *** got signal Terminated *** 2024-09-15T22:27:09.675 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:09 smithi150 podman[94869]: 2024-09-15 22:27:09.34496915 +0000 UTC m=+2.357101768 container died e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True) 2024-09-15T22:27:09.926 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:09 smithi150 podman[94869]: 2024-09-15 22:27:09.78130127 +0000 UTC m=+2.793433888 container cleanup e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-15T22:27:09.926 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:09 smithi150 bash[94869]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j 2024-09-15T22:27:10.268 INFO:journalctl@ceph.mds.j.smithi150.stdout:Sep 15 22:27:10 smithi150 podman[94881]: 2024-09-15 22:27:10.015987341 +0000 UTC m=+0.655414862 container remove e5b2db46df2b41fee5c4f328d80768e73f02b0bb2747f2e94d5ad3d1b533dc07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T22:27:10.275 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T22:27:10.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:10.346 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T22:27:10.346 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T22:27:10.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.b 2024-09-15T22:27:10.710 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:10 smithi154 systemd[1]: Stopping Ceph mds.b for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:11.021 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:27:10.708+0000 7f2950afb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:11.021 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:10 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b[64823]: 2024-09-15T22:27:10.708+0000 7f2950afb640 -1 mds.b *** got signal Terminated *** 2024-09-15T22:27:13.585 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:13 smithi154 podman[70558]: 2024-09-15 22:27:13.329112034 +0000 UTC m=+2.783488199 container died 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T22:27:13.843 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:13 smithi154 podman[70558]: 2024-09-15 22:27:13.658184808 +0000 UTC m=+3.112560971 container cleanup 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-15T22:27:13.844 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:13 smithi154 bash[70558]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b 2024-09-15T22:27:14.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T22:27:14.114 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:13 smithi154 podman[70573]: 2024-09-15 22:27:13.842727651 +0000 UTC m=+0.512051980 container remove 7c4b4dcb2dde57c60ec53c25ec87f3146bd2de934dfac8e8c7a9b9bd2511d6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T22:27:14.114 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:14 smithi154 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-15T22:27:14.115 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:14 smithi154 systemd[1]: Stopped Ceph mds.b for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:27:14.115 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 15 22:27:14 smithi154 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.b.service: Consumed 4min 39.917s CPU time. 2024-09-15T22:27:14.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:14.128 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T22:27:14.129 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T22:27:14.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.e 2024-09-15T22:27:14.438 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:27:14 smithi154 systemd[1]: Stopping Ceph mds.e for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:14.771 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:27:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e[64221]: 2024-09-15T22:27:14.436+0000 7fd25a0d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:14.771 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:27:14 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e[64221]: 2024-09-15T22:27:14.436+0000 7fd25a0d3640 -1 mds.e *** got signal Terminated *** 2024-09-15T22:27:17.605 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:27:17 smithi154 podman[70681]: 2024-09-15 22:27:17.335791778 +0000 UTC m=+2.991245407 container died f237e2dabed1f49bb5f76e7ef14f2ebbdf955ae68806ae8ad2b595b3077145e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:27:17.947 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:27:17 smithi154 podman[70681]: 2024-09-15 22:27:17.703759569 +0000 UTC m=+3.359213184 container cleanup f237e2dabed1f49bb5f76e7ef14f2ebbdf955ae68806ae8ad2b595b3077145e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:27:17.948 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 15 22:27:17 smithi154 bash[70681]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-e 2024-09-15T22:27:18.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T22:27:18.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:18.103 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T22:27:18.103 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T22:27:18.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.h 2024-09-15T22:27:18.271 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:27:18 smithi154 systemd[1]: Stopping Ceph mds.h for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:18.771 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:27:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h[64523]: 2024-09-15T22:27:18.424+0000 7f5944acd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:18.771 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:27:18 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h[64523]: 2024-09-15T22:27:18.424+0000 7f5944acd640 -1 mds.h *** got signal Terminated *** 2024-09-15T22:27:21.619 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:27:21 smithi154 podman[70811]: 2024-09-15 22:27:21.333877712 +0000 UTC m=+3.005234867 container died 708640c9fd1eb27e84a67efc48037053c9f31a805eab30e11449e183e8aea80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:27:21.968 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:27:21 smithi154 podman[70811]: 2024-09-15 22:27:21.682427415 +0000 UTC m=+3.353784567 container cleanup 708640c9fd1eb27e84a67efc48037053c9f31a805eab30e11449e183e8aea80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:27:21.968 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 15 22:27:21 smithi154 bash[70811]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-h 2024-09-15T22:27:22.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T22:27:22.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:22.145 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T22:27:22.145 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T22:27:22.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.k 2024-09-15T22:27:22.521 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:27:22 smithi154 systemd[1]: Stopping Ceph mds.k for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:22.521 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:27:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k[63906]: 2024-09-15T22:27:22.452+0000 7f39e2e42640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:22.521 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:27:22 smithi154 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k[63906]: 2024-09-15T22:27:22.452+0000 7f39e2e42640 -1 mds.k *** got signal Terminated *** 2024-09-15T22:27:25.596 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:27:25 smithi154 podman[70933]: 2024-09-15 22:27:25.331588062 +0000 UTC m=+2.962412681 container died d4d313e0dadb8e367cbcf60530693a7fe4ae13fc5b306dc9068bf76c8030f896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-15T22:27:25.931 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:27:25 smithi154 podman[70933]: 2024-09-15 22:27:25.677806618 +0000 UTC m=+3.308631279 container cleanup d4d313e0dadb8e367cbcf60530693a7fe4ae13fc5b306dc9068bf76c8030f896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:27:25.931 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 15 22:27:25 smithi154 bash[70933]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-k 2024-09-15T22:27:26.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T22:27:26.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:26.129 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T22:27:26.129 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T22:27:26.129 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.c 2024-09-15T22:27:26.456 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:27:26 smithi169 systemd[1]: Stopping Ceph mds.c for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:26.709 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:27:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c[66218]: 2024-09-15T22:27:26.454+0000 7f6fcdaf1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:26.709 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:27:26 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c[66218]: 2024-09-15T22:27:26.454+0000 7f6fcdaf1640 -1 mds.c *** got signal Terminated *** 2024-09-15T22:27:29.581 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:27:29 smithi169 podman[72656]: 2024-09-15 22:27:29.317235462 +0000 UTC m=+2.989323122 container died bd2a963b669bdd12f30f4f0a552590351455785ab9bc28f865035b091118a298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T22:27:29.939 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:27:29 smithi169 podman[72656]: 2024-09-15 22:27:29.670913112 +0000 UTC m=+3.343000772 container cleanup bd2a963b669bdd12f30f4f0a552590351455785ab9bc28f865035b091118a298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T22:27:29.940 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 15 22:27:29 smithi169 bash[72656]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-c 2024-09-15T22:27:30.062 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T22:27:30.098 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:30.098 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T22:27:30.099 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T22:27:30.099 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.f 2024-09-15T22:27:30.212 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:27:30 smithi169 systemd[1]: Stopping Ceph mds.f for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:30.709 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:27:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f[65919]: 2024-09-15T22:27:30.449+0000 7f06b14b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:30.710 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:27:30 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f[65919]: 2024-09-15T22:27:30.449+0000 7f06b14b2640 -1 mds.f *** got signal Terminated *** 2024-09-15T22:27:33.610 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:27:33 smithi169 podman[72789]: 2024-09-15 22:27:33.31826302 +0000 UTC m=+2.993828792 container died 75a7e58eea1c513282855d02a1261aabc51a30daf65b034bfe4e1963749d8131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True) 2024-09-15T22:27:33.943 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:27:33 smithi169 podman[72789]: 2024-09-15 22:27:33.683220299 +0000 UTC m=+3.358786072 container cleanup 75a7e58eea1c513282855d02a1261aabc51a30daf65b034bfe4e1963749d8131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T22:27:33.943 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 15 22:27:33 smithi169 bash[72789]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-f 2024-09-15T22:27:34.074 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T22:27:34.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:34.107 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T22:27:34.108 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T22:27:34.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.i 2024-09-15T22:27:34.459 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:27:34 smithi169 systemd[1]: Stopping Ceph mds.i for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:34.459 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:27:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i[66519]: 2024-09-15T22:27:34.436+0000 7f6d062b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:34.459 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:27:34 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i[66519]: 2024-09-15T22:27:34.436+0000 7f6d062b3640 -1 mds.i *** got signal Terminated *** 2024-09-15T22:27:37.459 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:27:37 smithi169 podman[72913]: 2024-09-15 22:27:37.305020476 +0000 UTC m=+2.969341127 container died 244e3035a0116bcdb408edb359d54b7482d9a28de9983730f0a05714548f82ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:27:37.959 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:27:37 smithi169 podman[72913]: 2024-09-15 22:27:37.778609666 +0000 UTC m=+3.442930324 container cleanup 244e3035a0116bcdb408edb359d54b7482d9a28de9983730f0a05714548f82ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T22:27:37.959 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 15 22:27:37 smithi169 bash[72913]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-i 2024-09-15T22:27:38.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T22:27:38.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:38.232 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T22:27:38.232 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T22:27:38.232 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.l 2024-09-15T22:27:38.459 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:38 smithi169 systemd[1]: Stopping Ceph mds.l for faa38c0e-73ad-11ef-bceb-c7b262605968... 2024-09-15T22:27:38.959 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l[65604]: 2024-09-15T22:27:38.706+0000 7fe7a782e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:38.959 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:38 smithi169 ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l[65604]: 2024-09-15T22:27:38.706+0000 7fe7a782e640 -1 mds.l *** got signal Terminated *** 2024-09-15T22:27:41.625 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:41 smithi169 podman[73035]: 2024-09-15 22:27:41.301641123 +0000 UTC m=+2.852276516 container died 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T22:27:41.918 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:41 smithi169 podman[73035]: 2024-09-15 22:27:41.724108153 +0000 UTC m=+3.274743549 container cleanup 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:27:41.918 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:41 smithi169 bash[73035]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l 2024-09-15T22:27:42.152 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T22:27:42.173 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:41 smithi169 podman[73049]: 2024-09-15 22:27:41.916867953 +0000 UTC m=+0.607762266 container remove 7755148e2dd0442ff42a090978f04463ed83dfaeffcf05219781a3693923a802 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-faa38c0e-73ad-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T22:27:42.173 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:42 smithi169 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-15T22:27:42.173 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:42 smithi169 systemd[1]: Stopped Ceph mds.l for faa38c0e-73ad-11ef-bceb-c7b262605968. 2024-09-15T22:27:42.174 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 15 22:27:42 smithi169 systemd[1]: ceph-faa38c0e-73ad-11ef-bceb-c7b262605968@mds.l.service: Consumed 22.796s CPU time. 2024-09-15T22:27:42.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:42.184 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T22:27:42.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:27:42.459 INFO:teuthology.orchestra.run.smithi150.stdout:Deleting cluster with fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:27:46.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:27:46.609 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:27:49.193 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:27:49.397 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:27:51.911 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:27:51.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:27:52.010 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:27:52.037 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T22:27:52.039 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi150/crash 2024-09-15T22:27:52.040 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:27:52.096 INFO:teuthology.orchestra.run.smithi150.stderr:tar: /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:27:52.096 INFO:teuthology.orchestra.run.smithi150.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:27:52.099 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi154/crash 2024-09-15T22:27:52.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:27:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:27:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:27:52.149 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi169/crash 2024-09-15T22:27:52.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:27:52.190 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:27:52.190 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:27:52.191 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T22:27:52.191 DEBUG:teuthology.orchestra.run.smithi150:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T22:27:52.270 INFO:tasks.cephadm:Compressing logs... 2024-09-15T22:27:52.270 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:27:52.274 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:27:52.277 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:27:52.304 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:: No such file or directory 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T22:27:52.305 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T22:27:52.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T22:27:52.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T22:27:52.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T22:27:52.306 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-09-15T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose --/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.k.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T22:27:52.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:27:52.324 INFO:teuthology.orchestra.run.smithi150.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T22:27:52.324 INFO:teuthology.orchestra.run.smithi150.stderr:: No such file or directory 2024-09-15T22:27:52.324 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T22:27:52.325 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:27:52.326 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:27:52.327 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T22:27:52.328 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:27:52.329 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T22:27:52.330 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log: 90.4% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:27:52.331 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T22:27:52.331 INFO:teuthology.orchestra.run.smithi150.stderr: 82.5% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:27:52.332 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T22:27:52.333 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:27:52.337 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T22:27:52.339 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- 94.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T22:27:52.339 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T22:27:52.340 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T22:27:52.341 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% 91.0% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:27:52.342 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:27:52.345 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.d.log: /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T22:27:52.349 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T22:27:52.353 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:27:52.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/cephadm.log: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:27:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.4% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:27:52.424 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.4% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:27:52.425 INFO:teuthology.orchestra.run.smithi169.stderr: 90.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:27:52.432 INFO:teuthology.orchestra.run.smithi169.stderr: 86.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:27:52.443 INFO:teuthology.orchestra.run.smithi169.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:27:52.444 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T22:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr: 86.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:27:52.506 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:27:52.508 INFO:teuthology.orchestra.run.smithi169.stderr: 93.0% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T22:27:52.533 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:27:52.613 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:27:52.659 INFO:teuthology.orchestra.run.smithi150.stderr: 90.5% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T22:27:52.901 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T22:27:53.639 INFO:teuthology.orchestra.run.smithi150.stderr: 90.3% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T22:27:53.945 INFO:teuthology.orchestra.run.smithi154.stderr: 90.8% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:27:54.234 INFO:teuthology.orchestra.run.smithi154.stderr: 91.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T22:28:00.917 INFO:teuthology.orchestra.run.smithi150.stderr: 94.8% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T22:28:04.267 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T22:28:04.904 INFO:teuthology.orchestra.run.smithi169.stderr: 95.8% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T22:28:05.955 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T22:28:06.341 INFO:teuthology.orchestra.run.smithi169.stderr: 95.4% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T22:28:06.442 INFO:teuthology.orchestra.run.smithi150.stderr: 95.5% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T22:28:07.131 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T22:28:07.398 INFO:teuthology.orchestra.run.smithi150.stderr: 93.4% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T22:28:07.401 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-15T22:28:07.401 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m15.098s 2024-09-15T22:28:07.401 INFO:teuthology.orchestra.run.smithi150.stderr:user 1m13.163s 2024-09-15T22:28:07.401 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m6.649s 2024-09-15T22:28:08.319 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T22:28:08.778 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T22:28:09.166 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T22:28:10.548 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T22:28:52.172 INFO:teuthology.orchestra.run.smithi154.stderr: 95.5% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T22:29:00.518 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T22:29:31.332 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T22:29:31.333 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-15T22:29:31.333 INFO:teuthology.orchestra.run.smithi169.stderr:real 1m39.042s 2024-09-15T22:29:31.333 INFO:teuthology.orchestra.run.smithi169.stderr:user 3m49.641s 2024-09-15T22:29:31.333 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m7.308s 2024-09-15T22:29:39.029 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T22:30:15.123 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T22:30:34.633 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T22:30:38.101 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T22:43:39.640 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T22:43:52.176 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T22:45:37.603 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/faa38c0e-73ad-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T22:45:37.635 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-15T22:45:37.635 INFO:teuthology.orchestra.run.smithi154.stderr:real 17m45.327s 2024-09-15T22:45:37.635 INFO:teuthology.orchestra.run.smithi154.stderr:user 6m47.605s 2024-09-15T22:45:37.636 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m19.145s 2024-09-15T22:45:37.636 INFO:tasks.cephadm:Archiving logs... 2024-09-15T22:45:37.637 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi150/log 2024-09-15T22:45:37.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:45:46.109 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi154/log 2024-09-15T22:45:46.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:46:45.238 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi169/log 2024-09-15T22:46:45.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:47:18.221 INFO:tasks.cephadm:Removing cluster... 2024-09-15T22:47:18.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --force 2024-09-15T22:47:18.497 INFO:teuthology.orchestra.run.smithi150.stdout:Deleting cluster with fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:47:19.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --force 2024-09-15T22:47:19.747 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:47:20.370 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid faa38c0e-73ad-11ef-bceb-c7b262605968 --force 2024-09-15T22:47:20.574 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: faa38c0e-73ad-11ef-bceb-c7b262605968 2024-09-15T22:47:21.145 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T22:47:21.146 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:47:21.186 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:47:21.204 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:47:21.221 INFO:tasks.cephadm:Teardown complete 2024-09-15T22:47:21.221 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:47:21.868 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:47:21.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:47:21.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:47:21.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:47:21.995 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:47:22.404 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:47:22.405 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:47:22.410 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:47:22.412 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:47:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:47:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:47:22.436 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:47:22.436 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-15T22:47:22.436 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +1079us[+1076us] +/- 53ms 2024-09-15T22:47:22.436 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -1007us[-1010us] +/- 51ms 2024-09-15T22:47:22.436 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -256us[ -256us] +/- 75ms 2024-09-15T22:47:22.436 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:47:22.443 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:47:22.451 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:47:22.451 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-15T22:47:22.451 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +1088us[+1040us] +/- 53ms 2024-09-15T22:47:22.451 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 110 -985us[-1032us] +/- 50ms 2024-09-15T22:47:22.451 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -213us[ -261us] +/- 75ms 2024-09-15T22:47:22.451 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:47:22.461 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:47:22.462 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-15T22:47:22.462 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +1050us[ +989us] +/- 53ms 2024-09-15T22:47:22.462 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -1030us[-1030us] +/- 51ms 2024-09-15T22:47:22.462 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -272us[ -272us] +/- 75ms 2024-09-15T22:47:22.462 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:47:22.463 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:47:22.721 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:47:22.722 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:47:22.968 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:47:23.102 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:47:23.210 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:47:23.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:47:23.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:23.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:47:23.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:23.533 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:47:23.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:23.566 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:47:23.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:47:23.610 INFO:teuthology.task.internal:Duration was 3175.357682 seconds 2024-09-15T22:47:23.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:47:23.662 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:47:23.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:47:23.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:47:23.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:47:23.725 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:47:23.729 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:47:23.750 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:47:24.080 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:47:24.080 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-15T22:47:24.080 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:47:24.130 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-15T22:47:24.130 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:47:24.163 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T22:47:24.163 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:47:24.205 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:47:24.205 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:47:24.210 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:47:24.212 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:47:24.276 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:47:24.276 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:47:24.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:47:24.283 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:47:24.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:47:24.914 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:47:24.914 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:47:24.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:47:25.008 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:47:25.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:47:25.046 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:25.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:25.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:25.088 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-15T22:47:25.099 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-15T22:47:25.119 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-15T22:47:25.149 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:25.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:25.183 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:25.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:25.198 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:47:25.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:47:25.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:47:25.225 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:47:25.226 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi150 2024-09-15T22:47:25.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:47:25.302 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi154 2024-09-15T22:47:25.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:47:25.340 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906225/remote/smithi169 2024-09-15T22:47:25.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:47:25.378 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:47:25.379 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:47:25.383 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:47:25.385 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:47:25.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:47:25.441 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:47:25.441 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:47:25.470 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:47:25.470 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:47:25.474 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:47:25.477 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:47:25.490 INFO:teuthology.orchestra.run.smithi154.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:47 /home/ubuntu/cephtest 2024-09-15T22:47:25.492 INFO:teuthology.orchestra.run.smithi169.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:47 /home/ubuntu/cephtest 2024-09-15T22:47:25.505 INFO:teuthology.orchestra.run.smithi150.stdout: 393246 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:47 /home/ubuntu/cephtest 2024-09-15T22:47:25.507 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:47:25.518 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:47:25.622 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} duration: 3175.3576815128326 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:47:25.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:47:25.712 INFO:teuthology.run:pass